Commit Graph

1214 Commits (3688226e327266cb3cfd1a1e3777ad94ad68d6f5)

Author SHA1 Message Date
yihua.huang b06a248c00 fix test 2017-04-08 20:06:04 +08:00
yihua.huang 1cfbd13aae refacor in httpclientdownloader 2017-04-08 20:04:56 +08:00
yihua.huang 83ada9749e fix test 2017-04-08 12:16:34 +08:00
yihua.huang fe95a6842f Request再次重构:去掉params,仅保留HttpRequestBody 2017-04-08 12:12:39 +08:00
yihua.huang 395396c68e 增加HttpRequestBody 2017-04-08 11:59:52 +08:00
Yihua Huang 25df6650d9 Merge pull request #513 from xbynet/master
Request支持设置header与cookie、新增POST请求时,XML、JSON参数支持、Page支持获取响应header
2017-04-03 07:57:40 +08:00
xbynet c93a8a2722 修复字符编码检测BUG 2017-03-31 18:27:18 +08:00
yihua.huang 74110e6ec5 remove useless file 2017-03-30 09:19:00 +08:00
yihua.huang b100dfe273 update version 2017-03-30 09:18:12 +08:00
xbynet@outlook.com 1c24baa8d1 Request支持设置header与cookie
新增POST请求时,XML、JSON参数支持
Page支持获取响应header
2017-03-29 02:27:06 +08:00
xbynet 5824e9515b Merge pull request #3 from code4craft/master
合并最新代码
2017-03-29 02:20:16 +08:00
yihua.huang 6bd197859b fix test 2017-03-27 09:55:50 +08:00
yihua.huang f23e138c72 add response headers to Page #508 2017-03-27 09:52:25 +08:00
yihua.huang ba000b364c remove site.addStartUrl in samples 2017-03-21 08:00:15 +08:00
yihua.huang 3824232171 remove site.addStartUrl in samples 2017-03-21 07:59:33 +08:00
yihua.huang 8564d51e56 remove site.addStartUrl in samples 2017-03-21 07:57:56 +08:00
yihua.huang c13110c4cb fix samples 2017-03-21 07:53:43 +08:00
yihua.huang c51ac6017c remove Site.addStartRequest() etc. #494 2017-03-21 07:32:34 +08:00
yihua.huang 68050fc88e test pass 2017-03-21 07:19:12 +08:00
yihua.huang 474b7c9d57 refactor 2017-03-20 23:13:49 +08:00
yihua.huang 25c81013ca new proxy pool api 2017-03-20 22:47:24 +08:00
yihua.huang 46297deaa1 HttpUriRequestConverter 2017-03-20 22:43:32 +08:00
yihua.huang 1d86f7c048 compile passed in httpclientDownloader 2017-03-20 22:40:14 +08:00
yihua.huang b71f379512 fix 2017-03-18 12:18:00 +08:00
yihua.huang a7f9e7cad5 重构一部分httpclient 2017-03-18 12:16:21 +08:00
yihua.huang 221c155060 move release connection before return proxy #396 2017-03-18 11:15:36 +08:00
yihua.huang 68beff42c5 add test #493 2017-03-18 11:01:30 +08:00
Yihua Huang d6b4e98a66 Merge pull request #493 from cheiftain/my_change
Bug, add null check to site in HttpClientDownloader & HttpClientGener…
2017-03-18 10:49:19 +08:00
xbynet 76729c9302 Merge pull request #2 from code4craft/master
合并官方最新代码
2017-03-17 16:07:56 +08:00
wuyifan 79522f941e Bug, add null check to site in HttpClientDownloader & HttpClientGenerator 2017-03-17 14:10:54 +08:00
yihua.huang e9341d0291 complete test #447 2017-03-17 07:54:28 +08:00
yihua.huang e7d35c4846 add params to all method of request #447 2017-03-17 07:18:05 +08:00
yihua.huang 75bad591d7 rewrite hashCode and equals for params #447 2017-03-17 07:10:14 +08:00
Yihua Huang 11c32669b2 Merge pull request #447 from xbynet/master
简化POST参数设置.
2017-03-17 07:06:46 +08:00
yihua.huang aa01e27779 change constructor for Proxy to public #490 2017-03-17 07:02:02 +08:00
yihua.huang 0fbf657d86 update fastjson to 1.2.28 #489 2017-03-17 06:59:28 +08:00
Yihua Huang 676758349f Merge pull request #492 from eyougo/master
fix a bug of RegexSelector when regex has zero-width assertions.
2017-03-17 06:55:07 +08:00
mei 791520e6a0 fix a bug of RegexSelector when regex has zero-width assertions. 2017-03-17 00:06:15 +08:00
yihua.huang c175ea88c0 #more test #484 2017-03-11 11:43:18 +08:00
yihua.huang 9b964c0a99 test for #484 2017-03-11 11:41:01 +08:00
yihua.huang fc702fd3b6 introduce mockito for test 2017-03-11 11:31:15 +08:00
yihua.huang 5215a492cc remove duplicate check for POST request #484 2017-03-11 11:26:13 +08:00
yihua.huang 45bf2b6fd7 remove javadoc link because it's out of date 2017-03-11 11:01:25 +08:00
yihua.huang 2a35bb4688 remove contributors because it's hard to maintain the list: see https://github.com/code4craft/webmagic/graphs/contributors instead 2017-03-11 10:59:55 +08:00
yihua.huang 0a1fb19052 add tests #483 2017-03-11 10:56:31 +08:00
yihua.huang a2e7f0004b Merge branch 'master' of github.com:code4craft/webmagic 2017-03-11 10:52:54 +08:00
yihua.huang ef32571821 rewrite Request.equals and hashCode, add Method to check #483 2017-03-11 10:52:39 +08:00
yihua.huang 8b8f535c30 refactor:extract charset detect to utils 2017-03-11 10:43:10 +08:00
Yihua Huang 50247f9bc6 Merge pull request #478 from ckex/develop
fix bug
2017-03-06 09:43:11 +08:00
Ckex.zha e645524ad2 fix bug,set ExecutorService 2017-03-04 20:57:29 +08:00