yao
|
2e2a0fdf3e
|
Downloader 提供刷新组件的api,方便在spider中操作
|
2020-12-21 18:08:55 +08:00 |
Sutra Zhou
|
48bc73fbff
|
New method Proxy#create.
|
2020-06-24 13:43:16 +08:00 |
|
Sutra Zhou
|
236e5ade44
|
Update Proxy#toString().
|
2020-06-17 11:19:37 +08:00 |
Thomas Perkins
|
2fd0e192fd
|
Add unit tests for us.codecraft.webmagic.utils.NumberUtils
These tests were written using Diffblue Cover.
|
2019-07-30 09:58:54 +01:00 |
yihua.huang
|
b539522ca8
|
#701 support to tls1.2
|
2017-11-29 13:36:19 +08:00 |
|
yihua.huang
|
6f5b9e448e
|
#627 set charset to request
|
2017-07-29 11:27:56 +08:00 |
|
yihua.huang
|
65049baca4
|
#571 fix spell mistake
|
2017-07-29 11:06:17 +08:00 |
|
yihua.huang
|
f375b9fdba
|
#629 fix ut
|
2017-07-25 18:27:10 +08:00 |
|
yihua.huang
|
3266ea15ca
|
#629 correct illegal url in HttpUriRequestConverter
|
2017-07-22 17:40:43 +08:00 |
|
yihua.huang
|
2183ba9b61
|
#571 add getBytes to Page
|
2017-07-22 12:11:00 +08:00 |
|
yihua.huang
|
eb376fca74
|
update jsoup to 1.10.3 #608
|
2017-06-24 11:29:35 +08:00 |
|
yihua.huang
|
faca38d4ec
|
update jsonpath to 2.2.0 #606
|
2017-06-24 11:01:23 +08:00 |
|
yihua.huang
|
3ee00015c2
|
change header from Authorization to Proxy-Authorization for Proxy Authorization #596
|
2017-06-17 16:08:39 +08:00 |
|
yihua.huang
|
592fa2c0f1
|
add site header test
|
2017-06-03 11:56:18 +08:00 |
|
Yihua Huang
|
b6b991a09b
|
Merge pull request #556 from zhuyuesut/master
增加对零宽断言的支持
|
2017-06-03 11:10:56 +08:00 |
|
yihua.huang
|
636359300f
|
add Site.disableCookieManagement #577
|
2017-05-29 08:29:53 +08:00 |
|
yihua.huang
|
3c1338193b
|
for 0.7.0.alpha
|
2017-05-20 12:34:09 +08:00 |
zhuyue
|
c80f25edbd
|
Update RegexSelectorTest.java
简单的增加了一点测试
|
2017-05-03 18:33:23 +08:00 |
|
yihua.huang
|
cbf80af5dd
|
test for SimpleProxyProvider #535
|
2017-04-16 10:50:27 +08:00 |
|
yihua.huang
|
eb632a93d3
|
SimpleProxyProvider #535
|
2017-04-16 10:43:56 +08:00 |
GZhY
|
5f34adf938
|
完善 LinksSelector.selectList 的测试用例
|
2017-04-09 21:29:01 +08:00 |
|
GZhY
|
ce3f0ac239
|
删除 fixAllRelativeHrefs 并修复 SeleniumDownloader 对 fixAllRelativeHrefs 的依赖
|
2017-04-09 21:01:32 +08:00 |
|
yihua.huang
|
1b04a7f2b3
|
#527 move logic check from downloaderto spider
|
2017-04-09 09:23:10 +08:00 |
|
yihua.huang
|
a1ae632b62
|
test for request cookies and headers
|
2017-04-08 23:13:16 +08:00 |
|
yihua.huang
|
db67db8103
|
#523 remove fixAllRelativeHrefs by default, get absolute urls for links()
|
2017-04-08 22:06:18 +08:00 |
|
yihua.huang
|
b06a248c00
|
fix test
|
2017-04-08 20:06:04 +08:00 |
|
yihua.huang
|
83ada9749e
|
fix test
|
2017-04-08 12:16:34 +08:00 |
|
yihua.huang
|
6bd197859b
|
fix test
|
2017-03-27 09:55:50 +08:00 |
|
yihua.huang
|
c13110c4cb
|
fix samples
|
2017-03-21 07:53:43 +08:00 |
|
yihua.huang
|
68050fc88e
|
test pass
|
2017-03-21 07:19:12 +08:00 |
|
yihua.huang
|
a7f9e7cad5
|
重构一部分httpclient
|
2017-03-18 12:16:21 +08:00 |
|
yihua.huang
|
68beff42c5
|
add test #493
|
2017-03-18 11:01:30 +08:00 |
|
yihua.huang
|
e9341d0291
|
complete test #447
|
2017-03-17 07:54:28 +08:00 |
mei
|
791520e6a0
|
fix a bug of RegexSelector when regex has zero-width assertions.
|
2017-03-17 00:06:15 +08:00 |
|
yihua.huang
|
c175ea88c0
|
#more test #484
|
2017-03-11 11:43:18 +08:00 |
|
yihua.huang
|
9b964c0a99
|
test for #484
|
2017-03-11 11:41:01 +08:00 |
|
yihua.huang
|
0a1fb19052
|
add tests #483
|
2017-03-11 10:56:31 +08:00 |
|
yihua.huang
|
1d2171805f
|
add test for #228
|
2017-02-25 22:30:48 +08:00 |
|
yihua.huang
|
00dfebbceb
|
#424 remove guava dep and add fix docs
|
2016-12-18 10:45:50 +08:00 |
|
yihua.huang
|
7476ceccee
|
more stable test
|
2016-12-18 08:15:26 +08:00 |
|
yihua.huang
|
b090dcd20d
|
sepcific error page for HttpClientDownloaderTest to avoid test error when local port is available
|
2016-12-18 07:15:06 +08:00 |
|
yihua.huang
|
2189aab652
|
fix test
|
2016-11-22 16:58:49 +08:00 |
|
yihua.huang
|
507556d0aa
|
fix test: ProxyTest.testProxy() do not load exist proxy config
|
2016-11-19 12:54:39 +08:00 |
|
yihua.huang
|
d8f978fd20
|
fix test in JsonPathSelectorTest #289
|
2016-05-08 19:32:03 +08:00 |
|
yihua.huang
|
61c28a0130
|
refactor on proxypool
|
2016-05-08 17:53:15 +08:00 |
|
yihua.huang
|
b5413368de
|
update ut
|
2016-05-08 16:23:41 +08:00 |
Jon
|
83c27ebbc4
|
增加IP代理认证功能
|
2016-05-08 16:17:58 +08:00 |
|
yihua.huang
|
81ce1ffc5f
|
fix ignore
|
2016-01-21 12:36:49 +08:00 |
|
yihua.huang
|
93764fa2c9
|
ignore some test
|
2016-01-21 12:28:32 +08:00 |
|
yihua.huang
|
5706bb90af
|
update xsoup to 0.3.1
|
2016-01-20 12:59:11 +08:00 |