yihua.huang
|
4111b07263
|
more error log on page code error #601
|
2017-06-17 10:36:41 +08:00 |
|
yihua.huang
|
6bd1eed25e
|
fix duplicate call of onSuccess and onError #605
|
2017-06-17 10:26:55 +08:00 |
|
yihua.huang
|
3a589d4ca6
|
HttpRequestBody implements Serializable #594
|
2017-06-08 15:59:46 +08:00 |
|
yihua.huang
|
13cdf82695
|
update version to 0.7.2-SNAPSHOT
|
2017-06-05 16:55:59 +08:00 |
|
yihua.huang
|
1e9187f24e
|
version 0.7.1
|
2017-06-04 07:52:54 +08:00 |
|
yihua.huang
|
592fa2c0f1
|
add site header test
|
2017-06-03 11:56:18 +08:00 |
|
yihua.huang
|
19d34dbb65
|
not add bracket to regex in RegexSelector #559
|
2017-06-03 11:30:07 +08:00 |
|
Yihua Huang
|
b6b991a09b
|
Merge pull request #556 from zhuyuesut/master
增加对零宽断言的支持
|
2017-06-03 11:10:56 +08:00 |
|
yihua.huang
|
bb0eb69acf
|
update ZhihuPageProcessor example
|
2017-06-03 10:42:17 +08:00 |
|
yihua.huang
|
2e35e149be
|
for 0.7.1
|
2017-05-29 14:41:49 +08:00 |
|
yihua.huang
|
17d8bfa907
|
docs and pgp version
|
2017-05-29 09:36:42 +08:00 |
|
yihua.huang
|
17478fcfc4
|
0.7.0 release
|
2017-05-29 09:30:56 +08:00 |
|
yihua.huang
|
636359300f
|
add Site.disableCookieManagement #577
|
2017-05-29 08:29:53 +08:00 |
|
yihua.huang
|
49de9374cd
|
new SimpleHttpClient #576
|
2017-05-27 17:30:19 +08:00 |
|
yihua.huang
|
8999ea9320
|
add public constructor for SimpleProxyProvider
|
2017-05-27 16:09:02 +08:00 |
|
yihua.huang
|
a8c2e6c729
|
alpha release
|
2017-05-20 12:51:16 +08:00 |
|
yihua.huang
|
3c1338193b
|
for 0.7.0.alpha
|
2017-05-20 12:34:09 +08:00 |
|
yihua.huang
|
e8abc28072
|
#552 add some log when crawler stop
|
2017-05-20 11:44:51 +08:00 |
zhuyue
|
9e1b7ed3f7
|
Update RegexSelector.java
|
2017-05-05 10:47:10 +08:00 |
|
zhuyue
|
c80f25edbd
|
Update RegexSelectorTest.java
简单的增加了一点测试
|
2017-05-03 18:33:23 +08:00 |
|
zhuyue
|
c3183252ac
|
Update RegexSelector.java
|
2017-05-03 18:24:19 +08:00 |
|
yihua.huang
|
cbf80af5dd
|
test for SimpleProxyProvider #535
|
2017-04-16 10:50:27 +08:00 |
|
yihua.huang
|
eb632a93d3
|
SimpleProxyProvider #535
|
2017-04-16 10:43:56 +08:00 |
|
yihua.huang
|
d38d51dfcb
|
fix javadoc
|
2017-04-15 12:24:50 +08:00 |
GZhY
|
5f34adf938
|
完善 LinksSelector.selectList 的测试用例
|
2017-04-09 21:29:01 +08:00 |
|
GZhY
|
ce3f0ac239
|
删除 fixAllRelativeHrefs 并修复 SeleniumDownloader 对 fixAllRelativeHrefs 的依赖
|
2017-04-09 21:01:32 +08:00 |
|
GZhY
|
bc6e81e00f
|
修复checkElementAndConvert方法注释中注释错误
|
2017-04-09 20:40:00 +08:00 |
|
yihua.huang
|
4a2c0f4f97
|
add returnProxy for proxyProvider
|
2017-04-09 09:28:36 +08:00 |
|
yihua.huang
|
1b04a7f2b3
|
#527 move logic check from downloaderto spider
|
2017-04-09 09:23:10 +08:00 |
|
yihua.huang
|
0f4d6e8b12
|
#525 remove port in UrlUtils.getDomain()
|
2017-04-08 23:17:00 +08:00 |
|
yihua.huang
|
a1ae632b62
|
test for request cookies and headers
|
2017-04-08 23:13:16 +08:00 |
|
yihua.huang
|
db67db8103
|
#523 remove fixAllRelativeHrefs by default, get absolute urls for links()
|
2017-04-08 22:06:18 +08:00 |
|
yihua.huang
|
abd020b45b
|
some comments
|
2017-04-08 20:16:17 +08:00 |
|
yihua.huang
|
2622b448b8
|
fix test
|
2017-04-08 20:09:43 +08:00 |
|
yihua.huang
|
b06a248c00
|
fix test
|
2017-04-08 20:06:04 +08:00 |
|
yihua.huang
|
1cfbd13aae
|
refacor in httpclientdownloader
|
2017-04-08 20:04:56 +08:00 |
|
yihua.huang
|
83ada9749e
|
fix test
|
2017-04-08 12:16:34 +08:00 |
|
yihua.huang
|
fe95a6842f
|
Request再次重构:去掉params，仅保留HttpRequestBody
|
2017-04-08 12:12:39 +08:00 |
|
yihua.huang
|
395396c68e
|
增加HttpRequestBody
|
2017-04-08 11:59:52 +08:00 |
xbynet
|
c93a8a2722
|
修复字符编码检测BUG
|
2017-03-31 18:27:18 +08:00 |
|
yihua.huang
|
74110e6ec5
|
remove useless file
|
2017-03-30 09:19:00 +08:00 |
|
yihua.huang
|
b100dfe273
|
update version
|
2017-03-30 09:18:12 +08:00 |
|
xbynet@outlook.com
|
1c24baa8d1
|
Request支持设置header与cookie
新增POST请求时,XML、JSON参数支持
Page支持获取响应header
|
2017-03-29 02:27:06 +08:00 |
|
yihua.huang
|
6bd197859b
|
fix test
|
2017-03-27 09:55:50 +08:00 |
|
yihua.huang
|
f23e138c72
|
add response headers to Page #508
|
2017-03-27 09:52:25 +08:00 |
|
yihua.huang
|
c13110c4cb
|
fix samples
|
2017-03-21 07:53:43 +08:00 |
|
yihua.huang
|
c51ac6017c
|
remove Site.addStartRequest() etc. #494
|
2017-03-21 07:32:34 +08:00 |
|
yihua.huang
|
68050fc88e
|
test pass
|
2017-03-21 07:19:12 +08:00 |
|
yihua.huang
|
474b7c9d57
|
refactor
|
2017-03-20 23:13:49 +08:00 |
|
yihua.huang
|
25c81013ca
|
new proxy pool api
|
2017-03-20 22:47:24 +08:00 |