yihua.huang
|
6f5b9e448e
|
#627 set charset to request
|
2017-07-29 11:27:56 +08:00 |
|
yihua.huang
|
32f1f2cf44
|
#613 add charset to page
|
2017-07-29 11:16:09 +08:00 |
|
yihua.huang
|
65049baca4
|
#571 fix spell mistake
|
2017-07-29 11:06:17 +08:00 |
|
yihua.huang
|
f375b9fdba
|
#629 fix ut
|
2017-07-25 18:27:10 +08:00 |
|
yihua.huang
|
3266ea15ca
|
#629 correct illegal url in HttpUriRequestConverter
|
2017-07-22 17:40:43 +08:00 |
|
yihua.huang
|
5daf92e8b2
|
#610 CASE_INSENSITIVE for charset detect in Content-Type
|
2017-07-22 17:27:36 +08:00 |
|
yihua.huang
|
2183ba9b61
|
#571 add getBytes to Page
|
2017-07-22 12:11:00 +08:00 |
|
yihua.huang
|
c3bdb20458
|
#631 remove IllegalArgumentException of HttpRequestBody.json and so on
|
2017-07-22 11:49:23 +08:00 |
|
yihua.huang
|
f405e642c0
|
add default constructor for HttpRequestBody #609
|
2017-06-24 11:31:17 +08:00 |
|
yihua.huang
|
eb376fca74
|
update jsoup to 1.10.3 #608
|
2017-06-24 11:29:35 +08:00 |
|
yihua.huang
|
faca38d4ec
|
update jsonpath to 2.2.0 #606
|
2017-06-24 11:01:23 +08:00 |
|
yihua.huang
|
1b6394bef9
|
version 0.7.2
|
2017-06-17 16:10:10 +08:00 |
|
yihua.huang
|
3ee00015c2
|
change header from Authorization to Proxy-Authorization for Proxy Authorization #596
|
2017-06-17 16:08:39 +08:00 |
|
yihua.huang
|
4111b07263
|
more error log on page code error #601
|
2017-06-17 10:36:41 +08:00 |
|
yihua.huang
|
6bd1eed25e
|
fix duplicate call of onSuccess and onError #605
|
2017-06-17 10:26:55 +08:00 |
|
yihua.huang
|
3a589d4ca6
|
HttpRequestBody implements Serializable #594
|
2017-06-08 15:59:46 +08:00 |
|
yihua.huang
|
13cdf82695
|
update version to 0.7.2-SNAPSHOT
|
2017-06-05 16:55:59 +08:00 |
|
yihua.huang
|
1e9187f24e
|
version 0.7.1
|
2017-06-04 07:52:54 +08:00 |
|
yihua.huang
|
592fa2c0f1
|
add site header test
|
2017-06-03 11:56:18 +08:00 |
|
yihua.huang
|
19d34dbb65
|
not add bracket to regex in RegexSelector #559
|
2017-06-03 11:30:07 +08:00 |
|
Yihua Huang
|
b6b991a09b
|
Merge pull request #556 from zhuyuesut/master
增加对零宽断言的支持
|
2017-06-03 11:10:56 +08:00 |
|
yihua.huang
|
bb0eb69acf
|
update ZhihuPageProcessor example
|
2017-06-03 10:42:17 +08:00 |
|
yihua.huang
|
2e35e149be
|
for 0.7.1
|
2017-05-29 14:41:49 +08:00 |
|
yihua.huang
|
17d8bfa907
|
docs and pgp version
|
2017-05-29 09:36:42 +08:00 |
|
yihua.huang
|
17478fcfc4
|
0.7.0 release
|
2017-05-29 09:30:56 +08:00 |
|
yihua.huang
|
636359300f
|
add Site.disableCookieManagement #577
|
2017-05-29 08:29:53 +08:00 |
|
yihua.huang
|
49de9374cd
|
new SimpleHttpClient #576
|
2017-05-27 17:30:19 +08:00 |
|
yihua.huang
|
8999ea9320
|
add public constructor for SimpleProxyProvider
|
2017-05-27 16:09:02 +08:00 |
|
yihua.huang
|
a8c2e6c729
|
alpha release
|
2017-05-20 12:51:16 +08:00 |
|
yihua.huang
|
3c1338193b
|
for 0.7.0.alpha
|
2017-05-20 12:34:09 +08:00 |
|
yihua.huang
|
e8abc28072
|
#552 add some log when crawler stop
|
2017-05-20 11:44:51 +08:00 |
zhuyue
|
9e1b7ed3f7
|
Update RegexSelector.java
|
2017-05-05 10:47:10 +08:00 |
|
zhuyue
|
c80f25edbd
|
Update RegexSelectorTest.java
简单的增加了一点测试
|
2017-05-03 18:33:23 +08:00 |
|
zhuyue
|
c3183252ac
|
Update RegexSelector.java
|
2017-05-03 18:24:19 +08:00 |
|
yihua.huang
|
cbf80af5dd
|
test for SimpleProxyProvider #535
|
2017-04-16 10:50:27 +08:00 |
|
yihua.huang
|
eb632a93d3
|
SimpleProxyProvider #535
|
2017-04-16 10:43:56 +08:00 |
|
yihua.huang
|
d38d51dfcb
|
fix javadoc
|
2017-04-15 12:24:50 +08:00 |
GZhY
|
5f34adf938
|
完善 LinksSelector.selectList 的测试用例
|
2017-04-09 21:29:01 +08:00 |
|
GZhY
|
ce3f0ac239
|
删除 fixAllRelativeHrefs 并修复 SeleniumDownloader 对 fixAllRelativeHrefs 的依赖
|
2017-04-09 21:01:32 +08:00 |
|
GZhY
|
bc6e81e00f
|
修复checkElementAndConvert方法注释中注释错误
|
2017-04-09 20:40:00 +08:00 |
|
yihua.huang
|
4a2c0f4f97
|
add returnProxy for proxyProvider
|
2017-04-09 09:28:36 +08:00 |
|
yihua.huang
|
1b04a7f2b3
|
#527 move logic check from downloaderto spider
|
2017-04-09 09:23:10 +08:00 |
|
yihua.huang
|
0f4d6e8b12
|
#525 remove port in UrlUtils.getDomain()
|
2017-04-08 23:17:00 +08:00 |
|
yihua.huang
|
a1ae632b62
|
test for request cookies and headers
|
2017-04-08 23:13:16 +08:00 |
|
yihua.huang
|
db67db8103
|
#523 remove fixAllRelativeHrefs by default, get absolute urls for links()
|
2017-04-08 22:06:18 +08:00 |
|
yihua.huang
|
abd020b45b
|
some comments
|
2017-04-08 20:16:17 +08:00 |
|
yihua.huang
|
2622b448b8
|
fix test
|
2017-04-08 20:09:43 +08:00 |
|
yihua.huang
|
b06a248c00
|
fix test
|
2017-04-08 20:06:04 +08:00 |
|
yihua.huang
|
1cfbd13aae
|
refacor in httpclientdownloader
|
2017-04-08 20:04:56 +08:00 |
|
yihua.huang
|
83ada9749e
|
fix test
|
2017-04-08 12:16:34 +08:00 |