Commit Graph

1132 Commits (04978f912d23c152ecd0be308f74895f9a1a50a5)

Author SHA1 Message Date
yihua.huang 3a589d4ca6 HttpRequestBody implements Serializable #594 2017-06-08 15:59:46 +08:00
yihua.huang 76766a7c77 RequestUtils for range #222 2017-06-05 17:13:33 +08:00
yihua.huang 13cdf82695 update version to 0.7.2-SNAPSHOT 2017-06-05 16:55:59 +08:00
yihua.huang 0acaa2e835 update readme 2017-06-04 18:10:51 +08:00
yihua.huang 1e9187f24e version 0.7.1 2017-06-04 07:52:54 +08:00
yihua.huang 5de6205563 use RawText as source for JsonPath #589 2017-06-04 07:24:56 +08:00
yihua.huang 211ac74389 use group 0 of targetUrl instead of group 1 #588 2017-06-04 07:11:13 +08:00
yihua.huang 9b77306098 test of ExtractByUrl #586 2017-06-04 07:03:20 +08:00
yihua.huang d8bd0637a1 add custom formatter test #586 2017-06-04 06:51:41 +08:00
yihua.huang 6cc647577a fix test for ExtractLinks #586 2017-06-03 22:38:42 +08:00
yihua.huang a6f8ed5476 complete formatter refactor by ObjectFormatterBuilder #586 2017-06-03 22:07:53 +08:00
yihua.huang b1ef61b278 add tests before refactor #586 2017-06-03 21:33:18 +08:00
yihua.huang b363ee6a9d move constant to class 2017-06-03 20:33:28 +08:00
yihua.huang df682857a7 fix test and some refactor 2017-06-03 20:19:41 +08:00
yihua.huang 0e6eb46eba add test for jsonpath in pagemodel #462 2017-06-03 16:47:21 +08:00
yihua.huang f5018d569e remove test_issue409 #409 2017-06-03 15:10:25 +08:00
yihua.huang 17ae500c77 test_issue409 #409 2017-06-03 15:09:51 +08:00
yihua.huang 4cd5b4f93e test_issue409 2017-06-03 15:02:33 +08:00
yihua.huang fb0acd710c complete SimpleHttpClientTest 2017-06-03 14:59:08 +08:00
yihua.huang d07941d900 SimpleHttpClientTest 2017-06-03 14:58:34 +08:00
yihua.huang 592fa2c0f1 add site header test 2017-06-03 11:56:18 +08:00
yihua.huang 07cbc9947b fix pom error in webmagic-script 2017-06-03 11:40:40 +08:00
yihua.huang 19d34dbb65 not add bracket to regex in RegexSelector #559 2017-06-03 11:30:07 +08:00
Yihua Huang b6b991a09b Merge pull request #556 from zhuyuesut/master
增加对零宽断言的支持
2017-06-03 11:10:56 +08:00
yihua.huang f02f469c69 add test #570 2017-06-03 11:02:31 +08:00
yihua.huang bb0eb69acf update ZhihuPageProcessor example 2017-06-03 10:42:17 +08:00
yihua.huang 2d693580fc add test 2017-06-01 22:28:03 +08:00
yihua.huang b879b0eed0 fix redisscheduler #583 2017-06-01 22:25:01 +08:00
yihua.huang 818a2b2408 invite kotlin experimental 2017-06-01 07:51:11 +08:00
yihua.huang 3c653d941a Merge branch 'master' of github.com:code4craft/webmagic 2017-05-29 21:26:09 +08:00
yihua.huang 5a9328c32e update link 2017-05-29 21:25:57 +08:00
Yihua Huang 9903f0367d Merge pull request #570 from SoulZhong/master
修复formatter初始化未传参bug
2017-05-29 17:49:42 +08:00
yihua.huang ec7c52104f update logo 2017-05-29 15:28:08 +08:00
yihua.huang 2482c2c877 update version in readme 2017-05-29 15:23:47 +08:00
yihua.huang 858d535ec7 remove useless files 2017-05-29 15:00:22 +08:00
yihua.huang 2e35e149be for 0.7.1 2017-05-29 14:41:49 +08:00
yihua.huang 17d8bfa907 docs and pgp version 2017-05-29 09:36:42 +08:00
yihua.huang 17478fcfc4 0.7.0 release 2017-05-29 09:30:56 +08:00
yihua.huang 636359300f add Site.disableCookieManagement #577 2017-05-29 08:29:53 +08:00
yihua.huang 49de9374cd new SimpleHttpClient #576 2017-05-27 17:30:19 +08:00
yihua.huang 7ffc6998ef add isExtractLinks to OOSpider #575 2017-05-27 16:20:06 +08:00
yihua.huang 8999ea9320 add public constructor for SimpleProxyProvider 2017-05-27 16:09:02 +08:00
soul bc828e1384 修复formatter初始化未传参bug 2017-05-25 12:17:10 +08:00
yihua.huang a8c2e6c729 alpha release 2017-05-20 12:51:16 +08:00
yihua.huang 3c1338193b for 0.7.0.alpha 2017-05-20 12:34:09 +08:00
yihua.huang e8abc28072 #552 add some log when crawler stop 2017-05-20 11:44:51 +08:00
zhuyue 9e1b7ed3f7 Update RegexSelector.java 2017-05-05 10:47:10 +08:00
zhuyue 975adf7072 Merge pull request #2 from zhuyuesut/zhuyuesut-fixbug
Update RegexSelectorTest.java
2017-05-03 18:36:21 +08:00
zhuyue c80f25edbd Update RegexSelectorTest.java
简单的增加了一点测试
2017-05-03 18:33:23 +08:00
zhuyue 39c3c2f904 Merge pull request #1 from zhuyuesut/zhuyuesut-fixbug
Update RegexSelector.java
2017-05-03 18:28:05 +08:00