Commit Graph

233 Commits (0af0badd253f61964199267683f159d6790add12)

Author SHA1 Message Date
Sutra Zhou ba1b4017a7 Mark slf4j-log4j12 as optional. 2020-05-21 19:59:29 +08:00
Sutra Zhou b98a87e45a Serialize requests in FileCacheQueueScheduler, so that the extra info of request could be restored. 2020-04-11 20:21:20 +08:00
yihua.huang c701fe8d38 #702 Refactor: rename CheckForAdditionalInfo to checkForAdditionalInfo 2017-11-30 11:50:52 +08:00
yihy 266083fa07 [Fix] #698  Repair using redis,Request additional information is lost 2017-11-29 20:19:00 +08:00
yihua.huang e5db538c19 #647 remove ThreadSafe annotation 2017-11-29 13:49:40 +08:00
yihua.huang e276b11ea9 vesion 0.7.3 2017-07-30 15:29:22 +08:00
yihua.huang 1b6394bef9 version 0.7.2 2017-06-17 16:10:10 +08:00
yihua.huang 76766a7c77 RequestUtils for range #222 2017-06-05 17:13:33 +08:00
yihua.huang 13cdf82695 update version to 0.7.2-SNAPSHOT 2017-06-05 16:55:59 +08:00
yihua.huang 1e9187f24e version 0.7.1 2017-06-04 07:52:54 +08:00
yihua.huang 5de6205563 use RawText as source for JsonPath #589 2017-06-04 07:24:56 +08:00
yihua.huang 211ac74389 use group 0 of targetUrl instead of group 1 #588 2017-06-04 07:11:13 +08:00
yihua.huang 9b77306098 test of ExtractByUrl #586 2017-06-04 07:03:20 +08:00
yihua.huang d8bd0637a1 add custom formatter test #586 2017-06-04 06:51:41 +08:00
yihua.huang 6cc647577a fix test for ExtractLinks #586 2017-06-03 22:38:42 +08:00
yihua.huang a6f8ed5476 complete formatter refactor by ObjectFormatterBuilder #586 2017-06-03 22:07:53 +08:00
yihua.huang b1ef61b278 add tests before refactor #586 2017-06-03 21:33:18 +08:00
yihua.huang b363ee6a9d move constant to class 2017-06-03 20:33:28 +08:00
yihua.huang df682857a7 fix test and some refactor 2017-06-03 20:19:41 +08:00
yihua.huang 0e6eb46eba add test for jsonpath in pagemodel #462 2017-06-03 16:47:21 +08:00
yihua.huang f5018d569e remove test_issue409 #409 2017-06-03 15:10:25 +08:00
yihua.huang 17ae500c77 test_issue409 #409 2017-06-03 15:09:51 +08:00
yihua.huang 4cd5b4f93e test_issue409 2017-06-03 15:02:33 +08:00
yihua.huang fb0acd710c complete SimpleHttpClientTest 2017-06-03 14:59:08 +08:00
yihua.huang d07941d900 SimpleHttpClientTest 2017-06-03 14:58:34 +08:00
yihua.huang f02f469c69 add test #570 2017-06-03 11:02:31 +08:00
yihua.huang 2d693580fc add test 2017-06-01 22:28:03 +08:00
yihua.huang b879b0eed0 fix redisscheduler #583 2017-06-01 22:25:01 +08:00
Yihua Huang 9903f0367d Merge pull request #570 from SoulZhong/master
修复formatter初始化未传参bug
2017-05-29 17:49:42 +08:00
yihua.huang 2e35e149be for 0.7.1 2017-05-29 14:41:49 +08:00
yihua.huang 17478fcfc4 0.7.0 release 2017-05-29 09:30:56 +08:00
yihua.huang 49de9374cd new SimpleHttpClient #576 2017-05-27 17:30:19 +08:00
yihua.huang 7ffc6998ef add isExtractLinks to OOSpider #575 2017-05-27 16:20:06 +08:00
soul bc828e1384 修复formatter初始化未传参bug 2017-05-25 12:17:10 +08:00
yihua.huang a8c2e6c729 alpha release 2017-05-20 12:51:16 +08:00
yihua.huang 3c1338193b for 0.7.0.alpha 2017-05-20 12:34:09 +08:00
yihua.huang d38d51dfcb fix javadoc 2017-04-15 12:24:50 +08:00
yihua.huang 1b04a7f2b3 #527 move logic check from downloaderto spider 2017-04-09 09:23:10 +08:00
yihua.huang 74110e6ec5 remove useless file 2017-03-30 09:19:00 +08:00
yihua.huang b100dfe273 update version 2017-03-30 09:18:12 +08:00
yihua.huang c13110c4cb fix samples 2017-03-21 07:53:43 +08:00
yihua.huang d87c73b472 change check-and-set to atomic sadd for redis DuplicateRemover #368 2017-03-01 22:24:34 +08:00
yihua.huang aaccc93215 new version 2017-01-21 12:04:12 +08:00
yihua.huang 3e633c6871 version 2017-01-21 11:51:14 +08:00
yihua.huang f45e2f118b for release 2017-01-21 11:38:36 +08:00
Jsbd 6d78d51fc0 Merge branch 'master' into master 2016-12-27 14:15:40 +08:00
yihua.huang d69204b919 0.6.0 2016-12-18 11:45:43 +08:00
yihua.huang 97592d6720 Version 0.6.0 2016-12-18 10:58:24 +08:00
yihua.huang 00dfebbceb #424 remove guava dep and add fix docs 2016-12-18 10:45:50 +08:00
yihua.huang a960a39c44 fix compile error for example change 2016-12-18 08:32:14 +08:00