Commit Graph

140 Commits (34da2fb3a02708b562ec747679ef0cd8d171a042)

Author SHA1 Message Date
Sutra Zhou dba0ddb92c Remove unknown tag from javadoc. 2021-04-28 12:17:52 +08:00
linweisen 76f625c02e 提交可恢复爬取内容例子 2021-04-09 17:00:00 +08:00
yihua.huang ba000b364c remove site.addStartUrl in samples 2017-03-21 08:00:15 +08:00
yihua.huang 3824232171 remove site.addStartUrl in samples 2017-03-21 07:59:33 +08:00
yihua.huang 8564d51e56 remove site.addStartUrl in samples 2017-03-21 07:57:56 +08:00
yihua.huang c13110c4cb fix samples 2017-03-21 07:53:43 +08:00
yihua.huang 9b964c0a99 test for #484 2017-03-11 11:41:01 +08:00
yihua.huang fc702fd3b6 introduce mockito for test 2017-03-11 11:31:15 +08:00
yihua.huang 00dfebbceb #424 remove guava dep and add fix docs 2016-12-18 10:45:50 +08:00
Yihua Huang 37cb43b667 Merge pull request #176 from lavenderx/master
add PhantomJSDownloader
2016-05-08 20:36:17 +08:00
yihua.huang 0fd4623f0a Merge branch 'osc' 2016-01-21 19:33:30 +08:00
yihua.huang 8b90b91e33 complete some javadoc 2016-01-21 18:14:10 +08:00
Yihua Huang 84b046e4c9 Merge pull request #227 from hsqlu/master
update deprecated method
2016-01-16 19:36:52 +08:00
chy996633 afd1617b58 知乎爬虫抓取 2015-11-13 11:56:46 +08:00
Qiannan Lu 155215290f resolve issue #226 2015-09-18 09:30:01 +08:00
Qiannan Lu 21f81bb8c1 update deprecated method 2015-09-18 08:59:40 +08:00
dolphineor 0d9b148fc2 add PhantomJSDownloader 2014-11-23 23:07:22 +08:00
yihua.huang eae37c868b new sample 2014-06-10 17:38:54 +08:00
yihua.huang 95bdb30296 update xsoup version to release #113 2014-05-27 20:46:48 +08:00
yihua.huang f9825c214a refactor selectable for html fragment #113 2014-05-27 16:00:51 +08:00
yihua.huang 4f22f1210e some bug fix #118 2014-05-02 20:38:49 +08:00
yihua.huang 64293cba20 samples 2014-05-02 19:12:38 +08:00
yihua.huang bc1d14fed4 sample 2014-05-02 17:54:21 +08:00
yihua.huang e8d4a9be2b fix remove duplicate error #117 2014-04-29 20:32:06 +08:00
yihua.huang 94a67165e1 remove jmx server for simplify #98 2014-04-26 20:17:52 +08:00
yihua.huang 86a45a6643 change SpiderMonitor to singleton #98 2014-04-26 18:14:25 +08:00
yihua.huang 2770811a10 update monitor example 2014-04-26 11:24:22 +08:00
yihua.huang 3a666fcebf add sample of 36kr #110 2014-04-25 18:36:07 +08:00
yihua.huang ec446277b1 some refactor in httpclientdownloader 2014-04-15 15:30:37 +08:00
yihua.huang 3a79b1b64a [Bugfix]formatter property does not work when field is String#100 2014-04-13 23:02:34 +08:00
yihua.huang b14f0ee479 fix jsonpath in AngularJSProcessor 2014-04-13 12:54:44 +08:00
yihua.huang 84b897f83b update AngularJSProcessor 2014-04-13 12:20:57 +08:00
yihua.huang 03c251237b add Json parse support 2014-04-13 10:23:00 +08:00
yihua.huang 843e928c2c comments on sinablogprocessor sample 2014-04-12 20:10:24 +08:00
yihua.huang be37d8b216 sinablogprocessor sample 2014-04-12 20:03:44 +08:00
yihua.huang 2b023c95c2 qqmeishi demo 2014-04-11 11:43:04 +08:00
yihua.huang db65dfafb8 add baidunews sample 2014-04-09 23:32:07 +08:00
yihua.huang 3669e73e4a update News163: use Xsoup 0.2.0 syntax instead of ComboExtract 2014-04-09 16:43:55 +08:00
yihua.huang 9606a173cd fix ZipCodePageProcessor 2014-03-13 22:55:50 +08:00
yihua.huang 4d628d80b4 add redis scheduler 2014-03-03 08:24:55 +08:00
yihua.huang ca29cd3ef2 add jokejimodel for example 2014-03-03 08:22:14 +08:00
yihua.huang e40b48e77b Merge tag 'webmagic-0.4.0' of github.com:code4craft/webmagic
[maven-release-plugin]  copy for tag webmagic-0.4.0

Conflicts:
	pom.xml
	webmagic-core/pom.xml
	webmagic-extension/pom.xml
2013-11-06 22:48:26 +08:00
yihua.huang 6e32a19f80 update api for direct download 2013-11-06 12:46:50 +08:00
yihua.huang 86cfefb58c update test 2013-11-04 07:19:32 +08:00
yihua.huang c18b603399 optimize long compare 2013-11-04 07:09:44 +08:00
yihua.huang 09153ff715 #22 http proxy support #32 update httpclient to 4.3.1 2013-11-04 00:47:09 +08:00
yihua.huang 3b00190f99 api without implementation for #28: add specific url crawl 2013-10-10 00:40:44 +08:00
yihua.huang 372cc0ad06 update jar 2013-09-23 13:21:40 +08:00
yihua.huang 95ab4edec3 some bugfix 2013-09-23 08:38:54 +08:00
yihua.huang 250cc5e662 change formatter to class 2013-09-23 08:17:21 +08:00