Commit Graph

235 Commits (3085896743114a7cc9fc0a48a7ade81d0e63a037)

Author SHA1 Message Date
yihua.huang ce5495ecd5 remove useless files 2016-01-21 19:31:50 +08:00
yihua.huang 8265c7dade remove submodules for relase 2016-01-21 19:25:13 +08:00
yihua.huang 972ccd3d56 update version to 0.5.3-SNAPSHOT 2016-01-21 19:03:07 +08:00
yihua.huang 8b90b91e33 complete some javadoc 2016-01-21 18:14:10 +08:00
yihua.huang 2b556cf053 update verison to 0.5.3-SNAPSHOT 2016-01-21 18:05:56 +08:00
yihua.huang 9c5716a543 complete javadoc 2016-01-21 18:05:12 +08:00
yihua.huang db3cbf6ca5 update version to 0.5.3-SNAPSHOT 2016-01-21 17:58:36 +08:00
Yihua Huang 84b046e4c9 Merge pull request #227 from hsqlu/master
update deprecated method
2016-01-16 19:36:52 +08:00
chy996633 afd1617b58 知乎爬虫抓取 2015-11-13 11:56:46 +08:00
Qiannan Lu 155215290f resolve issue #226 2015-09-18 09:30:01 +08:00
Qiannan Lu 21f81bb8c1 update deprecated method 2015-09-18 08:59:40 +08:00
dolphineor 0d9b148fc2 add PhantomJSDownloader 2014-11-23 23:07:22 +08:00
yihua.huang eae37c868b new sample 2014-06-10 17:38:54 +08:00
yihua.huang 8c33be48a6 Merge branch 'stable' of github.com:code4craft/webmagic 2014-06-04 17:37:45 +08:00
yihua.huang 5f8c3fd5c5 update version 2014-06-04 17:33:30 +08:00
yihua.huang 95bdb30296 update xsoup version to release #113 2014-05-27 20:46:48 +08:00
yihua.huang f9825c214a refactor selectable for html fragment #113 2014-05-27 16:00:51 +08:00
yihua.huang 7668731f08 update version to snapshot 2014-05-05 07:03:55 +08:00
yihua.huang 182dd51689 Merge branch 'stable' of github.com:code4craft/webmagic 2014-05-03 06:19:11 +08:00
yihua.huang 81e6e772ac versions back to 0.5.1 2014-05-03 06:18:57 +08:00
yihua.huang feb604da87 Merge branch 'stable' of github.com:code4craft/webmagic 2014-05-03 06:14:54 +08:00
yihua.huang 358e906379 [maven-release-plugin] prepare for next development iteration 2014-05-03 00:00:13 +08:00
yihua.huang 470750fc0d [maven-release-plugin] prepare release WebMagic-0.5.1 2014-05-02 23:59:55 +08:00
yihua.huang 4f22f1210e some bug fix #118 2014-05-02 20:38:49 +08:00
yihua.huang 64293cba20 samples 2014-05-02 19:12:38 +08:00
yihua.huang bc1d14fed4 sample 2014-05-02 17:54:21 +08:00
yihua.huang e8d4a9be2b fix remove duplicate error #117 2014-04-29 20:32:06 +08:00
yihua.huang 04ade75606 Merge branch 'stable' of github.com:code4craft/webmagic
Conflicts:
	README.md
	pom.xml
	webmagic-avalon/pom.xml
	webmagic-core/pom.xml
	webmagic-extension/pom.xml
	webmagic-lucene/pom.xml
	webmagic-samples/pom.xml
	webmagic-saxon/pom.xml
	webmagic-scripts/pom.xml
	webmagic-selenium/pom.xml
2014-04-27 15:03:15 +08:00
yihua.huang a08d8cb167 update verion 2014-04-27 14:59:48 +08:00
yihua.huang 42a2676e8c update version 2014-04-27 14:56:21 +08:00
yihua.huang c25b32f1ca [maven-release-plugin] prepare for next development iteration 2014-04-27 12:52:27 +08:00
yihua.huang 7ff83bb11a [maven-release-plugin] prepare release WebMagic-0.5.0 2014-04-27 12:52:12 +08:00
yihua.huang b0fb1c3e10 remove copy-dependcies plugin for m2e error 2014-04-27 08:22:33 +08:00
yihua.huang 94a67165e1 remove jmx server for simplify #98 2014-04-26 20:17:52 +08:00
yihua.huang 86a45a6643 change SpiderMonitor to singleton #98 2014-04-26 18:14:25 +08:00
yihua.huang 2770811a10 update monitor example 2014-04-26 11:24:22 +08:00
yihua.huang 3a666fcebf add sample of 36kr #110 2014-04-25 18:36:07 +08:00
yihua.huang ec446277b1 some refactor in httpclientdownloader 2014-04-15 15:30:37 +08:00
yihua.huang a03f6a8431 eclipse project 2014-04-15 07:44:43 +08:00
yihua.huang 3a79b1b64a [Bugfix]formatter property does not work when field is String#100 2014-04-13 23:02:34 +08:00
yihua.huang b14f0ee479 fix jsonpath in AngularJSProcessor 2014-04-13 12:54:44 +08:00
yihua.huang 84b897f83b update AngularJSProcessor 2014-04-13 12:20:57 +08:00
yihua.huang 03c251237b add Json parse support 2014-04-13 10:23:00 +08:00
yihua.huang 843e928c2c comments on sinablogprocessor sample 2014-04-12 20:10:24 +08:00
yihua.huang be37d8b216 sinablogprocessor sample 2014-04-12 20:03:44 +08:00
yihua.huang 2b023c95c2 qqmeishi demo 2014-04-11 11:43:04 +08:00
yihua.huang db65dfafb8 add baidunews sample 2014-04-09 23:32:07 +08:00
yihua.huang 3669e73e4a update News163: use Xsoup 0.2.0 syntax instead of ComboExtract 2014-04-09 16:43:55 +08:00
yihua.huang 6c11718566 Clean project structure #70 2014-03-14 23:24:38 +08:00
yihua.huang 9606a173cd fix ZipCodePageProcessor 2014-03-13 22:55:50 +08:00
yihua.huang c383ed74fb update verion and lib 2014-03-13 08:15:17 +08:00
yihua.huang 98e2bba099 Merge branch 'master' of github.com:code4craft/webmagic
Conflicts:
	README.md
	pom.xml
	webmagic-core/pom.xml
	webmagic-extension/pom.xml
	webmagic-scripts/pom.xml
2014-03-13 08:07:33 +08:00
yihua.huang 757cc9b942 [maven-release-plugin] prepare for next development iteration 2014-03-13 07:49:51 +08:00
yihua.huang 63ffb5c792 [maven-release-plugin] prepare release webmaigc-0.4.3 2014-03-13 07:49:27 +08:00
yihua.huang d5a978e00f update version back to 0.4.3 2014-03-13 06:55:05 +08:00
yihua.huang 4d628d80b4 add redis scheduler 2014-03-03 08:24:55 +08:00
yihua.huang ca29cd3ef2 add jokejimodel for example 2014-03-03 08:22:14 +08:00
yihua.huang af809c4d55 update version to 0.5.0-snapshot 2014-02-11 22:16:01 +08:00
yihua.huang 6933029ea5 update modules 2013-12-25 18:48:31 +08:00
yihua.huang 7c41bec92f Merge branch 'master' of github.com:code4craft/webmagic
Conflicts:
	README.md
	webmagic-samples/pom.xml
	webmagic-selenium/pom.xml
2013-12-03 23:50:26 +08:00
yihua.huang cc241bc0f2 update versions 2013-12-03 23:40:47 +08:00
yihua.huang fd23cb6dc0 Merge branch 'master' of github.com:code4craft/webmagic
Conflicts:
	README.md
	pom.xml
	webmagic-samples/pom.xml
	webmagic-selenium/pom.xml
2013-11-28 13:40:24 +08:00
yihua.huang cb84220d7a update version 2013-11-28 13:37:10 +08:00
yihua.huang 3aea5e5dc3 reupdate version 2013-11-12 07:35:50 +08:00
yihua.huang 1d75ae7f5b rollback version to 0.4.0 because not deploy success 2013-11-11 11:52:56 +08:00
yihua.huang 5a0c4fea16 update jar and docs 2013-11-06 22:55:08 +08:00
yihua.huang afe209c92b update version 2013-11-06 22:54:32 +08:00
yihua.huang e40b48e77b Merge tag 'webmagic-0.4.0' of github.com:code4craft/webmagic
[maven-release-plugin]  copy for tag webmagic-0.4.0

Conflicts:
	pom.xml
	webmagic-core/pom.xml
	webmagic-extension/pom.xml
2013-11-06 22:48:26 +08:00
yihua.huang 425df08523 update version to 0.4.0 2013-11-06 12:50:45 +08:00
yihua.huang 6e32a19f80 update api for direct download 2013-11-06 12:46:50 +08:00
yihua.huang 86cfefb58c update test 2013-11-04 07:19:32 +08:00
yihua.huang c18b603399 optimize long compare 2013-11-04 07:09:44 +08:00
yihua.huang 09153ff715 #22 http proxy support #32 update httpclient to 4.3.1 2013-11-04 00:47:09 +08:00
yihua.huang 7fb44d2eec #30 reuse PoolingClientConnectionManager for HttpClientDownloader 2013-10-14 23:22:04 +08:00
yihua.huang 3b00190f99 api without implementation for #28: add specific url crawl 2013-10-10 00:40:44 +08:00
yihua.huang ba05227594 update versions in other project 2013-09-28 07:43:37 +08:00
yihua.huang 372cc0ad06 update jar 2013-09-23 13:21:40 +08:00
yihua.huang 95ab4edec3 some bugfix 2013-09-23 08:38:54 +08:00
yihua.huang 250cc5e662 change formatter to class 2013-09-23 08:17:21 +08:00
yihua.huang 1b32ca5f58 update jar 2013-09-09 12:49:37 +08:00
yihua.huang a2fba8caa2 update to 0.3.1 2013-09-09 12:48:01 +08:00
yihua.huang d11f8dac20 update samples version 2013-09-08 22:58:29 +08:00
yihua.huang d7c7a78177 complete test cases 2013-09-08 22:19:02 +08:00
yihua.huang 58150a090d update jar 2013-09-05 20:56:25 +08:00
yihua.huang 57556ab879 merege 2013-09-05 20:53:15 +08:00
yihua.huang e1b6b54097 update version for samples 2013-09-04 11:07:28 +08:00
yihua.huang 1fc8e104ab add cycle retry 2013-09-04 10:32:13 +08:00
yihua.huang 891d845e5f fix test 2013-09-04 10:00:13 +08:00
yihua.huang e06b0c1a99 Merge branch 'xsoup' 2013-09-04 09:37:03 +08:00
yihua.huang aefd0569a5 update version 2013-09-04 09:36:56 +08:00
yihua.huang 194518fd82 add switch 2013-09-04 08:21:34 +08:00
yihua.huang b9eeb88f77 benchmark 2013-09-04 07:51:18 +08:00
yihua.huang 85b7cf1563 complete test 2013-09-02 13:52:41 +08:00
yihua.huang d7cd9e5747 update pom 2013-09-02 11:56:01 +08:00
yihua.huang 0b9e0465ed add delay queue 2013-08-21 23:49:15 +08:00
yihua.huang 91dcccf7b5 add a sample 2013-08-21 21:55:15 +08:00
yihua.huang 7003426898 update pom 2013-08-20 21:52:39 +08:00
yihua.huang 606417fdc7 update pom 2013-08-19 09:55:49 +08:00
yihua.huang 59aad6a7f4 comments in english 2013-08-17 18:33:05 +08:00
yihua.huang 7829c8fe02 update pom 2013-08-17 17:37:41 +08:00