Mobai
/
magic-Dependency
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
773 Commits
1 Branch
0 Tags
14 MiB
Commit Graph

190 Commits (b9544424f240d127ee71ce088caa8d5332b67749)

Author SHA1 Message Date
yihua.huang 2b023c95c2 qqmeishi demo 2014-04-11 11:43:04 +08:00
yihua.huang db65dfafb8 add baidunews sample 2014-04-09 23:32:07 +08:00
yihua.huang 3669e73e4a update News163: use Xsoup 0.2.0 syntax instead of ComboExtract 2014-04-09 16:43:55 +08:00
yihua.huang 6c11718566 Clean project structure #70 2014-03-14 23:24:38 +08:00
yihua.huang 9606a173cd fix ZipCodePageProcessor 2014-03-13 22:55:50 +08:00
yihua.huang c383ed74fb update verion and lib 2014-03-13 08:15:17 +08:00
yihua.huang 98e2bba099 Merge branch 'master' of github.com:code4craft/webmagic 
Conflicts:
	README.md
	pom.xml
	webmagic-core/pom.xml
	webmagic-extension/pom.xml
	webmagic-scripts/pom.xml
 2014-03-13 08:07:33 +08:00
yihua.huang 757cc9b942 [maven-release-plugin] prepare for next development iteration 2014-03-13 07:49:51 +08:00
yihua.huang 63ffb5c792 [maven-release-plugin] prepare release webmaigc-0.4.3 2014-03-13 07:49:27 +08:00
yihua.huang d5a978e00f update version back to 0.4.3 2014-03-13 06:55:05 +08:00
yihua.huang 4d628d80b4 add redis scheduler 2014-03-03 08:24:55 +08:00
yihua.huang ca29cd3ef2 add jokejimodel for example 2014-03-03 08:22:14 +08:00
yihua.huang af809c4d55 update version to 0.5.0-snapshot 2014-02-11 22:16:01 +08:00
yihua.huang 6933029ea5 update modules 2013-12-25 18:48:31 +08:00
yihua.huang 7c41bec92f Merge branch 'master' of github.com:code4craft/webmagic 
Conflicts:
	README.md
	webmagic-samples/pom.xml
	webmagic-selenium/pom.xml
 2013-12-03 23:50:26 +08:00
yihua.huang cc241bc0f2 update versions 2013-12-03 23:40:47 +08:00
yihua.huang fd23cb6dc0 Merge branch 'master' of github.com:code4craft/webmagic 
Conflicts:
	README.md
	pom.xml
	webmagic-samples/pom.xml
	webmagic-selenium/pom.xml
 2013-11-28 13:40:24 +08:00
yihua.huang cb84220d7a update version 2013-11-28 13:37:10 +08:00
yihua.huang 3aea5e5dc3 reupdate version 2013-11-12 07:35:50 +08:00
yihua.huang 1d75ae7f5b rollback version to 0.4.0 because not deploy success 2013-11-11 11:52:56 +08:00
yihua.huang 5a0c4fea16 update jar and docs 2013-11-06 22:55:08 +08:00
yihua.huang afe209c92b update version 2013-11-06 22:54:32 +08:00
yihua.huang e40b48e77b Merge tag 'webmagic-0.4.0' of github.com:code4craft/webmagic 
[maven-release-plugin]  copy for tag webmagic-0.4.0

Conflicts:
	pom.xml
	webmagic-core/pom.xml
	webmagic-extension/pom.xml
 2013-11-06 22:48:26 +08:00
yihua.huang 425df08523 update version to 0.4.0 2013-11-06 12:50:45 +08:00
yihua.huang 6e32a19f80 update api for direct download 2013-11-06 12:46:50 +08:00
yihua.huang 86cfefb58c update test 2013-11-04 07:19:32 +08:00
yihua.huang c18b603399 optimize long compare 2013-11-04 07:09:44 +08:00
yihua.huang 09153ff715 #22 http proxy support #32 update httpclient to 4.3.1 2013-11-04 00:47:09 +08:00
yihua.huang 7fb44d2eec #30 reuse PoolingClientConnectionManager for HttpClientDownloader 2013-10-14 23:22:04 +08:00
yihua.huang 3b00190f99 api without implementation for #28: add specific url crawl 2013-10-10 00:40:44 +08:00
yihua.huang ba05227594 update versions in other project 2013-09-28 07:43:37 +08:00
yihua.huang 372cc0ad06 update jar 2013-09-23 13:21:40 +08:00
yihua.huang 95ab4edec3 some bugfix 2013-09-23 08:38:54 +08:00
yihua.huang 250cc5e662 change formatter to class 2013-09-23 08:17:21 +08:00
yihua.huang 1b32ca5f58 update jar 2013-09-09 12:49:37 +08:00
yihua.huang a2fba8caa2 update to 0.3.1 2013-09-09 12:48:01 +08:00
yihua.huang d11f8dac20 update samples version 2013-09-08 22:58:29 +08:00
yihua.huang d7c7a78177 complete test cases 2013-09-08 22:19:02 +08:00
yihua.huang 58150a090d update jar 2013-09-05 20:56:25 +08:00
yihua.huang 57556ab879 merege 2013-09-05 20:53:15 +08:00
yihua.huang e1b6b54097 update version for samples 2013-09-04 11:07:28 +08:00
yihua.huang 1fc8e104ab add cycle retry 2013-09-04 10:32:13 +08:00
yihua.huang 891d845e5f fix test 2013-09-04 10:00:13 +08:00
yihua.huang e06b0c1a99 Merge branch 'xsoup' 2013-09-04 09:37:03 +08:00
yihua.huang aefd0569a5 update version 2013-09-04 09:36:56 +08:00
yihua.huang 194518fd82 add switch 2013-09-04 08:21:34 +08:00
yihua.huang b9eeb88f77 benchmark 2013-09-04 07:51:18 +08:00
yihua.huang 85b7cf1563 complete test 2013-09-02 13:52:41 +08:00
yihua.huang d7cd9e5747 update pom 2013-09-02 11:56:01 +08:00
yihua.huang 0b9e0465ed add delay queue 2013-08-21 23:49:15 +08:00
yihua.huang 91dcccf7b5 add a sample 2013-08-21 21:55:15 +08:00
yihua.huang 7003426898 update pom 2013-08-20 21:52:39 +08:00
yihua.huang 606417fdc7 update pom 2013-08-19 09:55:49 +08:00
yihua.huang 59aad6a7f4 comments in english 2013-08-17 18:33:05 +08:00
yihua.huang 7829c8fe02 update pom 2013-08-17 17:37:41 +08:00
yihua.huang 5d2bd925c2 new sample 2013-08-11 21:41:54 +08:00
yihua.huang 787b952932 release notes and docs 2013-08-11 10:21:26 +08:00
yihua.huang 8b15f3c63d add test 2013-08-10 20:33:47 +08:00
yihua.huang ade5714d50 add https support 2013-08-10 18:52:27 +08:00
yihua.huang 3b1993eaad update docs 2013-08-10 08:31:03 +08:00
yihua.huang 19229dd855 add JsonFilePageModelPipeline 2013-08-10 08:27:14 +08:00
yihua.huang 17d2d98cec remove invalid @date 2013-08-09 20:43:06 +08:00
yihua.huang e04d6253fa add manual 2013-08-09 00:03:14 +08:00
yihua.huang f76def231d remove freemarker dp 2013-08-07 23:36:48 +08:00
yihua.huang b713497a6b remove freemarker 2013-08-07 23:33:10 +08:00
yihua.huang 48fd003394 remove freemarker dep 2013-08-07 23:32:22 +08:00
yihua.huang c6132e0746 some refector 2013-08-07 22:32:58 +08:00
yihua.huang 194152ab13 modify class 2013-08-07 22:03:10 +08:00
yihua.huang 76dcbe605a update main class 2013-08-07 21:57:05 +08:00
yihua.huang afec9d31b8 add starter 2013-08-07 21:51:26 +08:00
yihua.huang f1573b40a2 set selenium dep to seperate package 2013-08-07 14:44:52 +08:00
yihua.huang bd1384a513 remove samples 2013-08-07 14:18:58 +08:00
yihua.huang 46c65f19c7 add maven jar plugin 2013-08-07 14:06:49 +08:00
yihua.huang 36384246b5 update package structure 2013-08-07 12:51:21 +08:00
yihua.huang 5ef231a768 update version 2013-08-07 12:48:32 +08:00
yihua.huang 3f7257957e add readme 2013-08-07 09:47:28 +08:00
yihua.huang 0c8599e3b2 update packages structure 2013-08-06 23:17:07 +08:00
yihua.huang e4c53c4400 fix compile error 2013-08-06 23:11:43 +08:00
yihua.huang 8b7e6a350b add test case back 2013-08-06 23:11:00 +08:00
yihua.huang ac917039a3 orgnize dep 2013-08-06 23:05:00 +08:00
yihua.huang 36494bcfa5 add xpath2.0 api 2013-08-06 23:01:43 +08:00
yihua.huang 5c96407a3d fix a null domain error 2013-08-06 22:43:31 +08:00
yihua.huang 5436ecbb7b update email 2013-08-06 22:12:52 +08:00
yihua.huang 7d277e84d4 update lucene pipeline 2013-08-06 21:47:44 +08:00
yihua.huang 29f8cd2ec6 change freemarker dep to samples 2013-08-06 21:26:03 +08:00
yihua.huang 789beccfb3 update package 2013-08-06 21:23:29 +08:00
yihua.huang b40cca1122 move model package to plugin 2013-08-06 20:41:35 +08:00
yihua.huang 4eb3d60083 fix nullpointer exception 2013-08-05 22:06:39 +08:00
yihua.huang f3a29d9315 fix pagedmodel bug 2013-08-05 21:03:47 +08:00
yihua.huang 971e7b6ce2 add core 2013-08-05 13:53:13 +08:00
yihua.huang 619a12b303 add paged support 2013-08-04 21:22:15 +08:00
yihua.huang 21cae2ff2e update package 2013-08-04 07:53:28 +08:00
yihua.huang cfb8990453 update author 2013-08-04 03:04:30 +08:00
yihua.huang b393e38320 add multi entity extract 2013-08-03 20:42:29 +08:00
yihua.huang d26cd82d59 rename package 2013-08-03 16:29:50 +08:00
yihua.huang 866ab0a056 update email 2013-08-03 14:01:18 +08:00
yihua.huang 901d6fde1d fix 2013-08-02 08:22:59 +08:00
yihua.huang 29c6a03f60 fix 2013-08-02 08:22:28 +08:00
yihua.huang 516ff3310d add failfast 2013-08-02 08:20:55 +08:00
yihua.huang 7ee567b804 add some samples 2013-08-02 08:13:40 +08:00