Commit Graph

302 Commits (fb693a4ac41667ba70f2d7c11c73b364fa569e67)

Author SHA1 Message Date
yihua.huang fb693a4ac4 [maven-release-plugin] prepare for next development iteration 2013-09-08 22:25:07 +08:00
yihua.huang bfaaa042b9 [maven-release-plugin] prepare release webmagic-parent-0.3.1 2013-09-08 22:24:48 +08:00
yihua.huang d7c7a78177 complete test cases 2013-09-08 22:19:02 +08:00
yihua.huang c17a31a21d fix null pointe exception #26 2013-09-08 21:09:49 +08:00
yihua.huang d2e0f0cd33 #25 use URL api in UrlUtils.canonicalizeUrl() 2013-09-06 21:35:23 +08:00
yihua.huang 363fd38ccb Merge branch 'master' of github.com:code4craft/webmagic 2013-09-06 21:18:13 +08:00
yihua.huang ef4cf49fee add stop method to spider #24 2013-09-06 21:17:36 +08:00
Yihua Huang bf8e4fe9dc Merge pull request #23 from linkerlin/master
增强单元测试
2013-09-04 15:50:42 -07:00
Linker Lin 4d023b3666 增加剔除文件 2013-09-05 00:30:52 +08:00
Linker Lin 2e8cf0a3dd 将单元测试fork独立的JVM来跑。避免少数情况默认maven开的JVM堆太小。 2013-09-05 00:30:10 +08:00
yihua.huang ac4cd39170 update version 2013-09-04 20:37:42 +08:00
yihua.huang 692de76f86 fix issue #21 charset detect error 2013-09-04 15:27:51 +08:00
yihua.huang e1b6b54097 update version for samples 2013-09-04 11:07:28 +08:00
yihua.huang a9fc06a916 release note 2013-09-04 11:04:36 +08:00
yihua.huang e7bf425df4 [maven-release-plugin] prepare for next development iteration 2013-09-04 10:51:01 +08:00
yihua.huang 77ff252316 [maven-release-plugin] prepare release webmagic-0.3.0 2013-09-04 10:50:50 +08:00
yihua.huang 1fc8e104ab add cycle retry 2013-09-04 10:32:13 +08:00
yihua.huang 891d845e5f fix test 2013-09-04 10:00:13 +08:00
yihua.huang d141541ef3 add retry 2013-09-04 09:57:19 +08:00
yihua.huang a1ef2523cc update xsoup version 2013-09-04 09:38:40 +08:00
yihua.huang e06b0c1a99 Merge branch 'xsoup' 2013-09-04 09:37:03 +08:00
yihua.huang aefd0569a5 update version 2013-09-04 09:36:56 +08:00
yihua.huang 194518fd82 add switch 2013-09-04 08:21:34 +08:00
yihua.huang b9eeb88f77 benchmark 2013-09-04 07:51:18 +08:00
yihua.huang 2ec6abfa65 fix grammer error in en 2013-09-04 00:16:20 +08:00
yihua.huang 326b97c65a update 2013-09-04 00:15:54 +08:00
yihua.huang 2c3574537a refactor in selectors 2013-09-02 14:14:24 +08:00
yihua.huang 85b7cf1563 complete test 2013-09-02 13:52:41 +08:00
yihua.huang d7cd9e5747 update pom 2013-09-02 11:56:01 +08:00
yihua.huang 55d4a76ab7 newselectors 2013-09-02 08:21:32 +08:00
yihua.huang b1cba78bd6 xsoup test 2013-09-02 07:30:31 +08:00
yihua.huang e87489d5dc syntax hightlight 2013-08-30 17:32:27 +08:00
yihua.huang d7abbd0e4b fix compile error 2013-08-25 16:31:00 +08:00
yihua.huang 5e9e8b2541 add TextContentSelector 2013-08-25 16:30:38 +08:00
yihua.huang 0cc0ccee35 add charset specific for easy call of HttpClientDownloader 2013-08-25 15:41:43 +08:00
yihua.huang 478ace7e97 add FilePageModelPipeline 2013-08-22 07:29:18 +08:00
yihua.huang 0b9e0465ed add delay queue 2013-08-21 23:49:15 +08:00
yihua.huang 91dcccf7b5 add a sample 2013-08-21 21:55:15 +08:00
yihua.huang 4fa82aad20 readme 2013-08-21 07:44:39 +08:00
yihua.huang 6748fb6bdd Merge branch 'master' of github.com:code4craft/webmagic 2013-08-21 07:37:12 +08:00
yihua.huang 9bba0b2b72 update readme version 2013-08-21 07:36:41 +08:00
黄亿华 3084aefe5e Merge pull request #17 from linkerlin/master
增加了对文件编码的强制限定,限定于UTF-8
2013-08-20 16:07:16 -07:00
linkerlin ce988d2f19 增加了对文件编码的强制限定,限定于UTF-8 2013-08-21 06:55:18 +08:00
yihua.huang ad66d33f38 [maven-release-plugin] prepare for next development iteration 2013-08-20 23:39:59 +08:00
yihua.huang 9dc6b11954 [maven-release-plugin] prepare release webmagic-parent-0.2.1 2013-08-20 23:37:55 +08:00
yihua.huang 4f62dfc8a4 release 2013-08-20 23:37:20 +08:00
yihua.huang 74c940c758 [maven-release-plugin] prepare for next development iteration 2013-08-20 23:19:58 +08:00
yihua.huang a4bb4e3429 [maven-release-plugin] prepare release webmagic-parent-0.2.1 2013-08-20 23:19:27 +08:00
yihua.huang 194f16aa75 update 2013-08-20 23:16:43 +08:00
yihua.huang 09ffd468c0 fix comments 2013-08-20 22:53:16 +08:00