Commit Graph

609 Commits (fc3d2906b0e74df940787c62e1728407193f450f)

Author SHA1 Message Date
yihua.huang fc3d2906b0 remove avalon from pom temporary 2014-05-02 23:47:14 +08:00
yihua.huang 01aec7e1ab extension point of geturl #118 2014-05-02 23:23:23 +08:00
yihua.huang ec1c2e8cbc test and so on 2014-05-02 23:19:11 +08:00
yihua.huang 4f22f1210e some bug fix #118 2014-05-02 20:38:49 +08:00
yihua.huang 186b90512e refactor redisscheduler #118 2014-05-02 20:24:15 +08:00
yihua.huang 56f033ce8d set setDuplicateRemover for chain api #118 2014-05-02 20:21:23 +08:00
yihua.huang d1140b9e29 add bloom filter for scheduler #118 2014-05-02 20:20:22 +08:00
yihua.huang 64293cba20 samples 2014-05-02 19:12:38 +08:00
yihua.huang bc1d14fed4 sample 2014-05-02 17:54:21 +08:00
yihua.huang 8e4814bdc5 fix path seperator 2014-05-02 17:06:34 +08:00
yihua.huang e8d4a9be2b fix remove duplicate error #117 2014-04-29 20:32:06 +08:00
yihua.huang 22652c4521 fix dep 2014-04-27 16:27:12 +08:00
yihua.huang f84a858bce update verion of forge 2014-04-27 15:38:38 +08:00
yihua.huang 5c00e59939 Merge branch 'stable' 2014-04-27 15:14:06 +08:00
yihua.huang 66692b2f74 update forger version 2014-04-27 15:09:26 +08:00
yihua.huang c07b32cd85 en docs 2014-04-27 15:06:13 +08:00
yihua.huang 3355624035 docs 2014-04-27 15:05:51 +08:00
yihua.huang a08d8cb167 update verion 2014-04-27 14:59:48 +08:00
yihua.huang 42a2676e8c update version 2014-04-27 14:56:21 +08:00
yihua.huang c892eadb56 contributor 2014-04-27 14:54:39 +08:00
yihua.huang 028f5e8755 readme 2014-04-27 14:52:44 +08:00
yihua.huang c25b32f1ca [maven-release-plugin] prepare for next development iteration 2014-04-27 12:52:27 +08:00
yihua.huang 7ff83bb11a [maven-release-plugin] prepare release WebMagic-0.5.0 2014-04-27 12:52:12 +08:00
yihua.huang dc3c175772 docs 2014-04-27 10:50:35 +08:00
yihua.huang 1104122979 more abstraction in scheduler 2014-04-27 09:30:01 +08:00
yihua.huang b0fb1c3e10 remove copy-dependcies plugin for m2e error 2014-04-27 08:22:33 +08:00
yihua.huang 94a67165e1 remove jmx server for simplify #98 2014-04-26 20:17:52 +08:00
yihua.huang 86a45a6643 change SpiderMonitor to singleton #98 2014-04-26 18:14:25 +08:00
yihua.huang ab4d36806e clean code 2014-04-26 11:45:21 +08:00
yihua.huang 04fde8203b add control for monitor 2014-04-26 11:44:14 +08:00
yihua.huang 2770811a10 update monitor example 2014-04-26 11:24:22 +08:00
yihua.huang 5ecd909ef2 add timeout for wait/notify #111 2014-04-25 19:41:36 +08:00
yihua.huang 964e637264 fix ut #110 2014-04-25 18:46:31 +08:00
yihua.huang c7afdb516e remove thread utils #110 2014-04-25 18:44:45 +08:00
yihua.huang 17e95f2a7f comments 2014-04-25 18:39:01 +08:00
yihua.huang 3a666fcebf add sample of 36kr #110 2014-04-25 18:36:07 +08:00
yihua.huang b1258f4f16 remove some test 2014-04-25 18:30:49 +08:00
yihua.huang 05eb7831b6 refactor and comments #110 2014-04-25 18:27:40 +08:00
yihua.huang 375e64e845 more monitor status 2014-04-25 18:10:14 +08:00
yihua.huang 018061d2cd fix error in thread pool 2014-04-25 18:01:02 +08:00
yihua.huang cdc423f2bf log 2014-04-25 17:41:41 +08:00
yihua.huang c6661899fd new thread pool #110 2014-04-25 17:33:48 +08:00
yihua.huang 179baa7a22 return when page is null 2014-04-25 16:07:41 +08:00
yihua.huang 0336f4cdb4 remove IllegalStateException when download error for less error log 2014-04-25 16:06:29 +08:00
yihua.huang 4738ae2d14 change url find to match #94 2014-04-25 16:04:41 +08:00
yihua.huang f973889cda refactor subpageprossor etc. #94 2014-04-25 15:48:05 +08:00
yihua.huang acb63d55d7 some check and example #98 2014-04-25 13:26:08 +08:00
yihua.huang 11ba5beb42 [refactor]move monitor to webmagic-extension #98 2014-04-25 13:17:13 +08:00
yihua.huang d61f65cef8 update mbean to mxbean #98 2014-04-25 11:31:43 +08:00
yihua.huang ad6a273b12 update test url 2014-04-25 11:28:35 +08:00