yihua.huang
|
928f98dd93
|
auto create folder in JsonFilePipeline #122
|
2014-05-08 15:12:17 +08:00 |
|
yihua.huang
|
7fbe18b8c0
|
implementation of PageMapper #120
|
2014-05-05 08:01:39 +08:00 |
|
yihua.huang
|
5dc9fe95a9
|
interface of PageMapper #120
|
2014-05-05 07:43:32 +08:00 |
|
yihua.huang
|
7668731f08
|
update version to snapshot
|
2014-05-05 07:03:55 +08:00 |
|
yihua.huang
|
81e6e772ac
|
versions back to 0.5.1
|
2014-05-03 06:18:57 +08:00 |
|
yihua.huang
|
358e906379
|
[maven-release-plugin] prepare for next development iteration
|
2014-05-03 00:00:13 +08:00 |
|
yihua.huang
|
470750fc0d
|
[maven-release-plugin] prepare release WebMagic-0.5.1
|
2014-05-02 23:59:55 +08:00 |
|
yihua.huang
|
186b90512e
|
refactor redisscheduler #118
|
2014-05-02 20:24:15 +08:00 |
|
yihua.huang
|
d1140b9e29
|
add bloom filter for scheduler #118
|
2014-05-02 20:20:22 +08:00 |
|
yihua.huang
|
e8d4a9be2b
|
fix remove duplicate error #117
|
2014-04-29 20:32:06 +08:00 |
|
yihua.huang
|
a08d8cb167
|
update verion
|
2014-04-27 14:59:48 +08:00 |
|
yihua.huang
|
42a2676e8c
|
update version
|
2014-04-27 14:56:21 +08:00 |
|
yihua.huang
|
c25b32f1ca
|
[maven-release-plugin] prepare for next development iteration
|
2014-04-27 12:52:27 +08:00 |
|
yihua.huang
|
7ff83bb11a
|
[maven-release-plugin] prepare release WebMagic-0.5.0
|
2014-04-27 12:52:12 +08:00 |
|
yihua.huang
|
1104122979
|
more abstraction in scheduler
|
2014-04-27 09:30:01 +08:00 |
|
yihua.huang
|
b0fb1c3e10
|
remove copy-dependcies plugin for m2e error
|
2014-04-27 08:22:33 +08:00 |
|
yihua.huang
|
94a67165e1
|
remove jmx server for simplify #98
|
2014-04-26 20:17:52 +08:00 |
|
yihua.huang
|
86a45a6643
|
change SpiderMonitor to singleton #98
|
2014-04-26 18:14:25 +08:00 |
|
yihua.huang
|
ab4d36806e
|
clean code
|
2014-04-26 11:45:21 +08:00 |
|
yihua.huang
|
04fde8203b
|
add control for monitor
|
2014-04-26 11:44:14 +08:00 |
|
yihua.huang
|
2770811a10
|
update monitor example
|
2014-04-26 11:24:22 +08:00 |
|
yihua.huang
|
17e95f2a7f
|
comments
|
2014-04-25 18:39:01 +08:00 |
|
yihua.huang
|
375e64e845
|
more monitor status
|
2014-04-25 18:10:14 +08:00 |
|
yihua.huang
|
c6661899fd
|
new thread pool #110
|
2014-04-25 17:33:48 +08:00 |
|
yihua.huang
|
179baa7a22
|
return when page is null
|
2014-04-25 16:07:41 +08:00 |
|
yihua.huang
|
4738ae2d14
|
change url find to match #94
|
2014-04-25 16:04:41 +08:00 |
|
yihua.huang
|
f973889cda
|
refactor subpageprossor etc. #94
|
2014-04-25 15:48:05 +08:00 |
|
yihua.huang
|
acb63d55d7
|
some check and example #98
|
2014-04-25 13:26:08 +08:00 |
|
yihua.huang
|
11ba5beb42
|
[refactor]move monitor to webmagic-extension #98
|
2014-04-25 13:17:13 +08:00 |
|
yihua.huang
|
b06aa489fb
|
[BugFix]Only one url from sourceRegion can be extracted #107
|
2014-04-18 17:48:26 +08:00 |
|
yihua.huang
|
023c2ac84e
|
spider config draft
|
2014-04-17 16:44:32 +08:00 |
|
yihua.huang
|
a5db6cf292
|
some monitor and JMX support #98
|
2014-04-17 00:35:09 +08:00 |
|
yihua.huang
|
aae1ab2cd6
|
fix compile error
|
2014-04-16 18:14:13 +08:00 |
|
yihua.huang
|
1fbfc92de2
|
Inherit support of Field annotation in Model #103
|
2014-04-16 18:13:44 +08:00 |
|
yihua.huang
|
3a79b1b64a
|
[Bugfix]formatter property does not work when field is String#100
|
2014-04-13 23:02:34 +08:00 |
|
Yihua Huang
|
cc9d319fd9
|
Merge pull request #94 from sebastian1118/master
update:PatternHandler
|
2014-04-13 13:16:20 +08:00 |
|
yihua.huang
|
03c251237b
|
add Json parse support
|
2014-04-13 10:23:00 +08:00 |
Tian
|
99e12aafaa
|
update:PatternHandler
|
2014-04-13 10:14:39 +08:00 |
|
yihua.huang
|
c1e7207869
|
add FileCacheQueueScheduler support for cycleRetryTimes
|
2014-04-07 11:00:09 +08:00 |
|
yihua.huang
|
969ad1766b
|
change logger style to slf4j for cleaner code
|
2014-04-06 21:32:20 +08:00 |
|
yihua.huang
|
9b2cb43f47
|
ConfigurablePageProcessor #91
|
2014-04-05 23:40:10 +08:00 |
Bo LIANG
|
159eeea2f5
|
Remove unused variable to make the project cleaner.
|
2014-04-05 18:32:12 +08:00 |
|
yihua.huang
|
c143fc662c
|
add SubPageProcessor #86
|
2014-04-05 18:17:48 +08:00 |
|
Yihua Huang
|
474f785dab
|
Merge pull request #86 from sebastian1118/master
new feature: PatternProcessor
|
2014-04-04 23:41:27 +08:00 |
|
Tian
|
38a12f8641
|
new feature: PatternProcessor
|
2014-04-04 22:02:52 +08:00 |
|
yihua.huang
|
dafd0b5875
|
[BugFix]multi model in one pageprocessor will be skipped #85
|
2014-04-04 20:36:31 +08:00 |
|
yihua.huang
|
a1c7e826f7
|
fix dep of slf4j-log4j12
|
2014-04-03 23:04:31 +08:00 |
|
yihua.huang
|
f3c2503a29
|
add warning of slf4j #78
|
2014-04-01 07:42:23 +08:00 |
|
yihua.huang
|
8958d774f2
|
add default values for @Formatter
|
2014-03-24 13:52:17 +08:00 |
|
yihua.huang
|
6c11718566
|
Clean project structure #70
|
2014-03-14 23:24:38 +08:00 |