Sutra Zhou
|
0e01550a79
|
Upgrade dependencies, including the jedis from 2.9.3 to 3.4.1.
|
2021-01-06 03:21:10 +08:00 |
yihua.huang
|
c701fe8d38
|
#702 Refactor: rename CheckForAdditionalInfo to checkForAdditionalInfo
|
2017-11-30 11:50:52 +08:00 |
yihy
|
266083fa07
|
[Fix] #698 Repair using redis,Request additional information is lost
|
2017-11-29 20:19:00 +08:00 |
|
yihua.huang
|
b879b0eed0
|
fix redisscheduler #583
|
2017-06-01 22:25:01 +08:00 |
|
yihua.huang
|
d87c73b472
|
change check-and-set to atomic sadd for redis DuplicateRemover #368
|
2017-03-01 22:24:34 +08:00 |
Salon.sai
|
f89a6a6826
|
add: redis scheduler with priority
|
2016-07-05 16:29:01 +08:00 |
SpenceZhou
|
165e5a72eb
|
Update RedisScheduler.java
修改redisscheduler中获取爬取总数bug
|
2015-12-02 17:10:42 +08:00 |
|
yihua.huang
|
186b90512e
|
refactor redisscheduler #118
|
2014-05-02 20:24:15 +08:00 |
|
yihua.huang
|
d1140b9e29
|
add bloom filter for scheduler #118
|
2014-05-02 20:20:22 +08:00 |
|
yihua.huang
|
e8d4a9be2b
|
fix remove duplicate error #117
|
2014-04-29 20:32:06 +08:00 |
|
yihua.huang
|
1104122979
|
more abstraction in scheduler
|
2014-04-27 09:30:01 +08:00 |
|
yihua.huang
|
11ba5beb42
|
[refactor]move monitor to webmagic-extension #98
|
2014-04-25 13:17:13 +08:00 |
|
yihua.huang
|
a5db6cf292
|
some monitor and JMX support #98
|
2014-04-17 00:35:09 +08:00 |
|
yihua.huang
|
d141541ef3
|
add retry
|
2013-09-04 09:57:19 +08:00 |
|
yihua.huang
|
c79d6ecf09
|
complete all comments
|
2013-08-17 23:30:49 +08:00 |
|
yihua.huang
|
59aad6a7f4
|
comments in english
|
2013-08-17 18:33:05 +08:00 |
|
yihua.huang
|
f21097421b
|
add new constructor to redisscheduler
|
2013-08-11 18:53:13 +08:00 |
|
yihua.huang
|
0f2c5b5723
|
update redisscheduler
|
2013-08-11 18:28:12 +08:00 |
|
yihua.huang
|
21eca688e9
|
complete docs
|
2013-08-09 20:56:33 +08:00 |
|
yihua.huang
|
17d2d98cec
|
remove invalid @date
|
2013-08-09 20:43:06 +08:00 |
|
yihua.huang
|
0c8599e3b2
|
update packages structure
|
2013-08-06 23:17:07 +08:00 |