Joe Zhou
|
8c008563ff
|
Update for next development version
|
2023-09-10 17:06:55 +08:00 |
|
Joe Zhou
|
07e83a421b
|
Update versions for release
|
2023-09-10 16:35:32 +08:00 |
|
Joe Zhou
|
6e8d130113
|
Update for next development version
|
2023-06-22 11:23:44 +08:00 |
|
Joe Zhou
|
3688226e32
|
Update versions for release
|
2023-06-22 11:16:41 +08:00 |
|
Joe Zhou
|
a5fb4e0414
|
Upgrade dependencies.
|
2023-06-22 10:40:37 +08:00 |
|
Joe Zhou
|
ef616c999e
|
Fix warnings.
|
2022-11-27 02:05:31 +08:00 |
|
Joe Zhou
|
cda8467f95
|
Update for next development version
|
2022-11-24 00:49:43 +08:00 |
|
Joe Zhou
|
888682863c
|
Update versions for release
|
2022-11-24 00:30:07 +08:00 |
|
Sutra Zhou
|
5d5f3bf20e
|
Update for next development version
|
2022-10-24 00:17:21 +08:00 |
|
Sutra Zhou
|
838c47f1f6
|
Update versions for release
|
2022-10-23 23:58:21 +08:00 |
|
Sutra Zhou
|
d2b2eed9df
|
Pass the task to onSuccess & onError.
|
2022-10-19 22:15:41 +08:00 |
vio.ao
|
7a62a6cb45
|
Revert "Revert "Common the downloader status process and pass error information when …""
This reverts commit acfbd7b883.
|
2022-10-01 17:33:11 +08:00 |
|
Sutra Zhou
|
acfbd7b883
|
Revert "Common the downloader status process and pass error information when …"
|
2022-10-01 10:37:09 +08:00 |
|
vio.ao
|
d01f26333b
|
Common the downloader status process and pass error information when onError
|
2022-10-01 00:21:17 +08:00 |
David Hsing
|
54da7af17e
|
change dependency versions into properties
change dependency versions into properties
update commons-collections from 3.x to 4.4
|
2022-05-03 17:42:42 +08:00 |
|
Sutra Zhou
|
c5a037a807
|
Update for next development version
|
2021-07-22 13:02:46 +08:00 |
|
Sutra Zhou
|
4e51a4f68b
|
Update versions for release
|
2021-07-22 12:42:55 +08:00 |
wecandoitjustthink
|
528a8908af
|
增加了List<SpiderStatusMXBean>属性的get方法,供SpiderMonitor的子类获取.
|
2021-02-27 19:59:05 +13:00 |
|
Sutra Zhou
|
71b7dfbf9a
|
Merge pull request #993 from yqia182/master
SpiderStatus中getPagePerSecond()方法，增加验证逻辑，避免空指针，避免除数为零。
|
2021-02-03 10:13:50 +08:00 |
|
JustThink
|
54127318a4
|
SpiderStatus中getPagePerSecond()方法，增加验证逻辑，避免空指针，避免除数为零。
|
2021-02-03 02:43:53 +13:00 |
|
Sutra Zhou
|
0e01550a79
|
Upgrade dependencies, including the jedis from 2.9.3 to 3.4.1.
|
2021-01-06 03:21:10 +08:00 |
|
Sutra Zhou
|
c489647c4b
|
Revert " Downloader 提供刷新组件的api,方便在spider中操作"
This reverts commit 2e2a0fdf3e.
|
2021-01-02 20:15:10 +08:00 |
yao
|
2e2a0fdf3e
|
Downloader 提供刷新组件的api,方便在spider中操作
|
2020-12-21 18:08:55 +08:00 |
|
Sutra Zhou
|
4b902270b4
|
Bump version number from 0.7.3 to 0.7.4.
|
2020-10-27 09:01:21 +08:00 |
|
Sutra Zhou
|
5d14efc50f
|
Serialize request URL only in FileCacheQueueScheduler.
|
2020-06-14 00:20:39 +08:00 |
|
Sutra Zhou
|
71aa04c89f
|
Upgrade dependencies.
|
2020-05-30 02:10:01 +08:00 |
|
Sutra Zhou
|
ba1b4017a7
|
Mark slf4j-log4j12 as optional.
|
2020-05-21 19:59:29 +08:00 |
|
Sutra Zhou
|
b98a87e45a
|
Serialize requests in FileCacheQueueScheduler, so that the extra info of request could be restored.
|
2020-04-11 20:21:20 +08:00 |
yihua.huang
|
c701fe8d38
|
#702 Refactor: rename CheckForAdditionalInfo to checkForAdditionalInfo
|
2017-11-30 11:50:52 +08:00 |
yihy
|
266083fa07
|
[Fix] #698 Repair using redis,Request additional information is lost
|
2017-11-29 20:19:00 +08:00 |
|
yihua.huang
|
e5db538c19
|
#647 remove ThreadSafe annotation
|
2017-11-29 13:49:40 +08:00 |
|
yihua.huang
|
e276b11ea9
|
vesion 0.7.3
|
2017-07-30 15:29:22 +08:00 |
|
yihua.huang
|
1b6394bef9
|
version 0.7.2
|
2017-06-17 16:10:10 +08:00 |
|
yihua.huang
|
76766a7c77
|
RequestUtils for range #222
|
2017-06-05 17:13:33 +08:00 |
|
yihua.huang
|
13cdf82695
|
update version to 0.7.2-SNAPSHOT
|
2017-06-05 16:55:59 +08:00 |
|
yihua.huang
|
1e9187f24e
|
version 0.7.1
|
2017-06-04 07:52:54 +08:00 |
|
yihua.huang
|
5de6205563
|
use RawText as source for JsonPath #589
|
2017-06-04 07:24:56 +08:00 |
|
yihua.huang
|
211ac74389
|
use group 0 of targetUrl instead of group 1 #588
|
2017-06-04 07:11:13 +08:00 |
|
yihua.huang
|
9b77306098
|
test of ExtractByUrl #586
|
2017-06-04 07:03:20 +08:00 |
|
yihua.huang
|
d8bd0637a1
|
add custom formatter test #586
|
2017-06-04 06:51:41 +08:00 |
|
yihua.huang
|
6cc647577a
|
fix test for ExtractLinks #586
|
2017-06-03 22:38:42 +08:00 |
|
yihua.huang
|
a6f8ed5476
|
complete formatter refactor by ObjectFormatterBuilder #586
|
2017-06-03 22:07:53 +08:00 |
|
yihua.huang
|
b1ef61b278
|
add tests before refactor #586
|
2017-06-03 21:33:18 +08:00 |
|
yihua.huang
|
b363ee6a9d
|
move constant to class
|
2017-06-03 20:33:28 +08:00 |
|
yihua.huang
|
df682857a7
|
fix test and some refactor
|
2017-06-03 20:19:41 +08:00 |
|
yihua.huang
|
0e6eb46eba
|
add test for jsonpath in pagemodel #462
|
2017-06-03 16:47:21 +08:00 |
|
yihua.huang
|
f5018d569e
|
remove test_issue409 #409
|
2017-06-03 15:10:25 +08:00 |
|
yihua.huang
|
17ae500c77
|
test_issue409 #409
|
2017-06-03 15:09:51 +08:00 |
|
yihua.huang
|
4cd5b4f93e
|
test_issue409
|
2017-06-03 15:02:33 +08:00 |
|
yihua.huang
|
fb0acd710c
|
complete SimpleHttpClientTest
|
2017-06-03 14:59:08 +08:00 |