16a4fe3e28
Use oxerr-parent instead.
2024-05-17 13:17:13 +08:00
38f240c42e
Update to hotfix version
2024-04-23 23:39:23 +08:00
a81c4e7627
Update to hotfix version
2024-04-23 21:46:35 +08:00
884f51ba3b
Update to hotfix version
2024-04-23 20:38:03 +08:00
5196a56ccf
Format code.
2024-04-21 23:30:43 +08:00
b7e0d360ec
Upgrade junit from 4.13.2 to 5.10.2.
2024-04-21 22:04:48 +08:00
2df7dca871
Changed refactor of processSingle again, this one is a better version ( #1157 )
...
* Refactor of processSingle in PageModelExtractor
* Changed my refactor of processSingle, this one is a lot better
* Changed my refactor of processSingle, this one is a lot better
2024-04-05 22:50:21 +08:00
05e5eefc7d
Refactor of processSingle in PageModelExtractor ( #1155 )
2024-04-05 21:51:08 +08:00
ed7429c293
Rename webmagic-parent to webmagic.
2024-04-03 19:37:56 +08:00
4ebf48f6e3
Replace log4j 1.x with log4j 2.x, refs #534 .
2024-04-03 18:26:01 +08:00
0ceaf14882
Bump version number from 0.10.1-SNAPSHOT to 1.0.0-SNAPSHOT for Java version updating from 1.8 to 11, refs #1134 .
2024-04-03 01:00:47 +08:00
31548deb93
Revert "Refactored code for increased optimization. ( #1139 )" ( #1153 )
...
This reverts commit f051d978e2
2024-03-30 14:37:55 +08:00
f051d978e2
Refactored code for increased optimization. ( #1139 )
...
* refactoring by decompose conditional technique
* refactoring by introduction explaining variable technique
* refactoring by rename method/variable technique
* refactoring by introducing explaining variable technique
* Added Extract class refactoring to increase maintainablilty
* Refactoring using replace conditional with polymorphism
2024-03-30 14:28:02 +08:00
9b9f173c1c
Refactored Code to increase maintainability ( #1152 )
...
* Initial Commit
* Assignment 1 Submission
* Resolving Implementation Smells
* Refactoring Code to increase maintainability
2024-03-30 14:26:41 +08:00
28ac8bf9c4
Refactored Code to Resolve Implementation Code Smells ( #1151 )
...
* Initial Commit
* Assignment 1 Submission
* Resolving Implementation Smells
2024-03-29 00:45:12 +08:00
e4ab6e27e4
Optimize Request#extras, refs #1148 .
2024-03-03 18:35:25 +08:00
1e5c6488ff
Update for next development version
2023-12-05 12:48:14 +08:00
73dd2ebbac
Update versions for release
2023-12-05 12:28:05 +08:00
67644de3d9
Expose Page to onSuccess & onError.
2023-11-20 18:28:27 +08:00
8c008563ff
Update for next development version
2023-09-10 17:06:55 +08:00
07e83a421b
Update versions for release
2023-09-10 16:35:32 +08:00
6e8d130113
Update for next development version
2023-06-22 11:23:44 +08:00
3688226e32
Update versions for release
2023-06-22 11:16:41 +08:00
a5fb4e0414
Upgrade dependencies.
2023-06-22 10:40:37 +08:00
ef616c999e
Fix warnings.
2022-11-27 02:05:31 +08:00
cda8467f95
Update for next development version
2022-11-24 00:49:43 +08:00
888682863c
Update versions for release
2022-11-24 00:30:07 +08:00
5d5f3bf20e
Update for next development version
2022-10-24 00:17:21 +08:00
838c47f1f6
Update versions for release
2022-10-23 23:58:21 +08:00
d2b2eed9df
Pass the task to onSuccess & onError.
2022-10-19 22:15:41 +08:00
7a62a6cb45
Revert "Revert "Common the downloader status process and pass error information when …""
...
This reverts commit acfbd7b883
2022-10-01 17:33:11 +08:00
acfbd7b883
Revert "Common the downloader status process and pass error information when …"
2022-10-01 10:37:09 +08:00
d01f26333b
Common the downloader status process and pass error information when onError
2022-10-01 00:21:17 +08:00
54da7af17e
change dependency versions into properties
...
change dependency versions into properties
update commons-collections from 3.x to 4.4
2022-05-03 17:42:42 +08:00
c5a037a807
Update for next development version
2021-07-22 13:02:46 +08:00
4e51a4f68b
Update versions for release
2021-07-22 12:42:55 +08:00
528a8908af
增加了List<SpiderStatusMXBean>属性的get方法,供SpiderMonitor的子类获取.
2021-02-27 19:59:05 +13:00
71b7dfbf9a
Merge pull request #993 from yqia182/master
...
SpiderStatus中getPagePerSecond()方法，增加验证逻辑，避免空指针，避免除数为零。
2021-02-03 10:13:50 +08:00
54127318a4
SpiderStatus中getPagePerSecond()方法，增加验证逻辑，避免空指针，避免除数为零。
2021-02-03 02:43:53 +13:00
0e01550a79
Upgrade dependencies, including the jedis from 2.9.3 to 3.4.1.
2021-01-06 03:21:10 +08:00
c489647c4b
Revert " Downloader 提供刷新组件的api,方便在spider中操作"
...
This reverts commit 2e2a0fdf3e
2021-01-02 20:15:10 +08:00
2e2a0fdf3e
Downloader 提供刷新组件的api,方便在spider中操作
2020-12-21 18:08:55 +08:00
4b902270b4
Bump version number from 0.7.3 to 0.7.4.
2020-10-27 09:01:21 +08:00
5d14efc50f
Serialize request URL only in FileCacheQueueScheduler.
2020-06-14 00:20:39 +08:00
71aa04c89f
Upgrade dependencies.
2020-05-30 02:10:01 +08:00
ba1b4017a7
Mark slf4j-log4j12 as optional.
2020-05-21 19:59:29 +08:00
b98a87e45a
Serialize requests in FileCacheQueueScheduler, so that the extra info of request could be restored.
2020-04-11 20:21:20 +08:00
c701fe8d38
#702 Refactor: rename CheckForAdditionalInfo to checkForAdditionalInfo
2017-11-30 11:50:52 +08:00
266083fa07
[Fix] #698 Repair using redis,Request additional information is lost
2017-11-29 20:19:00 +08:00
e5db538c19
#647 remove ThreadSafe annotation
2017-11-29 13:49:40 +08:00
Sutra Zhou
François Gibier
Parthgajera056
ayushi250317
vio.ao
David Hsing
wecandoitjustthink
yao
yihua.huang
yihy