webMagic-Mobai
/
magic-Dependency
mirror of https://gitea.qinmian.online/Mobai/magic-Dependency.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,202 Commits
1 Branch
0 Tags
14 MiB
Commit Graph

1202 Commits (faf7e1559aa98a3bae6421fab1396257324e7273)

Author SHA1 Message Date
Joe Zhou faf7e1559a Update README for the webmagic version. 2022-11-24 20:31:43 +08:00
Joe Zhou cda8467f95 Update for next development version 2022-11-24 00:49:43 +08:00
Joe Zhou 3085896743 Merge tag 'WebMagic-0.8.0' into develop 
Tag release
 2022-11-24 00:49:41 +08:00
Joe Zhou 43ce1a0db9 Merge branch 'release/0.8.0' 2022-11-24 00:49:41 +08:00
Joe Zhou 7d091def55 Upgrade fastjson, jruby, slf4j. 2022-11-24 00:42:41 +08:00
Joe Zhou a7a06936f0 Fix requireMavenVersion. 2022-11-24 00:33:30 +08:00
Joe Zhou 888682863c Update versions for release 2022-11-24 00:30:07 +08:00
Joe Zhou 64e6a9800a Add dead-lock note for QueueScheduler. 2022-11-24 00:26:09 +08:00
Joe Zhou e735e4e585 Log the remaining capacity. 2022-11-20 18:31:36 +08:00
Joe Zhou 4915431845 Revise logging level from warn to info, as we have passed the exception to onError. refs #1094 2022-11-15 22:48:02 +08:00
Joe Zhou 075b98291b Return spider in setEmptySleepTime itself for chainning. 2022-11-12 11:06:08 +08:00
Joe Zhou ac912e8f1f Revise QueueScheduler to support capacity-restricted. 2022-11-12 10:17:36 +08:00
Sutra Zhou 5d5f3bf20e Update for next development version 2022-10-24 00:17:21 +08:00
Sutra Zhou 6ba2256458 Merge tag 'WebMagic-0.7.6' into develop 
Tag release
 2022-10-24 00:17:15 +08:00
Sutra Zhou f45a8ff3e7 Merge branch 'master' of github.com:code4craft/webmagic 2022-10-24 00:15:30 +08:00
Sutra Zhou dc7218eba3 Merge branch 'release/0.7.6' 2022-10-24 00:10:29 +08:00
Sutra Zhou 838c47f1f6 Update versions for release 2022-10-23 23:58:21 +08:00
Sutra Zhou d2b2eed9df Pass the task to onSuccess & onError. 2022-10-19 22:15:41 +08:00
Sutra Zhou 5f80e02abd Interrupt current thread. 2022-10-19 22:08:38 +08:00
Sutra Zhou 904cd28236
Merge pull request #1089 from code4craft/snyk-fix-e9d89e9698a464f561824a17e083e765 
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.4 to 2.13.4.2
 2022-10-18 21:11:02 +08:00
snyk-bot a0ad7b808b
fix: webmagic-samples/pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-3038426
 2022-10-18 13:06:21 +00:00
Sutra Zhou 126c32ecd0 Fix compatible issue. 2022-10-16 07:21:35 +08:00
Sutra Zhou 6647af8d61
Merge pull request #762 from jialigit/master 
: 是非法字符，无法作为文件名
 2022-10-12 11:25:41 +08:00
Sutra Zhou da357f0370
Merge pull request #1088 from code4craft/snyk-fix-305ed17aec2839f91059daec3059c3ce 
[Snyk] Security upgrade us.codecraft:xsoup from 0.3.4 to 0.3.6
 2022-10-07 13:09:01 +08:00
snyk-bot 223cfc609d
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJSOUP-2989728
 2022-10-06 04:58:32 +00:00
Sutra Zhou 889b218798
Merge pull request #1087 from code4craft/snyk-fix-1f503660a3fe9a29c6255ad6d4e9b9ce 
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.2.1 to 2.13.4
 2022-10-03 16:39:56 +08:00
snyk-bot a255640c3d
fix: webmagic-samples/pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-3038424
 2022-10-03 07:46:32 +00:00
Sutra Zhou afc8309409 Upgrade maven plugins and dependencies. 2022-10-01 23:34:57 +08:00
Sutra Zhou 69accb656a
Merge pull request #1086 from vioao/enhance_jsoup_parse_table 
Enhance Jsoup could parse tr td tag directly
 2022-10-01 18:28:35 +08:00
vio.ao e7a7fbeeeb Enhance Jsoup could parse tr td tag directly 2022-10-01 18:23:15 +08:00
Sutra Zhou db9c92edf5
Merge pull request #1085 from vioao/common-downloader-error-process 
Common downloader error process
 2022-10-01 17:44:43 +08:00
vio.ao 5751681c91 Common the downloader status process and pass error information when onError 2022-10-01 17:34:02 +08:00
vio.ao 7a62a6cb45 Revert "Revert "Common the downloader status process and pass error information when …"" 
This reverts commit acfbd7b883.
 2022-10-01 17:33:11 +08:00
Sutra Zhou a3428846ca
Merge pull request #1083 from code4craft/revert-1082-common-downloader-status-process 
Revert "Common the downloader status process and pass error information when …"
 2022-10-01 10:37:27 +08:00
Sutra Zhou acfbd7b883
Revert "Common the downloader status process and pass error information when …" 2022-10-01 10:37:09 +08:00
Sutra Zhou ee5a0585d7
Merge pull request #1082 from vioao/common-downloader-status-process 
Common the downloader status process and pass error information when …
 2022-10-01 09:07:46 +08:00
vio.ao d01f26333b Common the downloader status process and pass error information when onError 2022-10-01 00:21:17 +08:00
Sutra Zhou 16221e391d Fix xhtml namespace. 2022-08-05 01:03:00 +08:00
Sutra Zhou 31c4e48e79
Merge pull request #1075 from code4craft/snyk-fix-53f8206c2d48cf7014326d6f53ad35a4 
[Snyk] Security upgrade org.seleniumhq.selenium:selenium-java from 3.141.59 to 4.0.0
 2022-07-23 14:14:51 +08:00
snyk-bot 565300cbaa
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMSQUAREUPOKHTTP3-2958044
 2022-07-23 05:43:39 +00:00
Sutra Zhou 4a22c803e2
Merge pull request #1072 from code4craft/snyk-fix-4eb94e676367a3667c00737cdabdf3de 
[Snyk] Security upgrade us.codecraft:xsoup from 0.3.2 to 0.3.4
 2022-06-30 08:51:30 +08:00
snyk-bot 31cf237e7c
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJSOUP-1567345
 2022-06-29 19:41:24 +00:00
Sutra Zhou 433fe40833
Merge pull request #1071 from code4craft/snyk-fix-8beb1ce977279ec88cdb90c43603581c 
[Snyk] Security upgrade com.alibaba:fastjson from 1.2.75 to 1.2.83
 2022-06-08 08:45:56 +08:00
snyk-bot 1ece3ce344
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMALIBABA-2859222
 2022-06-07 19:18:20 +00:00
Sutra Zhou 6747046b6c
Merge pull request #1067 from yokelsoft/develop 
change dependency versions into properties
 2022-05-03 20:04:23 +08:00
David Hsing 54da7af17e change dependency versions into properties 
change dependency versions into properties
update commons-collections from 3.x to 4.4
 2022-05-03 17:42:42 +08:00
Sutra Zhou add873d488
Merge pull request #1065 from code4craft/snyk-fix-a0dcc179d2c2f593e02424c579060a2d 
[Snyk] Security upgrade org.jetbrains.kotlin:kotlin-stdlib from 1.1.2-2 to 1.6.0
 2022-04-15 07:21:22 +08:00
snyk-bot 137e7b56ca
fix: webmagic-scripts/pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJETBRAINSKOTLIN-2628385
 2022-04-12 16:18:38 +00:00
Sutra Zhou e47bf1733b
Merge pull request #1064 from code4craft/snyk-fix-25c8898b02f8de0fc143c2eaa3e8c7cc 
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.2 to 2.13.2.1
 2022-03-27 00:21:43 +08:00
snyk-bot 9628739ceb
fix: webmagic-samples/pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-2421244
 2022-03-26 16:18:31 +00:00