Mobai
/
magic-Dependency
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,292 Commits
1 Branch
0 Tags
14 MiB
Commit Graph

1292 Commits (master)

Author SHA1 Message Date
Joe Zhou 075b98291b Return spider in setEmptySleepTime itself for chainning. 2022-11-12 11:06:08 +08:00
Joe Zhou ac912e8f1f Revise QueueScheduler to support capacity-restricted. 2022-11-12 10:17:36 +08:00
Sutra Zhou 5d5f3bf20e Update for next development version 2022-10-24 00:17:21 +08:00
Sutra Zhou 6ba2256458 Merge tag 'WebMagic-0.7.6' into develop 
Tag release
 2022-10-24 00:17:15 +08:00
Sutra Zhou f45a8ff3e7 Merge branch 'master' of github.com:code4craft/webmagic 2022-10-24 00:15:30 +08:00
Sutra Zhou dc7218eba3 Merge branch 'release/0.7.6' 2022-10-24 00:10:29 +08:00
Sutra Zhou 838c47f1f6 Update versions for release 2022-10-23 23:58:21 +08:00
Sutra Zhou d2b2eed9df Pass the task to onSuccess & onError. 2022-10-19 22:15:41 +08:00
Sutra Zhou 5f80e02abd Interrupt current thread. 2022-10-19 22:08:38 +08:00
Sutra Zhou 904cd28236
Merge pull request #1089 from code4craft/snyk-fix-e9d89e9698a464f561824a17e083e765 
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.4 to 2.13.4.2
 2022-10-18 21:11:02 +08:00
snyk-bot a0ad7b808b
fix: webmagic-samples/pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-3038426
 2022-10-18 13:06:21 +00:00
Sutra Zhou 126c32ecd0 Fix compatible issue. 2022-10-16 07:21:35 +08:00
Sutra Zhou 6647af8d61
Merge pull request #762 from jialigit/master 
: 是非法字符，无法作为文件名
 2022-10-12 11:25:41 +08:00
Sutra Zhou da357f0370
Merge pull request #1088 from code4craft/snyk-fix-305ed17aec2839f91059daec3059c3ce 
[Snyk] Security upgrade us.codecraft:xsoup from 0.3.4 to 0.3.6
 2022-10-07 13:09:01 +08:00
snyk-bot 223cfc609d
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJSOUP-2989728
 2022-10-06 04:58:32 +00:00
Sutra Zhou 889b218798
Merge pull request #1087 from code4craft/snyk-fix-1f503660a3fe9a29c6255ad6d4e9b9ce 
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.2.1 to 2.13.4
 2022-10-03 16:39:56 +08:00
snyk-bot a255640c3d
fix: webmagic-samples/pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-3038424
 2022-10-03 07:46:32 +00:00
Sutra Zhou afc8309409 Upgrade maven plugins and dependencies. 2022-10-01 23:34:57 +08:00
Sutra Zhou 69accb656a
Merge pull request #1086 from vioao/enhance_jsoup_parse_table 
Enhance Jsoup could parse tr td tag directly
 2022-10-01 18:28:35 +08:00
vio.ao e7a7fbeeeb Enhance Jsoup could parse tr td tag directly 2022-10-01 18:23:15 +08:00
Sutra Zhou db9c92edf5
Merge pull request #1085 from vioao/common-downloader-error-process 
Common downloader error process
 2022-10-01 17:44:43 +08:00
vio.ao 5751681c91 Common the downloader status process and pass error information when onError 2022-10-01 17:34:02 +08:00
vio.ao 7a62a6cb45 Revert "Revert "Common the downloader status process and pass error information when …"" 
This reverts commit acfbd7b883.
 2022-10-01 17:33:11 +08:00
Sutra Zhou a3428846ca
Merge pull request #1083 from code4craft/revert-1082-common-downloader-status-process 
Revert "Common the downloader status process and pass error information when …"
 2022-10-01 10:37:27 +08:00
Sutra Zhou acfbd7b883
Revert "Common the downloader status process and pass error information when …" 2022-10-01 10:37:09 +08:00
Sutra Zhou ee5a0585d7
Merge pull request #1082 from vioao/common-downloader-status-process 
Common the downloader status process and pass error information when …
 2022-10-01 09:07:46 +08:00
vio.ao d01f26333b Common the downloader status process and pass error information when onError 2022-10-01 00:21:17 +08:00
Sutra Zhou 16221e391d Fix xhtml namespace. 2022-08-05 01:03:00 +08:00
Sutra Zhou 31c4e48e79
Merge pull request #1075 from code4craft/snyk-fix-53f8206c2d48cf7014326d6f53ad35a4 
[Snyk] Security upgrade org.seleniumhq.selenium:selenium-java from 3.141.59 to 4.0.0
 2022-07-23 14:14:51 +08:00
snyk-bot 565300cbaa
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMSQUAREUPOKHTTP3-2958044
 2022-07-23 05:43:39 +00:00
Sutra Zhou 4a22c803e2
Merge pull request #1072 from code4craft/snyk-fix-4eb94e676367a3667c00737cdabdf3de 
[Snyk] Security upgrade us.codecraft:xsoup from 0.3.2 to 0.3.4
 2022-06-30 08:51:30 +08:00
snyk-bot 31cf237e7c
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJSOUP-1567345
 2022-06-29 19:41:24 +00:00
Sutra Zhou 433fe40833
Merge pull request #1071 from code4craft/snyk-fix-8beb1ce977279ec88cdb90c43603581c 
[Snyk] Security upgrade com.alibaba:fastjson from 1.2.75 to 1.2.83
 2022-06-08 08:45:56 +08:00
snyk-bot 1ece3ce344
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMALIBABA-2859222
 2022-06-07 19:18:20 +00:00
Sutra Zhou 6747046b6c
Merge pull request #1067 from yokelsoft/develop 
change dependency versions into properties
 2022-05-03 20:04:23 +08:00
David Hsing 54da7af17e change dependency versions into properties 
change dependency versions into properties
update commons-collections from 3.x to 4.4
 2022-05-03 17:42:42 +08:00
Sutra Zhou add873d488
Merge pull request #1065 from code4craft/snyk-fix-a0dcc179d2c2f593e02424c579060a2d 
[Snyk] Security upgrade org.jetbrains.kotlin:kotlin-stdlib from 1.1.2-2 to 1.6.0
 2022-04-15 07:21:22 +08:00
snyk-bot 137e7b56ca
fix: webmagic-scripts/pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJETBRAINSKOTLIN-2628385
 2022-04-12 16:18:38 +00:00
Sutra Zhou e47bf1733b
Merge pull request #1064 from code4craft/snyk-fix-25c8898b02f8de0fc143c2eaa3e8c7cc 
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.2 to 2.13.2.1
 2022-03-27 00:21:43 +08:00
snyk-bot 9628739ceb
fix: webmagic-samples/pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-2421244
 2022-03-26 16:18:31 +00:00
Sutra Zhou 37b00d41a7
Merge pull request #1063 from code4craft/snyk-fix-3bde29486cddc7ed8a030e05f97999dd 
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.0 to 2.13.2
 2022-03-22 20:24:41 +08:00
snyk-bot 90e3d631fb
fix: webmagic-samples/pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-2421244
 2022-03-21 17:09:14 +00:00
Sutra Zhou ddb026d613
Merge pull request #1060 from code4craft/snyk-fix-729e15e7770e9475a8504ae0fb1b5fe7 
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.0-rc1 to 2.13.0
 2022-03-12 10:09:46 +08:00
snyk-bot 3776de6de2
fix: webmagic-samples/pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-2421244
 2022-03-11 16:26:38 +00:00
Sutra Zhou f50b1c77b6
Merge pull request #1056 from code4craft/snyk-fix-cdf627b4ee226c4d9171b1960a044dc0 
[Snyk] Security upgrade net.sourceforge.htmlcleaner:htmlcleaner from 2.9 to 2.26
 2022-01-19 01:41:04 +08:00
snyk-bot a4f2bead80
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJDOM-1309669
 2022-01-18 16:51:10 +00:00
Sutra Zhou 571bac9d88
Merge pull request #1050 from code4craft/snyk-fix-3bb5020d5999f6b3ded6eb3378296acd 
[Snyk] Security upgrade com.github.dreamhead:moco-core from 1.2.0 to 1.3.0
 2022-01-02 22:24:16 +08:00
snyk-bot 88da899a89
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-2326698
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1584063
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1584064
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-2314893
 2022-01-01 18:51:21 +00:00
Sutra Zhou 1b4098c357
Merge pull request #1048 from code4craft/snyk-fix-5e9c00d3ecc1ab84f141bc680b00fe19 
[Snyk] Security upgrade com.jayway.jsonpath:json-path from 2.5.0 to 2.6.0
 2021-12-17 21:18:50 +08:00
snyk-bot 0c2a7daf4b
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-1078499
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-1298655
 2021-12-16 13:32:43 +00:00