Commit Graph

1218 Commits (94107bc5b362db3f12624b2725c55f67d1795fa1)

Author SHA1 Message Date
Sutra Zhou acfbd7b883
Revert "Common the downloader status process and pass error information when …" 2022-10-01 10:37:09 +08:00
Sutra Zhou ee5a0585d7
Merge pull request #1082 from vioao/common-downloader-status-process
Common the downloader status process and pass error information when …
2022-10-01 09:07:46 +08:00
vio.ao d01f26333b Common the downloader status process and pass error information when onError 2022-10-01 00:21:17 +08:00
Sutra Zhou 16221e391d Fix xhtml namespace. 2022-08-05 01:03:00 +08:00
Sutra Zhou 31c4e48e79
Merge pull request #1075 from code4craft/snyk-fix-53f8206c2d48cf7014326d6f53ad35a4
[Snyk] Security upgrade org.seleniumhq.selenium:selenium-java from 3.141.59 to 4.0.0
2022-07-23 14:14:51 +08:00
snyk-bot 565300cbaa
fix: pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMSQUAREUPOKHTTP3-2958044
2022-07-23 05:43:39 +00:00
Sutra Zhou 4a22c803e2
Merge pull request #1072 from code4craft/snyk-fix-4eb94e676367a3667c00737cdabdf3de
[Snyk] Security upgrade us.codecraft:xsoup from 0.3.2 to 0.3.4
2022-06-30 08:51:30 +08:00
snyk-bot 31cf237e7c
fix: pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJSOUP-1567345
2022-06-29 19:41:24 +00:00
Sutra Zhou 433fe40833
Merge pull request #1071 from code4craft/snyk-fix-8beb1ce977279ec88cdb90c43603581c
[Snyk] Security upgrade com.alibaba:fastjson from 1.2.75 to 1.2.83
2022-06-08 08:45:56 +08:00
snyk-bot 1ece3ce344
fix: pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMALIBABA-2859222
2022-06-07 19:18:20 +00:00
Sutra Zhou 6747046b6c
Merge pull request #1067 from yokelsoft/develop
change dependency versions into properties
2022-05-03 20:04:23 +08:00
David Hsing 54da7af17e change dependency versions into properties
change dependency versions into properties
update commons-collections from 3.x to 4.4
2022-05-03 17:42:42 +08:00
Sutra Zhou add873d488
Merge pull request #1065 from code4craft/snyk-fix-a0dcc179d2c2f593e02424c579060a2d
[Snyk] Security upgrade org.jetbrains.kotlin:kotlin-stdlib from 1.1.2-2 to 1.6.0
2022-04-15 07:21:22 +08:00
snyk-bot 137e7b56ca
fix: webmagic-scripts/pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJETBRAINSKOTLIN-2628385
2022-04-12 16:18:38 +00:00
Sutra Zhou e47bf1733b
Merge pull request #1064 from code4craft/snyk-fix-25c8898b02f8de0fc143c2eaa3e8c7cc
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.2 to 2.13.2.1
2022-03-27 00:21:43 +08:00
snyk-bot 9628739ceb
fix: webmagic-samples/pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-2421244
2022-03-26 16:18:31 +00:00
Sutra Zhou 37b00d41a7
Merge pull request #1063 from code4craft/snyk-fix-3bde29486cddc7ed8a030e05f97999dd
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.0 to 2.13.2
2022-03-22 20:24:41 +08:00
snyk-bot 90e3d631fb
fix: webmagic-samples/pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-2421244
2022-03-21 17:09:14 +00:00
Sutra Zhou ddb026d613
Merge pull request #1060 from code4craft/snyk-fix-729e15e7770e9475a8504ae0fb1b5fe7
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.0-rc1 to 2.13.0
2022-03-12 10:09:46 +08:00
snyk-bot 3776de6de2
fix: webmagic-samples/pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-2421244
2022-03-11 16:26:38 +00:00
Sutra Zhou f50b1c77b6
Merge pull request #1056 from code4craft/snyk-fix-cdf627b4ee226c4d9171b1960a044dc0
[Snyk] Security upgrade net.sourceforge.htmlcleaner:htmlcleaner from 2.9 to 2.26
2022-01-19 01:41:04 +08:00
snyk-bot a4f2bead80
fix: pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJDOM-1309669
2022-01-18 16:51:10 +00:00
Sutra Zhou 571bac9d88
Merge pull request #1050 from code4craft/snyk-fix-3bb5020d5999f6b3ded6eb3378296acd
[Snyk] Security upgrade com.github.dreamhead:moco-core from 1.2.0 to 1.3.0
2022-01-02 22:24:16 +08:00
snyk-bot 88da899a89
fix: pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-2326698
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1584063
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1584064
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-2314893
2022-01-01 18:51:21 +00:00
Sutra Zhou 1b4098c357
Merge pull request #1048 from code4craft/snyk-fix-5e9c00d3ecc1ab84f141bc680b00fe19
[Snyk] Security upgrade com.jayway.jsonpath:json-path from 2.5.0 to 2.6.0
2021-12-17 21:18:50 +08:00
snyk-bot 0c2a7daf4b
fix: pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-1078499
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-1298655
2021-12-16 13:32:43 +00:00
Sutra Zhou 692605bd75 Merge branch 'develop' of github.com:code4craft/webmagic into develop 2021-10-24 23:20:56 +08:00
Sutra Zhou 34da2fb3a0 Make PageProcessor#getSite be default method. Closes #1040. 2021-10-24 23:20:38 +08:00
Sutra Zhou 626ba57b0e
Merge pull request #1036 from code4craft/snyk-fix-f533124205b5e86f0bda976e921ffec2
[Snyk] Security upgrade org.jruby:jruby from 9.2.14.0 to 9.3.0.0
2021-09-23 23:04:31 +08:00
snyk-bot cdbba362bb
fix: pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMGITHUBJNR-1570422
2021-09-23 07:48:41 +00:00
Sutra Zhou f110147b62
Merge pull request #1033 from carl-don-it/perfect_spider_run
perfect Spider.run to avoid some rare concurrent issue, change the Sp…
2021-08-04 18:25:05 +08:00
carl.don:tjr fcdb9074d6 格式化 Spider.run 代码 2021-08-04 18:23:04 +08:00
carl.don:tjr ab5d81a6b6 perfect Spider.run to avoid some rare concurrent issue, change the Spider.emptySleepTime to long type 2021-08-04 17:17:22 +08:00
Sutra Zhou c5a037a807 Update for next development version 2021-07-22 13:02:46 +08:00
Sutra Zhou 4024230e17 Merge branch 'release/0.7.5' into develop 2021-07-22 13:02:44 +08:00
Sutra Zhou 04978f912d Merge branch 'release/0.7.5' 2021-07-22 12:59:39 +08:00
Sutra Zhou 113eaa4bae Bump version number to 0.7.5. 2021-07-22 12:57:14 +08:00
Sutra Zhou 4e51a4f68b Update versions for release 2021-07-22 12:42:55 +08:00
Sutra Zhou e3e66fb270 Upgrade webmagic-samples dependencies. 2021-07-22 12:38:38 +08:00
Sutra Zhou 14b09a3385 Update maven plugin versions. 2021-07-22 12:36:11 +08:00
Sutra Zhou 31a00f5f8e Set gitflow-maven-plugin versionTagPrefix. 2021-07-22 12:10:46 +08:00
Sutra Zhou db70b6e095 Add maven reports. 2021-06-22 21:58:49 +08:00
Sutra Zhou 1068e185a0
Merge pull request #1029 from code4craft/snyk-fix-9e933ef3fbdfa89b1dad83f86cbbea2a
[Snyk] Security upgrade com.jayway.jsonpath:json-path from 2.4.0 to 2.6.0
2021-06-03 11:34:10 +08:00
snyk-bot 129e9184bf
fix: pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-1078499
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-1298655
2021-06-03 03:28:14 +00:00
Sutra Zhou c7828f44ac
Merge pull request #1025 from gkorland/patch-1
Update to Jedis 3.6.0
2021-05-19 10:12:44 +08:00
Guy Korland 189c5962e6
Update to Jedis 3.6.0 2021-05-18 16:55:29 +03:00
Sutra Zhou dba0ddb92c Remove unknown tag from javadoc. 2021-04-28 12:17:52 +08:00
Sutra Zhou 133106a15c
Merge pull request #1013 from FreaxLin/Restore_the_already_crawled_example
提交可恢复爬取内容例子
2021-04-09 17:04:18 +08:00
linweisen 76f625c02e 提交可恢复爬取内容例子 2021-04-09 17:00:00 +08:00
Sutra Zhou 868b0cb05b
Merge pull request #1011 from code4craft/snyk-fix-9cd27ad57a7323a57b3b3f45ce02a123
[Snyk] Security upgrade com.github.dreamhead:moco-core from 1.1.0 to 1.2.0
2021-04-07 10:11:09 +08:00