webMagic-Mobai
/
magic-Dependency
mirror of https://gitea.qinmian.online/Mobai/magic-Dependency.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,227 Commits
1 Branch
0 Tags
14 MiB
Commit Graph

1227 Commits (c0d38a6f1a8406bd0723838a8742db118e4f6463)

Author SHA1 Message Date
Joe Zhou c0d38a6f1a Upgrade maven-fluido-skin from 1.9 to 1.11.1. 2023-09-23 12:04:56 +08:00
Joe Zhou 8c008563ff Update for next development version 2023-09-10 17:06:55 +08:00
Joe Zhou 780e712b0c Merge tag 'WebMagic-0.9.1' into develop 
Tag release
 2023-09-10 17:06:52 +08:00
Joe Zhou 21de4689ab Merge branch 'release/0.9.1' 2023-09-10 17:06:52 +08:00
Joe Zhou 07e83a421b Update versions for release 2023-09-10 16:35:32 +08:00
Joe Zhou 0b62461b7a Upgrade mapdb from 3.0.9 to 3.0.10. 2023-09-10 16:25:10 +08:00
dack-su 238814acb4
update net.sourceforge.htmlcleaner:htmlcleaner 2.26 to 2.29 (#1127) 2023-09-07 07:20:11 +08:00
Yihua Huang 028f1ed4a4
fix: pom.xml to reduce vulnerabilities (#1126) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-NETSOURCEFORGEHTMLCLEANER-5710357

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
 2023-08-22 13:02:24 +08:00
Joe Zhou 6e8d130113 Update for next development version 2023-06-22 11:23:44 +08:00
Joe Zhou fd4a136f9a Merge branch 'release/0.9.0' 2023-06-22 11:23:41 +08:00
Joe Zhou 94107bc5b3 Merge tag 'WebMagic-0.9.0' into develop 
Tag release
 2023-06-22 11:23:41 +08:00
Joe Zhou 3688226e32 Update versions for release 2023-06-22 11:16:41 +08:00
Joe Zhou ad010927f6 Fix test. 2023-06-22 10:40:46 +08:00
Joe Zhou a5fb4e0414 Upgrade dependencies. 2023-06-22 10:40:37 +08:00
Joe Zhou 58fd08bcf8 Expose Request to ProxyProvider. 2023-06-22 09:52:58 +08:00
Yihua Huang 9e59b37834
fix: pom.xml to reduce vulnerabilities (#1119) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMGOOGLEGUAVA-5710356

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
 2023-06-20 13:39:45 +08:00
Snyk bot aeb0e89f02
fix: pom.xml to reduce vulnerabilities (#1114) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-3369748
 2023-03-28 00:30:03 +08:00
Tanky-Zhang 244ade7b4c
feat:update host verify (#1112) 2023-03-22 22:25:51 +08:00
hooy 717931166a
向 webmagic-saxon 组件提供若干新 API，更优雅更灵活更强大 (#1108) 
* Feature:
* webmagic-saxon 组件新增若干新 API；

* Update: 更优雅的写代码。

* Update: JaxpSelectorUtils 工具类增加 final 关键字。
 2023-02-11 02:14:11 +08:00
Sutra Zhou f47038db63
Merge pull request #1107 from hooyantsing/develop 
修复 HtmlCleaner 无法正常解析 tr 和 td 标签的问题
 2023-02-04 14:07:17 +08:00
hooyantsing 08f4a4046b Update: 提供测试用例。 2023-02-03 22:59:56 +08:00
hooyantsing 12ce86425f BugFix: Jsoup 和 HtmlCleaner 构建 Dom 时，若缺失 table 标签，则无法正常解析 tr 和 td 标签。 2023-02-03 22:48:58 +08:00
Joe Zhou a266df406f Add Site.defaultCharset. closes #1101. 2022-12-20 23:41:31 +08:00
Joe Zhou 80424b0bd7 Replace List with Iterable, fixed #1099. 2022-12-05 23:26:01 +08:00
Joe Zhou ef616c999e Fix warnings. 2022-11-27 02:05:31 +08:00
Joe Zhou faf7e1559a Update README for the webmagic version. 2022-11-24 20:31:43 +08:00
Joe Zhou cda8467f95 Update for next development version 2022-11-24 00:49:43 +08:00
Joe Zhou 43ce1a0db9 Merge branch 'release/0.8.0' 2022-11-24 00:49:41 +08:00
Joe Zhou 3085896743 Merge tag 'WebMagic-0.8.0' into develop 
Tag release
 2022-11-24 00:49:41 +08:00
Joe Zhou 7d091def55 Upgrade fastjson, jruby, slf4j. 2022-11-24 00:42:41 +08:00
Joe Zhou a7a06936f0 Fix requireMavenVersion. 2022-11-24 00:33:30 +08:00
Joe Zhou 888682863c Update versions for release 2022-11-24 00:30:07 +08:00
Joe Zhou 64e6a9800a Add dead-lock note for QueueScheduler. 2022-11-24 00:26:09 +08:00
Joe Zhou e735e4e585 Log the remaining capacity. 2022-11-20 18:31:36 +08:00
Joe Zhou 4915431845 Revise logging level from warn to info, as we have passed the exception to onError. refs #1094 2022-11-15 22:48:02 +08:00
Joe Zhou 075b98291b Return spider in setEmptySleepTime itself for chainning. 2022-11-12 11:06:08 +08:00
Joe Zhou ac912e8f1f Revise QueueScheduler to support capacity-restricted. 2022-11-12 10:17:36 +08:00
Sutra Zhou 5d5f3bf20e Update for next development version 2022-10-24 00:17:21 +08:00
Sutra Zhou 6ba2256458 Merge tag 'WebMagic-0.7.6' into develop 
Tag release
 2022-10-24 00:17:15 +08:00
Sutra Zhou f45a8ff3e7 Merge branch 'master' of github.com:code4craft/webmagic 2022-10-24 00:15:30 +08:00
Sutra Zhou dc7218eba3 Merge branch 'release/0.7.6' 2022-10-24 00:10:29 +08:00
Sutra Zhou 838c47f1f6 Update versions for release 2022-10-23 23:58:21 +08:00
Sutra Zhou d2b2eed9df Pass the task to onSuccess & onError. 2022-10-19 22:15:41 +08:00
Sutra Zhou 5f80e02abd Interrupt current thread. 2022-10-19 22:08:38 +08:00
Sutra Zhou 904cd28236
Merge pull request #1089 from code4craft/snyk-fix-e9d89e9698a464f561824a17e083e765 
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.4 to 2.13.4.2
 2022-10-18 21:11:02 +08:00
snyk-bot a0ad7b808b
fix: webmagic-samples/pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-3038426
 2022-10-18 13:06:21 +00:00
Sutra Zhou 126c32ecd0 Fix compatible issue. 2022-10-16 07:21:35 +08:00
Sutra Zhou 6647af8d61
Merge pull request #762 from jialigit/master 
: 是非法字符，无法作为文件名
 2022-10-12 11:25:41 +08:00
Sutra Zhou da357f0370
Merge pull request #1088 from code4craft/snyk-fix-305ed17aec2839f91059daec3059c3ce 
[Snyk] Security upgrade us.codecraft:xsoup from 0.3.4 to 0.3.6
 2022-10-07 13:09:01 +08:00
snyk-bot 223cfc609d
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJSOUP-2989728
 2022-10-06 04:58:32 +00:00