Mobai
/
magic-Dependency
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,248 Commits
1 Branch
0 Tags
14 MiB
Commit Graph

1248 Commits (462c60fef2e4f3c97f2f55415d76ce035a6478fc)

Author SHA1 Message Date
Sutra Zhou 462c60fef2 Fix for entity is null. 2024-04-23 23:37:46 +08:00
Sutra Zhou 54aef0f0e0 Update versions for hotfix 2024-04-23 23:34:15 +08:00
Sutra Zhou 0dc852e219 Merge branch 'hotfix/0.10.2' 2024-04-23 21:46:28 +08:00
Sutra Zhou 0dbfaf7284 Remove useless log. 2024-04-23 21:34:59 +08:00
Sutra Zhou bda51537b6 Update versions for hotfix 2024-04-23 21:32:04 +08:00
Sutra Zhou 2994716ba5 Merge branch 'hotfix/0.10.1' 2024-04-23 20:37:56 +08:00
Sutra Zhou 78740a4e28 Fix NPE. 2024-04-23 20:26:38 +08:00
Sutra Zhou 5afe3e7b81 Revert "fix: pom.xml to reduce vulnerabilities (#1134)" 
This reverts commit 19288e9c11.
 2024-04-23 20:21:45 +08:00
Sutra Zhou a0ff4a2d2e Fix log message. 2024-04-23 20:09:15 +08:00
Sutra Zhou 76ef0332f1 Update versions for hotfix 2024-04-23 20:06:47 +08:00
Yihua Huang 65fd8f3779
fix: pom.xml to reduce vulnerabilities (#1146) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMJAYWAYJSONPATH-6140361

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
 2024-01-22 12:50:01 +08:00
Yihua Huang 4281f82352
fix: webmagic-samples/pom.xml to reduce vulnerabilities (#1142) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJETBRAINSKOTLIN-2393744
- https://snyk.io/vuln/SNYK-JAVA-ORGJETBRAINSKOTLIN-2628385

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
 2024-01-11 08:53:43 +08:00
Sutra Zhou 5d55bf33d2 Merge branch 'release/0.10.0' 2023-12-05 12:47:56 +08:00
Sutra Zhou 73dd2ebbac Update versions for release 2023-12-05 12:28:05 +08:00
Harikrishna 7c20290ce4
Refactor addTargetRequests method to eliminate redundant code. (#1138) 2023-11-26 10:56:06 +08:00
Harikrishna a911104076
Refactored to remove multiple calls of getSourceTexts() api (#1137) 2023-11-24 20:09:32 +08:00
Harikrishna 622ed5a17f
Refactor compareLong method using Long.compare, corrected the local variable name (#1136) 2023-11-24 12:37:04 +08:00
Sutra Zhou 67644de3d9 Expose Page to onSuccess & onError. 2023-11-20 18:28:27 +08:00
Yihua Huang 19288e9c11
fix: pom.xml to reduce vulnerabilities (#1134) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGSELENIUMHQSELENIUM-6062318

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
 2023-11-17 22:12:43 +08:00
Joe Zhou eda3be9432 Fix log format. 2023-11-06 22:44:53 +08:00
Maciej Walkowiak 73f60f809e
Fix typos (#1131) 2023-10-24 07:50:14 +08:00
Joe Zhou c0d38a6f1a Upgrade maven-fluido-skin from 1.9 to 1.11.1. 2023-09-23 12:04:56 +08:00
Joe Zhou 8c008563ff Update for next development version 2023-09-10 17:06:55 +08:00
Joe Zhou 21de4689ab Merge branch 'release/0.9.1' 2023-09-10 17:06:52 +08:00
Joe Zhou 780e712b0c Merge tag 'WebMagic-0.9.1' into develop 
Tag release
 2023-09-10 17:06:52 +08:00
Joe Zhou 07e83a421b Update versions for release 2023-09-10 16:35:32 +08:00
Joe Zhou 0b62461b7a Upgrade mapdb from 3.0.9 to 3.0.10. 2023-09-10 16:25:10 +08:00
dack-su 238814acb4
update net.sourceforge.htmlcleaner:htmlcleaner 2.26 to 2.29 (#1127) 2023-09-07 07:20:11 +08:00
Yihua Huang 028f1ed4a4
fix: pom.xml to reduce vulnerabilities (#1126) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-NETSOURCEFORGEHTMLCLEANER-5710357

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
 2023-08-22 13:02:24 +08:00
Joe Zhou 6e8d130113 Update for next development version 2023-06-22 11:23:44 +08:00
Joe Zhou fd4a136f9a Merge branch 'release/0.9.0' 2023-06-22 11:23:41 +08:00
Joe Zhou 94107bc5b3 Merge tag 'WebMagic-0.9.0' into develop 
Tag release
 2023-06-22 11:23:41 +08:00
Joe Zhou 3688226e32 Update versions for release 2023-06-22 11:16:41 +08:00
Joe Zhou ad010927f6 Fix test. 2023-06-22 10:40:46 +08:00
Joe Zhou a5fb4e0414 Upgrade dependencies. 2023-06-22 10:40:37 +08:00
Joe Zhou 58fd08bcf8 Expose Request to ProxyProvider. 2023-06-22 09:52:58 +08:00
Yihua Huang 9e59b37834
fix: pom.xml to reduce vulnerabilities (#1119) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMGOOGLEGUAVA-5710356

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
 2023-06-20 13:39:45 +08:00
Snyk bot aeb0e89f02
fix: pom.xml to reduce vulnerabilities (#1114) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-3369748
 2023-03-28 00:30:03 +08:00
Tanky-Zhang 244ade7b4c
feat:update host verify (#1112) 2023-03-22 22:25:51 +08:00
hooy 717931166a
向 webmagic-saxon 组件提供若干新 API，更优雅更灵活更强大 (#1108) 
* Feature:
* webmagic-saxon 组件新增若干新 API；

* Update: 更优雅的写代码。

* Update: JaxpSelectorUtils 工具类增加 final 关键字。
 2023-02-11 02:14:11 +08:00
Sutra Zhou f47038db63
Merge pull request #1107 from hooyantsing/develop 
修复 HtmlCleaner 无法正常解析 tr 和 td 标签的问题
 2023-02-04 14:07:17 +08:00
hooyantsing 08f4a4046b Update: 提供测试用例。 2023-02-03 22:59:56 +08:00
hooyantsing 12ce86425f BugFix: Jsoup 和 HtmlCleaner 构建 Dom 时，若缺失 table 标签，则无法正常解析 tr 和 td 标签。 2023-02-03 22:48:58 +08:00
Joe Zhou a266df406f Add Site.defaultCharset. closes #1101. 2022-12-20 23:41:31 +08:00
Joe Zhou 80424b0bd7 Replace List with Iterable, fixed #1099. 2022-12-05 23:26:01 +08:00
Joe Zhou ef616c999e Fix warnings. 2022-11-27 02:05:31 +08:00
Joe Zhou faf7e1559a Update README for the webmagic version. 2022-11-24 20:31:43 +08:00
Joe Zhou cda8467f95 Update for next development version 2022-11-24 00:49:43 +08:00
Joe Zhou 43ce1a0db9 Merge branch 'release/0.8.0' 2022-11-24 00:49:41 +08:00
Joe Zhou 3085896743 Merge tag 'WebMagic-0.8.0' into develop 
Tag release
 2022-11-24 00:49:41 +08:00