Commit Graph

617 Commits (master)

Author SHA1 Message Date
Joe Zhou 3e9cd9b5c3 Update versions for release 2024-07-05 00:20:28 +08:00
Niu_XZ 4d0cdb011f
stopWhenComplete,增加动态修改完成时停止方法。 (#1169)
Co-authored-by: niuxiaozu <niuxiaozu@yeah.net>
2024-06-17 17:27:28 +08:00
Joe Zhou 49a5efff46 Add a private constructor to hide the implicit public one. 2024-06-04 01:02:45 +08:00
Joe Zhou 5c43e36118 Make sure the contentType of detectCharset could be null. 2024-06-04 00:59:30 +08:00
Joe Zhou d2aebc60a7 Make getCharset to support null parameter. 2024-06-04 00:57:28 +08:00
Sutra Zhou 16a4fe3e28 Use oxerr-parent instead. 2024-05-17 13:17:13 +08:00
Sutra Zhou 4ee30c0592 Merge tag 'WebMagic-0.10.3' into develop
Tag hotfix
2024-04-23 23:41:18 +08:00
Sutra Zhou 38f240c42e Update to hotfix version 2024-04-23 23:39:23 +08:00
Sutra Zhou 462c60fef2 Fix for entity is null. 2024-04-23 23:37:46 +08:00
Sutra Zhou 54aef0f0e0 Update versions for hotfix 2024-04-23 23:34:15 +08:00
Sutra Zhou 6be02f3a0f Merge tag 'WebMagic-0.10.2' into develop
Tag hotfix
2024-04-23 21:47:57 +08:00
Sutra Zhou a81c4e7627 Update to hotfix version 2024-04-23 21:46:35 +08:00
Sutra Zhou 0dbfaf7284 Remove useless log. 2024-04-23 21:34:59 +08:00
Sutra Zhou bda51537b6 Update versions for hotfix 2024-04-23 21:32:04 +08:00
Sutra Zhou 2217b1c8f2 Merge tag 'WebMagic-0.10.1' into develop
Tag hotfix
2024-04-23 20:41:02 +08:00
Sutra Zhou 884f51ba3b Update to hotfix version 2024-04-23 20:38:03 +08:00
Sutra Zhou 78740a4e28 Fix NPE. 2024-04-23 20:26:38 +08:00
Sutra Zhou a0ff4a2d2e Fix log message. 2024-04-23 20:09:15 +08:00
Sutra Zhou 76ef0332f1 Update versions for hotfix 2024-04-23 20:06:47 +08:00
Joe Zhou 9ab342c3a7 Remove public modifiers from junit5 test methods. 2024-04-21 23:31:21 +08:00
Joe Zhou 5196a56ccf Format code. 2024-04-21 23:30:43 +08:00
Joe Zhou dba1668306 Add tests to test the equals & hashCode of Proxy. 2024-04-21 23:23:32 +08:00
Joe Zhou b7e0d360ec Upgrade junit from 4.13.2 to 5.10.2. 2024-04-21 22:04:48 +08:00
Sutra Zhou ed7429c293 Rename webmagic-parent to webmagic. 2024-04-03 19:37:56 +08:00
Sutra Zhou 4ebf48f6e3 Replace log4j 1.x with log4j 2.x, refs #534. 2024-04-03 18:26:01 +08:00
Joe Zhou 0ceaf14882 Bump version number from 0.10.1-SNAPSHOT to 1.0.0-SNAPSHOT for Java version updating from 1.8 to 11, refs #1134. 2024-04-03 01:00:47 +08:00
Sutra Zhou 31548deb93
Revert "Refactored code for increased optimization. (#1139)" (#1153)
This reverts commit f051d978e2.
2024-03-30 14:37:55 +08:00
Parthgajera056 f051d978e2
Refactored code for increased optimization. (#1139)
* refactoring by decompose conditional technique

* refactoring by introduction explaining variable technique

* refactoring by rename method/variable technique

* refactoring by introducing explaining variable technique

* Added Extract class refactoring to increase maintainablilty

* Refactoring using replace conditional with polymorphism
2024-03-30 14:28:02 +08:00
ayushi250317 9b9f173c1c
Refactored Code to increase maintainability (#1152)
* Initial Commit

* Assignment 1 Submission

* Resolving Implementation Smells

* Refactoring Code to increase maintainability
2024-03-30 14:26:41 +08:00
ayushi250317 28ac8bf9c4
Refactored Code to Resolve Implementation Code Smells (#1151)
* Initial Commit

* Assignment 1 Submission

* Resolving Implementation Smells
2024-03-29 00:45:12 +08:00
ayushi250317 80842d72db
Added test cases for improving line and branch coverage (#1150)
* Initial Commit

* Assignment 1 Submission
2024-03-23 13:22:30 +08:00
Sutra Zhou 95d1f44150 Optimize Request#extras, fix #1148. 2024-03-03 18:33:00 +08:00
Sutra Zhou 7ededbea1a Fix javadoc. 2023-12-05 12:56:14 +08:00
Sutra Zhou 1e5c6488ff Update for next development version 2023-12-05 12:48:14 +08:00
Sutra Zhou 73dd2ebbac Update versions for release 2023-12-05 12:28:05 +08:00
Harikrishna 7c20290ce4
Refactor addTargetRequests method to eliminate redundant code. (#1138) 2023-11-26 10:56:06 +08:00
Harikrishna a911104076
Refactored to remove multiple calls of getSourceTexts() api (#1137) 2023-11-24 20:09:32 +08:00
Harikrishna 622ed5a17f
Refactor compareLong method using Long.compare, corrected the local variable name (#1136) 2023-11-24 12:37:04 +08:00
Sutra Zhou 67644de3d9 Expose Page to onSuccess & onError. 2023-11-20 18:28:27 +08:00
Joe Zhou eda3be9432 Fix log format. 2023-11-06 22:44:53 +08:00
Joe Zhou 8c008563ff Update for next development version 2023-09-10 17:06:55 +08:00
Joe Zhou 07e83a421b Update versions for release 2023-09-10 16:35:32 +08:00
Joe Zhou 6e8d130113 Update for next development version 2023-06-22 11:23:44 +08:00
Joe Zhou 3688226e32 Update versions for release 2023-06-22 11:16:41 +08:00
Joe Zhou ad010927f6 Fix test. 2023-06-22 10:40:46 +08:00
Joe Zhou 58fd08bcf8 Expose Request to ProxyProvider. 2023-06-22 09:52:58 +08:00
Tanky-Zhang 244ade7b4c
feat:update host verify (#1112) 2023-03-22 22:25:51 +08:00
hooyantsing 12ce86425f BugFix: Jsoup 和 HtmlCleaner 构建 Dom 时,若缺失 table 标签,则无法正常解析 tr 和 td 标签。 2023-02-03 22:48:58 +08:00
Joe Zhou a266df406f Add Site.defaultCharset. closes #1101. 2022-12-20 23:41:31 +08:00
Joe Zhou 80424b0bd7 Replace List with Iterable, fixed #1099. 2022-12-05 23:26:01 +08:00