Commit Graph

1264 Commits (a5144350bddea084e5e88bbac2a71642f224e0ff)

Author SHA1 Message Date
Joe Zhou a5144350bd Upgrade maven plugins to latest versions. 2024-04-22 00:45:54 +08:00
Joe Zhou e34b495625 Upgrade maven-suirefire-plugin from 3.0.0-M7 to 3.2.5. 2024-04-22 00:17:58 +08:00
Joe Zhou 5344db0106 Upgrade jacoco-maven-plugin from 0.8.8 to 0.8.12. 2024-04-21 23:35:26 +08:00
Joe Zhou 9ab342c3a7 Remove public modifiers from junit5 test methods. 2024-04-21 23:31:21 +08:00
Joe Zhou 5196a56ccf Format code. 2024-04-21 23:30:43 +08:00
Joe Zhou dba1668306 Add tests to test the equals & hashCode of Proxy. 2024-04-21 23:23:32 +08:00
Joe Zhou b7e0d360ec Upgrade junit from 4.13.2 to 5.10.2. 2024-04-21 22:04:48 +08:00
François Gibier d8321baf56
Refactored and implement of a template method pattern for logger config in webmagic-scripts (#1158)
* Refactor of processSingle in PageModelExtractor

* Changed my refactor of processSingle, this one is a lot better

* Changed my refactor of processSingle, this one is a lot better

* add lombok for getters and setters

* Refactored and implement of a template method pattern for logger config
2024-04-06 07:55:46 +08:00
François Gibier 2df7dca871
Changed refactor of processSingle again, this one is a better version (#1157)
* Refactor of processSingle in PageModelExtractor

* Changed my refactor of processSingle, this one is a lot better

* Changed my refactor of processSingle, this one is a lot better
2024-04-05 22:50:21 +08:00
François Gibier 05e5eefc7d
Refactor of processSingle in PageModelExtractor (#1155) 2024-04-05 21:51:08 +08:00
Joe Zhou f10fabcb58 Update .gitignore, with merging Maven.gitignore & Global/Eclipse.gitignore in github/gitignore. 2024-04-03 20:21:02 +08:00
dependabot[bot] 383bea32f6
Bump com.jayway.jsonpath:json-path from 2.8.0 to 2.9.0 (#1154)
Bumps [com.jayway.jsonpath:json-path](https://github.com/jayway/JsonPath) from 2.8.0 to 2.9.0.
- [Release notes](https://github.com/jayway/JsonPath/releases)
- [Changelog](https://github.com/json-path/JsonPath/blob/master/changelog.md)
- [Commits](https://github.com/jayway/JsonPath/compare/json-path-2.8.0...json-path-2.9.0)

---
updated-dependencies:
- dependency-name: com.jayway.jsonpath:json-path
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-03 19:44:15 +08:00
Sutra Zhou ed7429c293 Rename webmagic-parent to webmagic. 2024-04-03 19:37:56 +08:00
Sutra Zhou 4ebf48f6e3 Replace log4j 1.x with log4j 2.x, refs #534. 2024-04-03 18:26:01 +08:00
Joe Zhou 2c730eb978 Update Java version from 1.8 to 11, refs #1134. 2024-04-03 01:14:36 +08:00
Joe Zhou 0ceaf14882 Bump version number from 0.10.1-SNAPSHOT to 1.0.0-SNAPSHOT for Java version updating from 1.8 to 11, refs #1134. 2024-04-03 01:00:47 +08:00
Sutra Zhou 31548deb93
Revert "Refactored code for increased optimization. (#1139)" (#1153)
This reverts commit f051d978e2.
2024-03-30 14:37:55 +08:00
Parthgajera056 f051d978e2
Refactored code for increased optimization. (#1139)
* refactoring by decompose conditional technique

* refactoring by introduction explaining variable technique

* refactoring by rename method/variable technique

* refactoring by introducing explaining variable technique

* Added Extract class refactoring to increase maintainablilty

* Refactoring using replace conditional with polymorphism
2024-03-30 14:28:02 +08:00
ayushi250317 9b9f173c1c
Refactored Code to increase maintainability (#1152)
* Initial Commit

* Assignment 1 Submission

* Resolving Implementation Smells

* Refactoring Code to increase maintainability
2024-03-30 14:26:41 +08:00
ayushi250317 28ac8bf9c4
Refactored Code to Resolve Implementation Code Smells (#1151)
* Initial Commit

* Assignment 1 Submission

* Resolving Implementation Smells
2024-03-29 00:45:12 +08:00
ayushi250317 80842d72db
Added test cases for improving line and branch coverage (#1150)
* Initial Commit

* Assignment 1 Submission
2024-03-23 13:22:30 +08:00
Ch3n4y 7f8607b881
update com.fasterxml.jackson.core:jackson-databind 2.15.2 to 2.16.0 (#1149) 2024-03-07 08:41:26 +08:00
Sutra Zhou 22a60df6aa Fix build for selenium upgrading from 3.141.59 to 4.14.1, refs #1134. 2024-03-03 20:02:09 +08:00
Sutra Zhou e4ab6e27e4 Optimize Request#extras, refs #1148. 2024-03-03 18:35:25 +08:00
Sutra Zhou 95d1f44150 Optimize Request#extras, fix #1148. 2024-03-03 18:33:00 +08:00
Sutra Zhou 7ededbea1a Fix javadoc. 2023-12-05 12:56:14 +08:00
Sutra Zhou 1e5c6488ff Update for next development version 2023-12-05 12:48:14 +08:00
Sutra Zhou 26e134f9a1 Merge tag 'WebMagic-0.10.0' into develop
Tag release
2023-12-05 12:47:56 +08:00
Sutra Zhou 5d55bf33d2 Merge branch 'release/0.10.0' 2023-12-05 12:47:56 +08:00
Sutra Zhou 73dd2ebbac Update versions for release 2023-12-05 12:28:05 +08:00
Harikrishna 7c20290ce4
Refactor addTargetRequests method to eliminate redundant code. (#1138) 2023-11-26 10:56:06 +08:00
Harikrishna a911104076
Refactored to remove multiple calls of getSourceTexts() api (#1137) 2023-11-24 20:09:32 +08:00
Harikrishna 622ed5a17f
Refactor compareLong method using Long.compare, corrected the local variable name (#1136) 2023-11-24 12:37:04 +08:00
Sutra Zhou 67644de3d9 Expose Page to onSuccess & onError. 2023-11-20 18:28:27 +08:00
Yihua Huang 19288e9c11
fix: pom.xml to reduce vulnerabilities (#1134)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGSELENIUMHQSELENIUM-6062318

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2023-11-17 22:12:43 +08:00
Joe Zhou eda3be9432 Fix log format. 2023-11-06 22:44:53 +08:00
Maciej Walkowiak 73f60f809e
Fix typos (#1131) 2023-10-24 07:50:14 +08:00
Joe Zhou c0d38a6f1a Upgrade maven-fluido-skin from 1.9 to 1.11.1. 2023-09-23 12:04:56 +08:00
Joe Zhou 8c008563ff Update for next development version 2023-09-10 17:06:55 +08:00
Joe Zhou 21de4689ab Merge branch 'release/0.9.1' 2023-09-10 17:06:52 +08:00
Joe Zhou 780e712b0c Merge tag 'WebMagic-0.9.1' into develop
Tag release
2023-09-10 17:06:52 +08:00
Joe Zhou 07e83a421b Update versions for release 2023-09-10 16:35:32 +08:00
Joe Zhou 0b62461b7a Upgrade mapdb from 3.0.9 to 3.0.10. 2023-09-10 16:25:10 +08:00
dack-su 238814acb4
update net.sourceforge.htmlcleaner:htmlcleaner 2.26 to 2.29 (#1127) 2023-09-07 07:20:11 +08:00
Yihua Huang 028f1ed4a4
fix: pom.xml to reduce vulnerabilities (#1126)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-NETSOURCEFORGEHTMLCLEANER-5710357

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2023-08-22 13:02:24 +08:00
Joe Zhou 6e8d130113 Update for next development version 2023-06-22 11:23:44 +08:00
Joe Zhou fd4a136f9a Merge branch 'release/0.9.0' 2023-06-22 11:23:41 +08:00
Joe Zhou 94107bc5b3 Merge tag 'WebMagic-0.9.0' into develop
Tag release
2023-06-22 11:23:41 +08:00
Joe Zhou 3688226e32 Update versions for release 2023-06-22 11:16:41 +08:00
Joe Zhou ad010927f6 Fix test. 2023-06-22 10:40:46 +08:00