5016700658
feat():爬虫框架
2024-08-12 11:03:09 +08:00
9d75cce16d
Merge branch 'release/1.0.0'
2024-07-05 00:27:50 +08:00
3e9cd9b5c3
Update versions for release
2024-07-05 00:20:28 +08:00
4d0cdb011f
stopWhenComplete，增加动态修改完成时停止方法。 ( #1169 )
...
Co-authored-by: niuxiaozu <niuxiaozu@yeah.net>
2024-06-17 17:27:28 +08:00
49a5efff46
Add a private constructor to hide the implicit public one.
2024-06-04 01:02:45 +08:00
5c43e36118
Make sure the contentType of detectCharset could be null.
2024-06-04 00:59:30 +08:00
d2aebc60a7
Make getCharset to support null parameter.
2024-06-04 00:57:28 +08:00
7d2d2244b3
Upgrade oxerr-parent from 2.1.0 to 2.2.1.
2024-05-21 12:55:05 +08:00
16a4fe3e28
Use oxerr-parent instead.
2024-05-17 13:17:13 +08:00
4ee30c0592
Merge tag 'WebMagic-0.10.3' into develop
...
Tag hotfix
2024-04-23 23:41:18 +08:00
38f240c42e
Update to hotfix version
2024-04-23 23:39:23 +08:00
f7fdcd025f
Merge branch 'hotfix/0.10.3'
2024-04-23 23:39:16 +08:00
462c60fef2
Fix for entity is null.
2024-04-23 23:37:46 +08:00
54aef0f0e0
Update versions for hotfix
2024-04-23 23:34:15 +08:00
6be02f3a0f
Merge tag 'WebMagic-0.10.2' into develop
...
Tag hotfix
2024-04-23 21:47:57 +08:00
a81c4e7627
Update to hotfix version
2024-04-23 21:46:35 +08:00
0dc852e219
Merge branch 'hotfix/0.10.2'
2024-04-23 21:46:28 +08:00
0dbfaf7284
Remove useless log.
2024-04-23 21:34:59 +08:00
bda51537b6
Update versions for hotfix
2024-04-23 21:32:04 +08:00
2217b1c8f2
Merge tag 'WebMagic-0.10.1' into develop
...
Tag hotfix
2024-04-23 20:41:02 +08:00
884f51ba3b
Update to hotfix version
2024-04-23 20:38:03 +08:00
2994716ba5
Merge branch 'hotfix/0.10.1'
2024-04-23 20:37:56 +08:00
78740a4e28
Fix NPE.
2024-04-23 20:26:38 +08:00
5afe3e7b81
Revert "fix: pom.xml to reduce vulnerabilities ( #1134 )"
...
This reverts commit 19288e9c11
2024-04-23 20:21:45 +08:00
a0ff4a2d2e
Fix log message.
2024-04-23 20:09:15 +08:00
76ef0332f1
Update versions for hotfix
2024-04-23 20:06:47 +08:00
a5144350bd
Upgrade maven plugins to latest versions.
2024-04-22 00:45:54 +08:00
e34b495625
Upgrade maven-suirefire-plugin from 3.0.0-M7 to 3.2.5.
2024-04-22 00:17:58 +08:00
5344db0106
Upgrade jacoco-maven-plugin from 0.8.8 to 0.8.12.
2024-04-21 23:35:26 +08:00
9ab342c3a7
Remove public modifiers from junit5 test methods.
2024-04-21 23:31:21 +08:00
5196a56ccf
Format code.
2024-04-21 23:30:43 +08:00
dba1668306
Add tests to test the equals & hashCode of Proxy.
2024-04-21 23:23:32 +08:00
b7e0d360ec
Upgrade junit from 4.13.2 to 5.10.2.
2024-04-21 22:04:48 +08:00
d8321baf56
Refactored and implement of a template method pattern for logger config in webmagic-scripts ( #1158 )
...
* Refactor of processSingle in PageModelExtractor
* Changed my refactor of processSingle, this one is a lot better
* Changed my refactor of processSingle, this one is a lot better
* add lombok for getters and setters
* Refactored and implement of a template method pattern for logger config
2024-04-06 07:55:46 +08:00
2df7dca871
Changed refactor of processSingle again, this one is a better version ( #1157 )
...
* Refactor of processSingle in PageModelExtractor
* Changed my refactor of processSingle, this one is a lot better
* Changed my refactor of processSingle, this one is a lot better
2024-04-05 22:50:21 +08:00
05e5eefc7d
Refactor of processSingle in PageModelExtractor ( #1155 )
2024-04-05 21:51:08 +08:00
f10fabcb58
Update .gitignore, with merging Maven.gitignore & Global/Eclipse.gitignore in github/gitignore.
2024-04-03 20:21:02 +08:00
383bea32f6
Bump com.jayway.jsonpath:json-path from 2.8.0 to 2.9.0 ( #1154 )
...
Bumps [com.jayway.jsonpath:json-path](https://github.com/jayway/JsonPath ) from 2.8.0 to 2.9.0.
- [Release notes](https://github.com/jayway/JsonPath/releases )
- [Changelog](https://github.com/json-path/JsonPath/blob/master/changelog.md )
- [Commits](https://github.com/jayway/JsonPath/compare/json-path-2.8.0...json-path-2.9.0 )
---
updated-dependencies:
- dependency-name: com.jayway.jsonpath:json-path
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-03 19:44:15 +08:00
ed7429c293
Rename webmagic-parent to webmagic.
2024-04-03 19:37:56 +08:00
4ebf48f6e3
Replace log4j 1.x with log4j 2.x, refs #534 .
2024-04-03 18:26:01 +08:00
2c730eb978
Update Java version from 1.8 to 11, refs #1134 .
2024-04-03 01:14:36 +08:00
0ceaf14882
Bump version number from 0.10.1-SNAPSHOT to 1.0.0-SNAPSHOT for Java version updating from 1.8 to 11, refs #1134 .
2024-04-03 01:00:47 +08:00
31548deb93
Revert "Refactored code for increased optimization. ( #1139 )" ( #1153 )
...
This reverts commit f051d978e2
2024-03-30 14:37:55 +08:00
f051d978e2
Refactored code for increased optimization. ( #1139 )
...
* refactoring by decompose conditional technique
* refactoring by introduction explaining variable technique
* refactoring by rename method/variable technique
* refactoring by introducing explaining variable technique
* Added Extract class refactoring to increase maintainablilty
* Refactoring using replace conditional with polymorphism
2024-03-30 14:28:02 +08:00
9b9f173c1c
Refactored Code to increase maintainability ( #1152 )
...
* Initial Commit
* Assignment 1 Submission
* Resolving Implementation Smells
* Refactoring Code to increase maintainability
2024-03-30 14:26:41 +08:00
28ac8bf9c4
Refactored Code to Resolve Implementation Code Smells ( #1151 )
...
* Initial Commit
* Assignment 1 Submission
* Resolving Implementation Smells
2024-03-29 00:45:12 +08:00
80842d72db
Added test cases for improving line and branch coverage ( #1150 )
...
* Initial Commit
* Assignment 1 Submission
2024-03-23 13:22:30 +08:00
7f8607b881
update com.fasterxml.jackson.core:jackson-databind 2.15.2 to 2.16.0 ( #1149 )
2024-03-07 08:41:26 +08:00
22a60df6aa
Fix build for selenium upgrading from 3.141.59 to 4.14.1, refs #1134 .
2024-03-03 20:02:09 +08:00
e4ab6e27e4
Optimize Request#extras, refs #1148 .
2024-03-03 18:35:25 +08:00
Saisai
Joe Zhou
Niu_XZ
François Gibier
dependabot[bot]
Parthgajera056
ayushi250317
Ch3n4y