Commit Graph

91 Commits (73f60f809e30d56dec130811407814595a09a103)

Author SHA1 Message Date
Joe Zhou 8c008563ff Update for next development version 2023-09-10 17:06:55 +08:00
Joe Zhou 07e83a421b Update versions for release 2023-09-10 16:35:32 +08:00
Joe Zhou 6e8d130113 Update for next development version 2023-06-22 11:23:44 +08:00
Joe Zhou 3688226e32 Update versions for release 2023-06-22 11:16:41 +08:00
Joe Zhou cda8467f95 Update for next development version 2022-11-24 00:49:43 +08:00
Joe Zhou 888682863c Update versions for release 2022-11-24 00:30:07 +08:00
Sutra Zhou 5d5f3bf20e Update for next development version 2022-10-24 00:17:21 +08:00
Sutra Zhou 838c47f1f6 Update versions for release 2022-10-23 23:58:21 +08:00
Sutra Zhou d2b2eed9df Pass the task to onSuccess & onError. 2022-10-19 22:15:41 +08:00
vio.ao 7a62a6cb45 Revert "Revert "Common the downloader status process and pass error information when …""
This reverts commit acfbd7b883.
2022-10-01 17:33:11 +08:00
Sutra Zhou acfbd7b883
Revert "Common the downloader status process and pass error information when …" 2022-10-01 10:37:09 +08:00
vio.ao d01f26333b Common the downloader status process and pass error information when onError 2022-10-01 00:21:17 +08:00
Sutra Zhou c5a037a807 Update for next development version 2021-07-22 13:02:46 +08:00
Sutra Zhou 4e51a4f68b Update versions for release 2021-07-22 12:42:55 +08:00
Sutra Zhou c489647c4b Revert " Downloader 提供刷新组件的api,方便在spider中操作"
This reverts commit 2e2a0fdf3e.
2021-01-02 20:15:10 +08:00
yao 2e2a0fdf3e Downloader 提供刷新组件的api,方便在spider中操作 2020-12-21 18:08:55 +08:00
Sutra Zhou 4b902270b4 Bump version number from 0.7.3 to 0.7.4. 2020-10-27 09:01:21 +08:00
leeyazhou 9aab25f339 build: manage plugin version & remove build WARNING
## use the new dependency of commons-io

[WARNING] The artifact org.apache.commons:commons-io:jar:1.3.2 has been
relocated to commons-io:commons-io:jar:1.3.2

## manage plugin version of maven-jar-plugin and maven-deploy-plugin

[WARNING]
[WARNING] Some problems were encountered while building the effective
model for us.codecraft:webmagic-core:jar:0.7.3
[WARNING] 'build.plugins.plugin.version' for
org.apache.maven.plugins:maven-jar-plugin is missing. @
us.codecraft:webmagic-parent:0.7.3, /opt/code/git/webmagic/pom.xml, line
263, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective
model for us.codecraft:webmagic-extension:jar:0.7.3
[WARNING] 'build.plugins.plugin.version' for
org.apache.maven.plugins:maven-jar-plugin is missing. @
us.codecraft:webmagic-parent:0.7.3, /opt/code/git/webmagic/pom.xml, line
263, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective
model for us.codecraft:webmagic-scripts:jar:0.7.3
[WARNING] 'build.plugins.plugin.version' for
org.apache.maven.plugins:maven-jar-plugin is missing. @ line 61, column
21
[WARNING]
[WARNING] Some problems were encountered while building the effective
model for us.codecraft:webmagic-selenium:jar:0.7.3
[WARNING] 'build.plugins.plugin.version' for
org.apache.maven.plugins:maven-jar-plugin is missing. @
us.codecraft:webmagic-parent:0.7.3, /opt/code/git/webmagic/pom.xml, line
263, column 21
[WARNING] 'build.plugins.plugin.version' for
org.apache.maven.plugins:maven-deploy-plugin is missing. @ line 34,
column 12
[WARNING]
[WARNING] Some problems were encountered while building the effective
model for us.codecraft:webmagic-saxon:jar:0.7.3
[WARNING] 'build.plugins.plugin.version' for
org.apache.maven.plugins:maven-jar-plugin is missing. @
us.codecraft:webmagic-parent:0.7.3, /opt/code/git/webmagic/pom.xml, line
263, column 21
[WARNING] 'build.plugins.plugin.version' for
org.apache.maven.plugins:maven-deploy-plugin is missing. @ line 34,
column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective
model for us.codecraft:webmagic-samples:jar:0.7.3
[WARNING] 'build.plugins.plugin.version' for
org.apache.maven.plugins:maven-jar-plugin is missing. @
us.codecraft:webmagic-parent:0.7.3, /opt/code/git/webmagic/pom.xml, line
263, column 21
[WARNING]
[WARNING] Some problems were encountered while building the effective
model for us.codecraft:webmagic-parent:pom:0.7.3
[WARNING] 'build.plugins.plugin.version' for
org.apache.maven.plugins:maven-jar-plugin is missing. @ line 263, column
21
[WARNING]
[WARNING] It is highly recommended to fix these problems because they
threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support
building such malformed projects.
2020-08-07 16:36:32 +08:00
Sutra Zhou 71aa04c89f Upgrade dependencies. 2020-05-30 02:10:01 +08:00
Sutra Zhou c966a2015c
Merge pull request #882 from code4craft/snyk-fix-cec34e294bd875db1e52fde5b4b853f1
[Snyk] Fix for 1 vulnerable dependencies
2020-05-29 14:45:08 +08:00
Sutra Zhou ba1b4017a7 Mark slf4j-log4j12 as optional. 2020-05-21 19:59:29 +08:00
snyk-test f1b3a29d6f fix: webmagic-selenium/pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGAPACHEHTTPCOMPONENTS-31517
2019-06-28 01:31:36 +00:00
yihua.huang e276b11ea9 vesion 0.7.3 2017-07-30 15:29:22 +08:00
yihua.huang 1b6394bef9 version 0.7.2 2017-06-17 16:10:10 +08:00
yihua.huang 13cdf82695 update version to 0.7.2-SNAPSHOT 2017-06-05 16:55:59 +08:00
yihua.huang 1e9187f24e version 0.7.1 2017-06-04 07:52:54 +08:00
yihua.huang 2e35e149be for 0.7.1 2017-05-29 14:41:49 +08:00
yihua.huang 17478fcfc4 0.7.0 release 2017-05-29 09:30:56 +08:00
yihua.huang a8c2e6c729 alpha release 2017-05-20 12:51:16 +08:00
yihua.huang 3c1338193b for 0.7.0.alpha 2017-05-20 12:34:09 +08:00
GZhY ce3f0ac239 删除 fixAllRelativeHrefs 并修复 SeleniumDownloader 对 fixAllRelativeHrefs 的依赖 2017-04-09 21:01:32 +08:00
yihua.huang b100dfe273 update version 2017-03-30 09:18:12 +08:00
yihua.huang 11904a4d41 fix huaban demo #475 2017-03-04 11:43:28 +08:00
yihua.huang 895fca9fd7 修复seleniumDownloader配置文件写死的问题 #475 2017-03-04 11:34:06 +08:00
yihua.huang aaccc93215 new version 2017-01-21 12:04:12 +08:00
yihua.huang 3e633c6871 version 2017-01-21 11:51:14 +08:00
yihua.huang f45e2f118b for release 2017-01-21 11:38:36 +08:00
yihua.huang d69204b919 0.6.0 2016-12-18 11:45:43 +08:00
yihua.huang 97592d6720 Version 0.6.0 2016-12-18 10:58:24 +08:00
Linker Lin 047cb8ff8f updated versions to 0.5.4-SNAPSHOT 2016-04-01 14:51:59 +08:00
yihua.huang c0b8e8f8ae remove .classpath .project 2016-01-22 14:58:22 +08:00
yihua.huang a8e6de4b90 Merge branch 'master' of git.oschina.net:flashsword20/webmagic 2016-01-22 10:16:58 +08:00
yihua.huang ce5495ecd5 remove useless files 2016-01-21 19:31:50 +08:00
yihua.huang 8265c7dade remove submodules for relase 2016-01-21 19:25:13 +08:00
yihua.huang 2b556cf053 update verison to 0.5.3-SNAPSHOT 2016-01-21 18:05:56 +08:00
yihua.huang 9c5716a543 complete javadoc 2016-01-21 18:05:12 +08:00
yihua.huang db3cbf6ca5 update version to 0.5.3-SNAPSHOT 2016-01-21 17:58:36 +08:00
bingoko 5d365f7bf4 update and validate pom.xml
Update selenium and GhostDriver (PhantomJSDriver) to latest version.
2015-07-11 15:43:49 +01:00
bingoko d3bbece202 Add PhantomJS support for selenium
The configuration file is config.ini
The dependencies are updated in pom.xml.
Update SeleniumDownloader and WebDriverPool to support PhantomJS. 
NOTE: The versions of GhostDriver, Selenium, and PhantomJS are stable
and validated.

A GooglePlay Example is under samples package: GooglePlayProcessor.java
2015-07-11 15:34:21 +01:00
yihua.huang 8c33be48a6 Merge branch 'stable' of github.com:code4craft/webmagic 2014-06-04 17:37:45 +08:00