Sutra Zhou
|
f45a8ff3e7
|
Merge branch 'master' of github.com:code4craft/webmagic
|
2022-10-24 00:15:30 +08:00 |
|
Sutra Zhou
|
6647af8d61
|
Merge pull request #762 from jialigit/master
: 是非法字符，无法作为文件名
|
2022-10-12 11:25:41 +08:00 |
vio.ao
|
5751681c91
|
Common the downloader status process and pass error information when onError
|
2022-10-01 17:34:02 +08:00 |
David Hsing
|
54da7af17e
|
change dependency versions into properties
change dependency versions into properties
update commons-collections from 3.x to 4.4
|
2022-05-03 17:42:42 +08:00 |
|
Sutra Zhou
|
dba0ddb92c
|
Remove unknown tag from javadoc.
|
2021-04-28 12:17:52 +08:00 |
linweisen
|
76f625c02e
|
提交可恢复爬取内容例子
|
2021-04-09 17:00:00 +08:00 |
singinginwind
|
b74264be69
|
: 是非法字符，无法作为文件名
: 是非法字符，无法作为文件名
|
2018-03-28 17:08:26 +08:00 |
yihua.huang
|
ba000b364c
|
remove site.addStartUrl in samples
|
2017-03-21 08:00:15 +08:00 |
|
yihua.huang
|
3824232171
|
remove site.addStartUrl in samples
|
2017-03-21 07:59:33 +08:00 |
|
yihua.huang
|
8564d51e56
|
remove site.addStartUrl in samples
|
2017-03-21 07:57:56 +08:00 |
|
yihua.huang
|
c13110c4cb
|
fix samples
|
2017-03-21 07:53:43 +08:00 |
|
yihua.huang
|
9b964c0a99
|
test for #484
|
2017-03-11 11:41:01 +08:00 |
|
yihua.huang
|
fc702fd3b6
|
introduce mockito for test
|
2017-03-11 11:31:15 +08:00 |
|
yihua.huang
|
00dfebbceb
|
#424 remove guava dep and add fix docs
|
2016-12-18 10:45:50 +08:00 |
|
Yihua Huang
|
37cb43b667
|
Merge pull request #176 from lavenderx/master
add PhantomJSDownloader
|
2016-05-08 20:36:17 +08:00 |
|
yihua.huang
|
0fd4623f0a
|
Merge branch 'osc'
|
2016-01-21 19:33:30 +08:00 |
|
yihua.huang
|
8b90b91e33
|
complete some javadoc
|
2016-01-21 18:14:10 +08:00 |
|
Yihua Huang
|
84b046e4c9
|
Merge pull request #227 from hsqlu/master
update deprecated method
|
2016-01-16 19:36:52 +08:00 |
chy996633
|
afd1617b58
|
知乎爬虫抓取
|
2015-11-13 11:56:46 +08:00 |
Qiannan Lu
|
155215290f
|
resolve issue #226
|
2015-09-18 09:30:01 +08:00 |
|
Qiannan Lu
|
21f81bb8c1
|
update deprecated method
|
2015-09-18 08:59:40 +08:00 |
dolphineor
|
0d9b148fc2
|
add PhantomJSDownloader
|
2014-11-23 23:07:22 +08:00 |
|
yihua.huang
|
eae37c868b
|
new sample
|
2014-06-10 17:38:54 +08:00 |
|
yihua.huang
|
95bdb30296
|
update xsoup version to release #113
|
2014-05-27 20:46:48 +08:00 |
|
yihua.huang
|
f9825c214a
|
refactor selectable for html fragment #113
|
2014-05-27 16:00:51 +08:00 |
|
yihua.huang
|
4f22f1210e
|
some bug fix #118
|
2014-05-02 20:38:49 +08:00 |
|
yihua.huang
|
64293cba20
|
samples
|
2014-05-02 19:12:38 +08:00 |
|
yihua.huang
|
bc1d14fed4
|
sample
|
2014-05-02 17:54:21 +08:00 |
|
yihua.huang
|
e8d4a9be2b
|
fix remove duplicate error #117
|
2014-04-29 20:32:06 +08:00 |
|
yihua.huang
|
94a67165e1
|
remove jmx server for simplify #98
|
2014-04-26 20:17:52 +08:00 |
|
yihua.huang
|
86a45a6643
|
change SpiderMonitor to singleton #98
|
2014-04-26 18:14:25 +08:00 |
|
yihua.huang
|
2770811a10
|
update monitor example
|
2014-04-26 11:24:22 +08:00 |
|
yihua.huang
|
3a666fcebf
|
add sample of 36kr #110
|
2014-04-25 18:36:07 +08:00 |
|
yihua.huang
|
ec446277b1
|
some refactor in httpclientdownloader
|
2014-04-15 15:30:37 +08:00 |
|
yihua.huang
|
3a79b1b64a
|
[Bugfix]formatter property does not work when field is String#100
|
2014-04-13 23:02:34 +08:00 |
|
yihua.huang
|
b14f0ee479
|
fix jsonpath in AngularJSProcessor
|
2014-04-13 12:54:44 +08:00 |
|
yihua.huang
|
84b897f83b
|
update AngularJSProcessor
|
2014-04-13 12:20:57 +08:00 |
|
yihua.huang
|
03c251237b
|
add Json parse support
|
2014-04-13 10:23:00 +08:00 |
|
yihua.huang
|
843e928c2c
|
comments on sinablogprocessor sample
|
2014-04-12 20:10:24 +08:00 |
|
yihua.huang
|
be37d8b216
|
sinablogprocessor sample
|
2014-04-12 20:03:44 +08:00 |
|
yihua.huang
|
2b023c95c2
|
qqmeishi demo
|
2014-04-11 11:43:04 +08:00 |
|
yihua.huang
|
db65dfafb8
|
add baidunews sample
|
2014-04-09 23:32:07 +08:00 |
|
yihua.huang
|
3669e73e4a
|
update News163: use Xsoup 0.2.0 syntax instead of ComboExtract
|
2014-04-09 16:43:55 +08:00 |
|
yihua.huang
|
9606a173cd
|
fix ZipCodePageProcessor
|
2014-03-13 22:55:50 +08:00 |
|
yihua.huang
|
4d628d80b4
|
add redis scheduler
|
2014-03-03 08:24:55 +08:00 |
|
yihua.huang
|
ca29cd3ef2
|
add jokejimodel for example
|
2014-03-03 08:22:14 +08:00 |
|
yihua.huang
|
e40b48e77b
|
Merge tag 'webmagic-0.4.0' of github.com:code4craft/webmagic
[maven-release-plugin] copy for tag webmagic-0.4.0
Conflicts:
pom.xml
webmagic-core/pom.xml
webmagic-extension/pom.xml
|
2013-11-06 22:48:26 +08:00 |
|
yihua.huang
|
6e32a19f80
|
update api for direct download
|
2013-11-06 12:46:50 +08:00 |
|
yihua.huang
|
86cfefb58c
|
update test
|
2013-11-04 07:19:32 +08:00 |
|
yihua.huang
|
c18b603399
|
optimize long compare
|
2013-11-04 07:09:44 +08:00 |