yihua.huang
|
76766a7c77
|
RequestUtils for range #222
|
2017-06-05 17:13:33 +08:00 |
|
yihua.huang
|
5de6205563
|
use RawText as source for JsonPath #589
|
2017-06-04 07:24:56 +08:00 |
|
yihua.huang
|
9b77306098
|
test of ExtractByUrl #586
|
2017-06-04 07:03:20 +08:00 |
|
yihua.huang
|
d8bd0637a1
|
add custom formatter test #586
|
2017-06-04 06:51:41 +08:00 |
|
yihua.huang
|
6cc647577a
|
fix test for ExtractLinks #586
|
2017-06-03 22:38:42 +08:00 |
|
yihua.huang
|
a6f8ed5476
|
complete formatter refactor by ObjectFormatterBuilder #586
|
2017-06-03 22:07:53 +08:00 |
|
yihua.huang
|
b1ef61b278
|
add tests before refactor #586
|
2017-06-03 21:33:18 +08:00 |
|
yihua.huang
|
df682857a7
|
fix test and some refactor
|
2017-06-03 20:19:41 +08:00 |
|
yihua.huang
|
0e6eb46eba
|
add test for jsonpath in pagemodel #462
|
2017-06-03 16:47:21 +08:00 |
|
yihua.huang
|
f5018d569e
|
remove test_issue409 #409
|
2017-06-03 15:10:25 +08:00 |
|
yihua.huang
|
17ae500c77
|
test_issue409 #409
|
2017-06-03 15:09:51 +08:00 |
|
yihua.huang
|
4cd5b4f93e
|
test_issue409
|
2017-06-03 15:02:33 +08:00 |
|
yihua.huang
|
fb0acd710c
|
complete SimpleHttpClientTest
|
2017-06-03 14:59:08 +08:00 |
|
yihua.huang
|
d07941d900
|
SimpleHttpClientTest
|
2017-06-03 14:58:34 +08:00 |
|
yihua.huang
|
f02f469c69
|
add test #570
|
2017-06-03 11:02:31 +08:00 |
|
yihua.huang
|
2d693580fc
|
add test
|
2017-06-01 22:28:03 +08:00 |
|
yihua.huang
|
2e35e149be
|
for 0.7.1
|
2017-05-29 14:41:49 +08:00 |
|
yihua.huang
|
1b04a7f2b3
|
#527 move logic check from downloaderto spider
|
2017-04-09 09:23:10 +08:00 |
|
yihua.huang
|
c13110c4cb
|
fix samples
|
2017-03-21 07:53:43 +08:00 |
|
yihua.huang
|
00dfebbceb
|
#424 remove guava dep and add fix docs
|
2016-12-18 10:45:50 +08:00 |
|
yihua.huang
|
a960a39c44
|
fix compile error for example change
|
2016-12-18 08:32:14 +08:00 |
Jerry
|
e56b8c3efc
|
fix the monitor bug which the spider will terminate when a seed url with port
|
2016-09-22 22:36:18 +08:00 |
Salon.sai
|
f89a6a6826
|
add: redis scheduler with priority
|
2016-07-05 16:29:01 +08:00 |
|
yihua.huang
|
7586e3d75c
|
add some test for github repo downloader
|
2016-01-19 08:05:53 +08:00 |
|
yihua.huang
|
3734865a6a
|
fix package name =.=
|
2014-08-21 14:39:44 +08:00 |
|
yihua.huang
|
e7668e01b8
|
fix SourceRegion error and add some tests on it #144
|
2014-08-21 14:29:06 +08:00 |
|
yihua.huang
|
4e5ba02020
|
fix test cont'
|
2014-08-18 11:08:17 +08:00 |
|
yihua.huang
|
94a67165e1
|
remove jmx server for simplify #98
|
2014-04-26 20:17:52 +08:00 |
|
yihua.huang
|
11ba5beb42
|
[refactor]move monitor to webmagic-extension #98
|
2014-04-25 13:17:13 +08:00 |
|
yihua.huang
|
1fbfc92de2
|
Inherit support of Field annotation in Model #103
|
2014-04-16 18:13:44 +08:00 |
|
yihua.huang
|
03c251237b
|
add Json parse support
|
2014-04-13 10:23:00 +08:00 |
|
yihua.huang
|
9b2cb43f47
|
ConfigurablePageProcessor #91
|
2014-04-05 23:40:10 +08:00 |
|
yihua.huang
|
dafd0b5875
|
[BugFix]multi model in one pageprocessor will be skipped #85
|
2014-04-04 20:36:31 +08:00 |
|
yihua.huang
|
8958d774f2
|
add default values for @Formatter
|
2014-03-24 13:52:17 +08:00 |
|
yihua.huang
|
fa33b15843
|
property loader
|
2014-02-11 23:07:31 +08:00 |
|
yihua.huang
|
cf62d707e0
|
#36 Spider does not exit when success
|
2013-11-27 23:33:18 +08:00 |
|
yihua.huang
|
6e32a19f80
|
update api for direct download
|
2013-11-06 12:46:50 +08:00 |
|
yihua.huang
|
6f18eec77e
|
fix a test error
|
2013-09-23 13:07:33 +08:00 |
|
yihua.huang
|
b131878123
|
add example
|
2013-09-23 13:01:28 +08:00 |
|
yihua.huang
|
250cc5e662
|
change formatter to class
|
2013-09-23 08:17:21 +08:00 |
|
yihua.huang
|
b18216245b
|
add type convert
|
2013-09-23 07:53:33 +08:00 |
|
yihua.huang
|
d7c7a78177
|
complete test cases
|
2013-09-08 22:19:02 +08:00 |
|
yihua.huang
|
c70ed57025
|
remove PriorityScheduler to core
|
2013-08-20 21:55:58 +08:00 |
|
yihua.huang
|
7003426898
|
update pom
|
2013-08-20 21:52:39 +08:00 |
|
yihua.huang
|
59aad6a7f4
|
comments in english
|
2013-08-17 18:33:05 +08:00 |
|
yihua.huang
|
e566a53936
|
update ignore test
|
2013-08-17 18:13:13 +08:00 |
|
yihua.huang
|
1148450ff9
|
update filecache to more useful
|
2013-08-17 18:12:47 +08:00 |
|
yihua.huang
|
a339e4ab5c
|
add jsonpathselector
|
2013-08-12 13:36:44 +08:00 |
|
yihua.huang
|
17d2d98cec
|
remove invalid @date
|
2013-08-09 20:43:06 +08:00 |
|
yihua.huang
|
521fbad987
|
move xpath2.0 support to seperate package
|
2013-08-07 23:21:28 +08:00 |