yihua.huang
|
edfc319c45
|
update httpclient to 4.3.1
|
2013-11-04 00:06:30 +08:00 |
|
yihua.huang
|
160a149b05
|
todo bugfix
|
2013-11-03 23:10:09 +08:00 |
|
yihua.huang
|
583a0eba8c
|
#29 refactor some method name
|
2013-11-03 20:24:26 +08:00 |
|
yihua.huang
|
6fa82a418b
|
#29 seed urls with more information
|
2013-11-03 20:20:50 +08:00 |
|
yihua.huang
|
1446ada732
|
some refactor
|
2013-10-31 22:50:22 +08:00 |
|
yihua.huang
|
84976c81ec
|
remove useless code
|
2013-10-31 22:48:18 +08:00 |
|
yihua.huang
|
b4fcf41168
|
add exit when comlete option
|
2013-10-31 22:41:02 +08:00 |
|
yihua.huang
|
352887870c
|
remove shutdown call
|
2013-10-31 22:22:14 +08:00 |
|
yihua.huang
|
a3f9ad198f
|
refactor multi thread code in Spider
|
2013-10-31 21:52:43 +08:00 |
|
yihua.huang
|
dbfb6b5803
|
update user-manual
|
2013-10-25 21:15:12 +08:00 |
|
yihua.huang
|
43b79f284a
|
update user-manual
|
2013-10-25 21:14:24 +08:00 |
|
yihua.huang
|
2e496402dc
|
add more warning for 0.3.3
|
2013-10-24 13:16:48 +08:00 |
|
yihua.huang
|
7fb44d2eec
|
#30 reuse PoolingClientConnectionManager for HttpClientDownloader
|
2013-10-14 23:22:04 +08:00 |
|
yihua.huang
|
5a226387e0
|
#27 nullpointer fix
|
2013-10-11 11:32:44 +08:00 |
|
yihua.huang
|
16e12e3bc9
|
#27 customize http header for downloader
|
2013-10-11 08:37:21 +08:00 |
|
yihua.huang
|
1a2c84ea78
|
#27 add timeout config to site
|
2013-10-11 07:36:16 +08:00 |
|
yihua.huang
|
3b00190f99
|
api without implementation for #28: add specific url crawl
|
2013-10-10 00:40:44 +08:00 |
|
yihua.huang
|
719100d6e6
|
update xsoup usage doc
|
2013-09-28 08:02:29 +08:00 |
|
yihua.huang
|
e7657cca30
|
update some code for annotation
|
2013-09-28 08:00:00 +08:00 |
|
yihua.huang
|
122cebfa5f
|
update manual for objectformatter
|
2013-09-28 07:54:42 +08:00 |
|
yihua.huang
|
9e6d55dbee
|
update manual for objectformatter
|
2013-09-28 07:52:32 +08:00 |
|
yihua.huang
|
ba05227594
|
update versions in other project
|
2013-09-28 07:43:37 +08:00 |
|
yihua.huang
|
21dddb008f
|
update user-manual
|
2013-09-28 07:38:03 +08:00 |
|
yihua.huang
|
774e55ea1e
|
manual
|
2013-09-28 07:37:03 +08:00 |
|
yihua.huang
|
613607b7dc
|
add manual link
|
2013-09-28 07:23:12 +08:00 |
|
yihua.huang
|
6c31582e1e
|
manual
|
2013-09-28 07:22:03 +08:00 |
|
yihua.huang
|
b29707ff59
|
update version indocs
|
2013-09-24 20:33:07 +08:00 |
|
yihua.huang
|
4acbc19cee
|
[maven-release-plugin] prepare for next development iteration
|
2013-09-23 13:12:32 +08:00 |
|
yihua.huang
|
cc3b787991
|
[maven-release-plugin] prepare release webmagic-0.3.2
|
2013-09-23 13:12:19 +08:00 |
|
yihua.huang
|
6f18eec77e
|
fix a test error
|
2013-09-23 13:07:33 +08:00 |
|
yihua.huang
|
b131878123
|
add example
|
2013-09-23 13:01:28 +08:00 |
|
yihua.huang
|
95ab4edec3
|
some bugfix
|
2013-09-23 08:38:54 +08:00 |
|
yihua.huang
|
250cc5e662
|
change formatter to class
|
2013-09-23 08:17:21 +08:00 |
|
yihua.huang
|
b18216245b
|
add type convert
|
2013-09-23 07:53:33 +08:00 |
|
yihua.huang
|
fba330872b
|
fix a thread pool exception
|
2013-09-22 23:57:15 +08:00 |
|
yihua.huang
|
3c79d031bd
|
fix thread pool
|
2013-09-22 22:52:52 +08:00 |
|
yihua.huang
|
81f7534757
|
update version
|
2013-09-12 21:28:42 +08:00 |
|
yihua.huang
|
a0d64b7635
|
update version
|
2013-09-12 21:06:05 +08:00 |
|
yihua.huang
|
d11f8dac20
|
update samples version
|
2013-09-08 22:58:29 +08:00 |
|
yihua.huang
|
fb693a4ac4
|
[maven-release-plugin] prepare for next development iteration
|
2013-09-08 22:25:07 +08:00 |
|
yihua.huang
|
bfaaa042b9
|
[maven-release-plugin] prepare release webmagic-parent-0.3.1
|
2013-09-08 22:24:48 +08:00 |
|
yihua.huang
|
d7c7a78177
|
complete test cases
|
2013-09-08 22:19:02 +08:00 |
|
yihua.huang
|
c17a31a21d
|
fix null pointe exception #26
|
2013-09-08 21:09:49 +08:00 |
|
yihua.huang
|
d2e0f0cd33
|
#25 use URL api in UrlUtils.canonicalizeUrl()
|
2013-09-06 21:35:23 +08:00 |
|
yihua.huang
|
363fd38ccb
|
Merge branch 'master' of github.com:code4craft/webmagic
|
2013-09-06 21:18:13 +08:00 |
|
yihua.huang
|
ef4cf49fee
|
add stop method to spider #24
|
2013-09-06 21:17:36 +08:00 |
|
Yihua Huang
|
bf8e4fe9dc
|
Merge pull request #23 from linkerlin/master
增强单元测试
|
2013-09-04 15:50:42 -07:00 |
Linker Lin
|
4d023b3666
|
增加剔除文件
|
2013-09-05 00:30:52 +08:00 |
|
Linker Lin
|
2e8cf0a3dd
|
将单元测试fork独立的JVM来跑。避免少数情况默认maven开的JVM堆太小。
|
2013-09-05 00:30:10 +08:00 |
|
yihua.huang
|
ac4cd39170
|
update version
|
2013-09-04 20:37:42 +08:00 |