f9b157951d
Merge branch 'master' of github.com:code4craft/webmagic
2014-04-04 20:01:14 +08:00
22c394e629
[doc]
2014-04-04 20:00:58 +08:00
3efa774191
Merge pull request #84 from ccliangbo/logInScheduler
...
Modify the log levels of LocalDuplicatedRemovedScheduler.java
2014-04-04 17:16:34 +08:00
762a3973fd
Modify the log levels of LocalDuplicatedRemovedScheduler.java
...
The old version will print a debug level log each time the push method is
called. So sometimes, when a html page have multiple links for the same
page, the debug log will appears more than once. Also, when we meet a
duplicate URL, it will also print a log, which will be confusing.
I change the level of it to trace. And each time a URL is really push into
queue, print a debug level log.
2014-04-04 15:53:46 +08:00
44293cd894
[doc]add qq group in readme
2014-04-04 10:07:48 +08:00
9a0a4051ed
[doc] ch3 part1
2014-04-04 08:05:34 +08:00
7ca644cdd9
format readme
2014-04-04 06:47:28 +08:00
a1c7e826f7
fix dep of slf4j-log4j12
2014-04-03 23:04:31 +08:00
a34e92d11a
fix huabanprocessor
2014-04-03 22:33:10 +08:00
50cee4c7bb
[doc] complete docs2.0 ch1
2014-04-03 11:06:03 +08:00
9ec0ca02c6
doc2.0 ch1
2014-04-03 08:18:59 +08:00
7e0e5b0969
clean ui
2014-04-02 11:47:44 +08:00
94f97da4dc
[Avalon] fix spring config for static and ignore google fonts for better loading speed
2014-04-02 07:36:31 +08:00
22e8697671
add forger to folder
2014-04-01 23:16:03 +08:00
05abd566a4
remove submodule
2014-04-01 23:08:28 +08:00
01848301d4
encode illegal charactors in url #80
2014-04-01 22:14:30 +08:00
2780423e60
enable blank space in quotes in UrlUtils.fixAllRelativeHrefs #80
2014-04-01 20:35:11 +08:00
97b6f46280
Bugfix: break loop in addTargetRequests #81
2014-04-01 20:12:25 +08:00
d1563da33b
add contributor
2014-04-01 08:07:25 +08:00
b13f1da039
reformat
2014-04-01 08:04:43 +08:00
7038c00a9a
reformat
2014-04-01 08:03:47 +08:00
6252042ed2
add warning of slf4j #78
2014-04-01 08:02:22 +08:00
f3c2503a29
add warning of slf4j #78
2014-04-01 07:42:23 +08:00
4e15a68ff4
update xsoup version to 0.2.2
...
Bugfix: Parsing error when separate chars in quotes cause in xsoup #77
2014-03-30 09:43:35 +08:00
8d8194bee4
Change HashMap to LinkedHashMap in ResultItems for same order of input and output #76
2014-03-25 08:23:20 +08:00
c72483a220
update en_docs
2014-03-24 17:22:37 +08:00
e008b7b851
update zh_docs
2014-03-24 17:22:06 +08:00
8958d774f2
add default values for @Formatter
2014-03-24 13:52:17 +08:00
90447bff02
update xsoup to 0.2.1 #75
2014-03-22 20:23:16 +08:00
8b35d79569
Do not cache document in Selectable for selected Html element #73
2014-03-19 22:19:06 +08:00
6201fd6966
add worker as container
2014-03-17 23:01:58 +08:00
6577a75892
fix spring config path in web.xml of webmagic-worker
2014-03-17 11:08:12 +08:00
c7169328c7
refactor config resource
2014-03-16 19:19:11 +08:00
23d1151bc0
seperate spring config file
2014-03-16 18:18:17 +08:00
316980973c
invite h2 as test and standalone db, add spring profile for switch
2014-03-16 18:10:05 +08:00
9a4eab44be
add DynamicClassException to DynamicClassService.compileAndSave
2014-03-16 08:48:04 +08:00
09c43efc96
service and mock
2014-03-15 21:56:12 +08:00
7036950f28
update submodule url
2014-03-15 21:11:39 +08:00
f763764a21
add travis ci support for submodule
2014-03-15 21:09:44 +08:00
3eaa5c4d23
ignore dao test after test pass
2014-03-15 21:05:13 +08:00
6e882b78b5
add DynamicClassDao and UT
2014-03-15 20:19:39 +08:00
994c1d5341
avalon readme
2014-03-15 19:25:33 +08:00
8ea0a0624b
fix submodule url for travis-ci
2014-03-15 19:16:46 +08:00
8f84fb2ab5
fix submodule url for travis-ci
2014-03-15 19:14:56 +08:00
c2d27056ea
move worker and admin into avalon #70
2014-03-15 19:06:05 +08:00
79e6eedb31
add web.xml for ci pass in webamgic-worker #70
2014-03-14 23:52:56 +08:00
6c11718566
Clean project structure #70
2014-03-14 23:24:38 +08:00
9606a173cd
fix ZipCodePageProcessor
2014-03-13 22:55:50 +08:00
2801daf185
update version in readme
2014-03-13 16:45:22 +08:00
757cc9b942
[maven-release-plugin] prepare for next development iteration
2014-03-13 07:49:51 +08:00
yihua.huang
Bo LIANG