Commit Graph

588 Commits (c25b32f1ca6bf35be24d2a794c1481d127ccad37)

Author SHA1 Message Date
yihua.huang f094f31816 update contributors 2014-03-01 15:31:13 +08:00
yihua.huang 2768a1cae4 add test for cycleTriedTimes and fix cycleTriedTimes inc error #60 2014-03-01 15:10:38 +08:00
yihua.huang bbd0d7e600 update httpclient version to 4.3.3 #59 2014-02-28 21:17:02 +08:00
yihua.huang 571061454a #58 add CYCLE_TRIED_TIMES support to QueueScheduler and PriorityScheduler 2014-02-27 23:54:30 +08:00
yihua.huang a79ae6a9e4 add ui design for avalon 2014-02-27 23:29:25 +08:00
yihua.huang 0b436aca4f remove fiel 2014-02-24 22:48:55 +08:00
yihua.huang b93cc92fb5 pages for spiders 2014-02-24 22:47:51 +08:00
yihua.huang cd0b3a4df4 invite ui from charisma 2014-02-23 23:12:58 +08:00
Yihua Huang 19843c063b Merge pull request #57 from d0ngw/master
Fix chrome driver can't quit
2014-02-17 07:17:45 +08:00
d0ngw 4fc89485b6 Fix chrome driver can't quit 2014-02-16 22:04:12 +08:00
yihua.huang 0e98183f74 Change log4j to slf4j #55 2014-02-12 09:35:57 +08:00
yihua.huang fa33b15843 property loader 2014-02-11 23:07:31 +08:00
yihua.huang 362fdd0662 Merge branch 'master' of github.com:code4craft/webmagic 2014-02-11 22:23:56 +08:00
yihua.huang af809c4d55 update version to 0.5.0-snapshot 2014-02-11 22:16:01 +08:00
Yihua Huang 7e8a5c7dd2 Merge pull request #54 from bitdeli-chef/master
Add a Bitdeli Badge to README
2014-01-21 23:00:07 -08:00
Bitdeli Chef 6cade5ddf3 Add a Bitdeli badge to README 2014-01-22 07:03:10 +00:00
Yihua Huang 31ff4cc404 Merge pull request #53 from xuchaoo/master
修复由于FileCacheQueueScheduler中fileCursor 文件再次打开时没有初始化抛出NullPointerExceptio...
2014-01-08 17:49:44 -08:00
jon a722f9bb66 修复由于FileCacheQueueScheduler中fileCursor 文件再次打开时没有初始化抛出NullPointerException的错误 2014-01-08 21:24:58 +08:00
Yihua Huang 090827f124 Merge pull request #52 from d0ngw/master
The SeleniumDownloader should call the setRawText
2013-12-26 19:30:31 -08:00
d0ngw a5a9b141b3 The SeleniumDownloader should call the setRawText 2013-12-27 11:09:04 +08:00
yihua.huang 6933029ea5 update modules 2013-12-25 18:48:31 +08:00
Yihua Huang 5d9fda0614 Merge pull request #51 from code4craft/test
Update RegexSelector.java
2013-12-20 16:43:49 -08:00
Almark Ming 2b46b11e55 Update RegexSelector.java
Optimize regex format check

Conflicts:
	webmagic-core/src/main/java/us/codecraft/webmagic/selector/RegexSelector.java
2013-12-21 08:38:17 +08:00
yihua.huang d9a15ad66a 404 page 2013-12-21 07:56:58 +08:00
yihua.huang 12a6390cbd update spring4 configuration 2013-12-18 01:02:59 +08:00
yihua.huang 7fd27d9b22 add spring 4 mvc for worker 2013-12-17 23:57:23 +08:00
yihua.huang 31fb0048a1 add worker 2013-12-07 00:37:07 +08:00
yihua.huang b51fb2696b update ut for cookie 2013-12-06 00:30:01 +08:00
yihua.huang ff2f588c41 #48 nullpointer exception 2013-12-04 22:11:20 +08:00
yihua.huang ac516f9b0e update version in docs 2013-12-03 23:46:31 +08:00
yihua.huang cc241bc0f2 update versions 2013-12-03 23:40:47 +08:00
yihua.huang d274310cb2 [maven-release-plugin] prepare for next development iteration 2013-12-03 23:35:06 +08:00
yihua.huang e8c32a32dc [maven-release-plugin] prepare release webmagic-0.4.2 2013-12-03 23:34:57 +08:00
yihua.huang 93cb4308ef update pom 2013-12-03 23:29:57 +08:00
yihua.huang 6a828e923c #46 Downloader thread hang up when timeout 2013-12-03 09:59:54 +08:00
yihua.huang 486d9d276f #45 Remove multi in ExtractBy 2013-11-28 18:23:51 +08:00
yihua.huang aaa53f58c7 Merge branch 'master' of github.com:code4craft/webmagic 2013-11-28 16:27:49 +08:00
yihua.huang 07bcb06a3f update version in readme 2013-11-28 16:27:36 +08:00
Yihua Huang 4f53b07e47 Merge pull request #44 from supermicah/master
double-check 中再取次httpClient的内容
2013-11-27 23:28:20 -08:00
shijinping 9a524aa364 double-check 中再取次httpClient的内容 2013-11-28 14:38:30 +08:00
yihua.huang cb84220d7a update version 2013-11-28 13:37:10 +08:00
yihua.huang e7083dc39d [maven-release-plugin] prepare for next development iteration 2013-11-28 13:04:32 +08:00
yihua.huang ae623567b3 [maven-release-plugin] prepare release webmagic-0.4.1 2013-11-28 13:04:22 +08:00
yihua.huang 7c43b5146e scripts readme 2013-11-28 12:04:05 +08:00
yihua.huang 633e0fe834 document for avalon 2013-11-28 11:39:19 +08:00
yihua.huang 18a3af4a0a add more sample for jsonpath #42 2013-11-28 09:58:22 +08:00
yihua.huang 59ad4cad27 #42 Add jsonpath in annotation mode for json result 2013-11-28 08:25:16 +08:00
yihua.huang c2d6d495b3 #41 add getThreadAlive(),getStatus,getPageCount() to spider 2013-11-28 07:59:24 +08:00
yihua.huang cf62d707e0 #36 Spider does not exit when success 2013-11-27 23:33:18 +08:00
yihua.huang a01312930a #39 Parsing html after page.getHtml() 2013-11-27 22:01:34 +08:00