Mobai
/
magic-Dependency
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Revise logging level from warn to info, as we have passed the exception to onError. refs #1094

master
Joe Zhou 2022-11-15 22:48:02 +08:00
parent 075b98291b
commit 4915431845
1 changed files with 5 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
webmagic-core/src/main/java/us/codecraft/webmagic/downloader/HttpClientDownloader.java
View File

@ -82,12 +82,16 @@ public class HttpClientDownloader extends AbstractDownloader {
try {
httpResponse = httpClient.execute(requestContext.getHttpUriRequest(), requestContext.getHttpClientContext());
page = handleResponse(request, request.getCharset() != null ? request.getCharset() : task.getSite().getCharset(), httpResponse, task);
onSuccess(request, task);
logger.info("downloading page success {}", request.getUrl());
return page;
} catch (IOException e) {
logger.warn("download page {} error", request.getUrl(), e);
onError(request, task, e);
logger.info("download page {} error", request.getUrl(), e);
return page;
} finally {
if (httpResponse != null) {