为 httpclient 设置代理, 设置http头.
2015-01-21 11:05
513 查看
在学校园网,要代理才可上网。写程序获取网上资源时,怎么办呢?同样可以为程序设置代理。我用HttpClient的3.1版本。有些网站要浏览器才可以访问,但程序可以仿浏览器,主要是设置http头。
在HostConfiguration.setProxy里设置。如下面代码:
package com.chenlb;
import java.io.IOException;
import java.util.ArrayList;
import java.util.List;
import org.apache.commons.httpclient.DefaultHttpMethodRetryHandler;
import org.apache.commons.httpclient.Header;
import org.apache.commons.httpclient.HttpClient;
import org.apache.commons.httpclient.HttpException;
import org.apache.commons.httpclient.HttpStatus;
import org.apache.commons.httpclient.UsernamePasswordCredentials;
import org.apache.commons.httpclient.auth.AuthScope;
import org.apache.commons.httpclient.methods.GetMethod;
import org.apache.commons.httpclient.params.HttpMethodParams;
public class HttpClientUse {
public static void main(String[] args) throws HttpException, IOException {
HttpClient httpClient = new HttpClient();
httpClient.getHostConfiguration().setProxy("localhost", 808);
/*//需要验证
UsernamePasswordCredentials creds = new UsernamePasswordCredentials("chenlb", "123456");
httpClient.getState().setProxyCredentials(AuthScope.ANY, creds);
*/
//设置http头
List<Header> headers = new ArrayList<Header>();
headers.add(new Header("User-Agent", "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)"));
httpClient.getHostConfiguration().getParams().setParameter("http.default-headers", headers);
GetMethod method = new GetMethod("http://www.baidu.com");
method.getParams().setParameter(HttpMethodParams.RETRY_HANDLER,
new DefaultHttpMethodRetryHandler(3, false));
try {
int statusCode = httpClient.executeMethod(method);
if (statusCode != HttpStatus.SC_OK) {
System.out.println("Method failed code="+statusCode+": " + method.getStatusLine());
} else {
System.out.println(new String(method.getResponseBody(), "gb2312"));
}
} finally {
method.releaseConnection();
}
}
}
如果要用户名与密码验证的,请把/* */注释去掉。使验证有效。
验证,关键是:
UsernamePasswordCredentials creds = new UsernamePasswordCredentials("chenlb", "123456");
httpClient.getState().setProxyCredentials(AuthScope.ANY, creds);
设置http请求头.
List<Header> headers = new ArrayList<Header>();
headers.add(new Header("User-Agent", "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)"));
httpClient.getHostConfiguration().getParams().setParameter("http.default-headers", headers);
在HostConfiguration.setProxy里设置。如下面代码:
package com.chenlb;
import java.io.IOException;
import java.util.ArrayList;
import java.util.List;
import org.apache.commons.httpclient.DefaultHttpMethodRetryHandler;
import org.apache.commons.httpclient.Header;
import org.apache.commons.httpclient.HttpClient;
import org.apache.commons.httpclient.HttpException;
import org.apache.commons.httpclient.HttpStatus;
import org.apache.commons.httpclient.UsernamePasswordCredentials;
import org.apache.commons.httpclient.auth.AuthScope;
import org.apache.commons.httpclient.methods.GetMethod;
import org.apache.commons.httpclient.params.HttpMethodParams;
public class HttpClientUse {
public static void main(String[] args) throws HttpException, IOException {
HttpClient httpClient = new HttpClient();
httpClient.getHostConfiguration().setProxy("localhost", 808);
/*//需要验证
UsernamePasswordCredentials creds = new UsernamePasswordCredentials("chenlb", "123456");
httpClient.getState().setProxyCredentials(AuthScope.ANY, creds);
*/
//设置http头
List<Header> headers = new ArrayList<Header>();
headers.add(new Header("User-Agent", "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)"));
httpClient.getHostConfiguration().getParams().setParameter("http.default-headers", headers);
GetMethod method = new GetMethod("http://www.baidu.com");
method.getParams().setParameter(HttpMethodParams.RETRY_HANDLER,
new DefaultHttpMethodRetryHandler(3, false));
try {
int statusCode = httpClient.executeMethod(method);
if (statusCode != HttpStatus.SC_OK) {
System.out.println("Method failed code="+statusCode+": " + method.getStatusLine());
} else {
System.out.println(new String(method.getResponseBody(), "gb2312"));
}
} finally {
method.releaseConnection();
}
}
}
如果要用户名与密码验证的,请把/* */注释去掉。使验证有效。
验证,关键是:
UsernamePasswordCredentials creds = new UsernamePasswordCredentials("chenlb", "123456");
httpClient.getState().setProxyCredentials(AuthScope.ANY, creds);
设置http请求头.
List<Header> headers = new ArrayList<Header>();
headers.add(new Header("User-Agent", "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)"));
httpClient.getHostConfiguration().getParams().setParameter("http.default-headers", headers);
相关文章推荐
- HttpClient HttpURLConnection设置代理IP和端口
- java HttpClient设置代理
- crawler_java应用集锦9:httpclient4.2.2的几个常用方法,登录之后访问页面问题,下载文件_设置代理
- 为 httpclient 设置代理, 设置http头.
- GitHub Windows Client 设置HTTP 代理
- HttpClient代理IP及设置连接读取超时
- 轻松把玩HttpClient之设置代理,可以访问FaceBook
- httpClient 设置代理请求接口
- HttpClient设置代理,超时,以及得到cookies
- httpclient4.X 设置代理请求(包含账号密码)
- httpclient4.X 设置代理请求(包含账号密码)
- android HttpClient 代理设置 连接到互联网
- HttpClient(四)-- 使用代理IP 和 超时设置
- 轻松把玩HttpClient之设置代理,可以访问FaceBook
- 轻松把玩HttpClient之设置代理,可以访问FaceBook
- client是httpclient的实例,设置代理的代码
- httpClient4 设置代理
- HttpClient设置超时和代理
- HttpClient 设置代理 及Fiddler查看请求
- Android通过HttpURLConnection与HttpClient联网代理网关设置