您的位置:首页 > 编程语言 > Python开发

python urllib2 设置代理 自定义header

2011-10-18 15:58 435 查看
from urllib2 import urlopen

import urllib2

enable_proxy = True

proxy_handler = urllib2.ProxyHandler({"http" : 'http://192.168.0.101:3128'})

null_proxy_handler = urllib2.ProxyHandler({})

if enable_proxy:

opener = urllib2.build_opener(proxy_handler)

else:

opener = urllib2.build_opener(null_proxy_handler)

urllib2.install_opener(opener)

#设置代理end

header = {'Accept-Charset':'GBK,utf-8;q=0.7,*;q=0.3','User-Agent' : 'Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US) AppleWebKit/534.16 (KHTML, like Gecko) Chrome/10.0.648.151 Safari/534.16'}

#Debug Log star

httpHandler = urllib2.HTTPHandler(debuglevel=1)

httpsHandler = urllib2.HTTPSHandler(debuglevel=1)

opener = urllib2.build_opener(httpHandler, httpsHandler)

urllib2.install_opener(opener)

#Debug Log end

request = urllib2.Request(url,headers = header)

res = urlopen(request)

html = res.read()

res.close()
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签: