您的位置:首页 > 其它

爬虫-爬取代理ip网页里的ip

2017-05-31 09:18 239 查看
思想:先打开url,获取其html然后下载出网页中符合正则表达式的ip

import urllib.request
import re

def open_url(url):
req=urllib.request.Request(url)
req.add_header('User-Agent','Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.2454.101 Safari/537.36')
page=urllib.request.urlopen(req)
html=page.read().decode('utf-8')
return html

def get_ip(html):
p=r'(?:(?:[0,1]?\d?\d|2[0-4]\d|25[0-5])\.){3}(?:[0,1]?\d?\d|2[0-4]\d|25[0-5])'
#p=r'<img class="BDE_Image" pic_type="0" width="500" height="375" src="[^"]+\.jpg"'
iplist=re.findall(p,html)
for each in iplist:
print(each)

if __name__=='__main__':
url="http://www.proxy360.cn/default.aspx"
html=open_url(url)
get_ip(html)
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签: