一个python爬图片的小爬虫
2015-03-09 00:16
435 查看
import reimport urllib2import urllibdef get_herf(): for i in xrange(1,2): url = "http://www.meizitu.com/a/list_1_%d.html" %i request = urllib2.Request(url) respond = urllib2.urlopen(request) content = respond.read() pattern = re.compile('
',re.S) #print content result = re.findall(pattern,content) #print result return result def get_img(): url_add = get_herf() print "total:", len(url_add),"catagory" for url in url_add: num_cat = int(url_add.index(url)+1) print "saving catagory:", num_cat request
= urllib2.Request(url) respond = urllib2.urlopen(request) content = respond.read().decode("gbk") pattern = re.compile('
',re.S) result = re.findall(pattern,content) for item in result: number = int(result.index(item))+1 save(str(item),num_cat,number) print "finished all saving, total", len(result), "pictures" print "finished all saving, total", len(result), "pictures" def save(imageURL,num_cat,number):
filename = str(num_cat)+"_"+str(number)+".jpg" urllib.urlretrieve(imageURL,filename) print "finished saving picture:", num_cat, number get_img()
',re.S) #print content result = re.findall(pattern,content) #print result return result def get_img(): url_add = get_herf() print "total:", len(url_add),"catagory" for url in url_add: num_cat = int(url_add.index(url)+1) print "saving catagory:", num_cat request
= urllib2.Request(url) respond = urllib2.urlopen(request) content = respond.read().decode("gbk") pattern = re.compile('
',re.S) result = re.findall(pattern,content) for item in result: number = int(result.index(item))+1 save(str(item),num_cat,number) print "finished all saving, total", len(result), "pictures" print "finished all saving, total", len(result), "pictures" def save(imageURL,num_cat,number):
filename = str(num_cat)+"_"+str(number)+".jpg" urllib.urlretrieve(imageURL,filename) print "finished saving picture:", num_cat, number get_img()
相关文章推荐
- python-一个小爬虫,爬取图片
- Python实现一个简单的图片爬虫
- python爬虫三:获取一个网易用户的所有图片(selenium+phantomjs)
- python学习总结----爬虫爬一个网站的图片
- python3,requests。写了一个简单的爬虫,爬取爱课程首页的图片
- Python Requests爬虫——获取一个收藏夹下所有答案的图片
- 一个简单的python爬虫爬取糗百图片
- 【原创】分享一个Python爬虫源码|爬虫批量爬取图片
- 一个简单的python爬虫,抓取单个页面的图片
- python 实现一个贴吧图片爬虫的示例
- 用python写一个美女图片爬虫
- 用python实现的一个抓取图片的爬虫
- Python爬虫爬取一个网页上的图片地址实例代码
- 一个简单的python爬虫程序
- [Python]网络爬虫(六):一个简单的百度贴吧的小爬虫
- 写个图片爬虫,scrapy,python第一次接触(停止更新)
- python 网页爬虫+保存图片+多线程+网络代理
- [Python]网络爬虫(十):一个爬虫的诞生全过程(以山东大学绩点运算为例)
- python学习--抓取一个网页上图片
- python简易爬虫来实现自动图片下载