您的位置:首页 > 编程语言 > Python开发

某徒步旅游网站python爬虫小练习

2017-07-18 22:19 471 查看

yxk周边游网站python爬虫小练习(跨页面)

代码很简单,关键一个是
encoding="utf_8_sig"
, 否则乱码,注意
writerow()
处理list

import warnings
warnings.filterwarnings("ignore")


import csv
from urllib.request import urlopen
from bs4 import BeautifulSoup

csvFile=open("C:\\Users\\dell-pc\\Documents\\Python Scripts\\Untitled Folder\\uxiake.csv","wt",newline="",encoding="utf_8_sig")
writer=csv.writer(csvFile)
try:
for i in range(9):
num=str(i+1)
html=urlopen("http://www.youxiake.com/around?place_id=2&days=0&month=0&holiday=0&price=0&tag=0&class_id=0>s=>e=&p="+num)
bs0bj=BeautifulSoup(html)
total=bs0bj.find("div",{"class":"m-bd-con current"}).findAll("div",{"class":"act-item clearfix"})
for i in total:
putin=[]
head=i.find("h3").find("a").get_text()
style=i.find("h3").find("span").get_text()
place=i.find("div",{"class":"z-subMsg"}).findAll("p")[0].get_text()
days=i.find("span",{"class":"days"}).get_text()
venue=i.find("span",{"class":"venue"}).get_text()
putin.append([head,style,place,days,venue])
for i in putin:
writer.writerow(i)
finally:
csvFile.close()
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签: