您的位置:首页 > 编程语言 > Python开发

python爬虫selenium+firefox抓取京东商品评论

2018-01-18 18:28 1076 查看
from selenium import webdriver
from selenium.webdriver.firefox.firefox_binary import FirefoxBinary

caps=webdriver.DesiredCapabilities().FIREFOX
caps['marionette']=True
binary=FirefoxBinary(r'D:\Program Files\Firefox\firefox.exe')
driver=webdriver.Firefox(firefox_binary=binary,capabilities=caps)
driver.get('https://item.jd.com/5725260.html?jd_pop=12a9a276-18c3\
-4502-b324-738b240534c4&abt=0#comment')
'''
#单页评论
com=driver.find_elements_by_css_selector('p.comment-con')
for each_com in com:
coms=each_com.text
print(coms)
'''

#多页评论
import time
for x in range(0,2):
com=driver.find_elements_by_css_selector('p.comment-con')
for each_com in com:
coms=each_com.text
print(coms)
try:
next_page=driver.find_element_by_class_name('ui-pager-next')
next_page.click()
time.sleep(5)
except:
break

'''
com=driver.find_elements_by_css_selector('div.comment-item')
for each_com in com:
coms=each_com.text
print(coms)#所有信息
'''
'''
com=driver.find_elements_by_css_selector('div.comment-item')
for each_com in com:
coms=each_com.find_elements_by_css_selector('div.order-info')[0]
print(coms.text)#所有信息中某类信息
'''
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签: