【scrapy】Item Pipeline
2014-07-12 18:14
330 查看
After an item has been scraped by a spider,it is sent to the Item Pipeline which process it through several components that are executed sequentially.
Each item pipeline component is a single python class that must implement the following method:
process_item(item,spider)
This method is called for every item pipeline component and must either return a Item object or raise a DropItem exception.Dropped items are no longer processed by further pipeline component.
参数：item(Item object) ——the item scraped
spider(Spider object)——the spider which scraped the item
Each item pipeline component is a single python class that must implement the following method:
process_item(item,spider)
This method is called for every item pipeline component and must either return a Item object or raise a DropItem exception.Dropped items are no longer processed by further pipeline component.
参数：item(Item object) ——the item scraped
spider(Spider object)——the spider which scraped the item
内容来自用户分享和网络整理，不保证内容的准确性，如有侵权内容，可联系管理员处理 
相关文章推荐
- scrapy爬虫之Item Pipeline
- Python爬虫从入门到放弃（十六）之 Scrapy框架中Item Pipeline用法
- Python：Scrapy框架中Item Pipeline组件使用详解
- Python：Scrapy框架中Item Pipeline组件（项目管道组件）的使用教程
- Scrapy笔记（6）- Item Pipeline
- Scrapy框架学习（二）----Item Pipeline(管道)和Scrapy Shell
- scrapy爬虫之item pipeline保存数据
- Python爬虫从入门到放弃（十六）之 Scrapy框架中Item Pipeline用法
- 探讨scrapy当中的pipeline何时获取item。
- 爬虫框架Scrapy之Item Pipeline
- Scrapy源码分析-Item Pipeline中文文档（四）
- Scrapy-Item Pipeline（项目管道）
- Scrapy学习篇（七）之Item Pipeline
- 用python scrapy 写东西用的小思路 Item Pipeline
- Scrapy 扩展中间件: 同步/异步提交批量 item 到 MySQL
- Scrapy 入门笔记(4) --- 使用 Pipeline 保存数据
- scrapy 将item存到mysql中（pymysql）
- scrapy 让指定的spider执行指定的pipeline
- Scrapy Pipeline之使用REST API
- Scrapy爬虫入门教程九 Item Pipeline（项目管道）