用python导入mysql
2016-04-13 17:57
597 查看
#coding: utf-8 ''' @2016/04/13: To load raw-data.csv into db. Data is from Citeulike. ''' import re import mysql.connector def main(): # directory on iiot's server infile = open('./raw-data.csv','r') outfile = open('./error.txt','a+') #database on iiot's server cnx = mysql.connector.connect(user=' ',password=' ', host = ' ',port = , db=' ') cursor = cnx.cursor() insert_query = 'insert into article values (%s,%s,%s,%s,%s)' for read in infile: # 1 2 3 4 5 # doc.id,"title","citeulike.id","raw.title","raw.abstract" try: res = re.search('(\d*),"(.*)",(\d*),"(.*)","(.*)"',read) print res.group(1) data = (res.group(1),res.group(2),res.group(3),res.group(4),res.group(5)) cursor.execute(insert_query,data) cnx.commit() except Exception,e: outfile.write(str(e)+'\n'+read+'\n') if __name__=='__main__': main()
把.csv文件导入mysql,.csv文件以','分隔,在每一项字符串中含有',' 不能用load data local infile .. fields terminated by ',',否则字符串被截断。
用re
相关文章推荐
- 解决Python UnicodeDecodeError: ‘ascii’ codec can’t decode
- Python3.5入门学习记录-函数
- Python -- 字符串大小写转换
- python 基础学习(字典对象,set对象)
- 初学python(对比java语言不同) 第九篇
- python 基础学习(元组,if,for)
- hive+python数据分析入门
- [Python] Python基础字符串
- Python 3.5.1安装lxml
- python 小记2
- 各大机器学习包汇总(python版,持续更新)
- Python一日一练15----归并排序
- Python字典笔记
- python中的reduce函数
- Python 中用 Ctrl+C 终止多线程程序的问题解决
- Theano 学习笔记(一)
- Python-贴吧图片爬虫
- python安装
- python2.7安装+mysql-window-64位安装+python连接操作mysql教程
- python lambda表达式