您的位置:首页 > 编程语言 > Python开发

python 统计词频

2018-01-18 20:02 671 查看
import sys
reload(sys)

sys.setdefaultencoding("utf-8")

#import jieba
#import jieba.analyse

#wf = open("clean_title.txt", "w+")
#for line in open('clean_data.csv'):

#    item = line.strip('\n\r').split('\t')
#    tags = jieba.analyse.extract_tags[item[0]]
#    tagsw = ",".join(tags)
#    wf.write(tagsw)

#wf.close()

word_lst = []
word_dict = {}
with open('clean_title.txt') as wf,open("word.txt",'w') as wf2:
for word in wf:
word_lst.append(word.split(','))
for item in word_lst:
for item2 in item:
if item2 not in word_dict:
word_dict[item2] = 1
else:
word_dict[item2] += 1

for key in word_dict:
print key,word_dict[key]
wf2.write(key+' '+str(word_dict[key])+'\n')
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签: