jieba 分词
描述
尾号为7,8,9,0的同学做,聊斋相关的分词,出现次数最高的20个。
需要把是同一个人不同说法,要合并成一个。比如 孙猴子和孙悟空,要算成一个。
import jieba
txt=open("聊斋志异.txt","r",encoding="gb18030",errors='ignore')
words=jieba.lcut(txt.read())
counts={} #新建一个字典
for word in words:
if len (word)==1:
continue
else:
counts[word]=counts.get(word,0)+1
item=list(counts.items())
item.sort(key=lambda x:x[1],reverse=True)
for i in range(20):
print("{0:<10}{1:>5}".format(item[i][0],item[i][1]))
标签:jieba,word,item,counts,txt,分词 From: https://www.cnblogs.com/CCaii/p/17909968.html