15810856129 / SimhashLinks
使用Simhash对海量文本进行去重
☆12Updated 7 years ago
Alternatives and similar repositories for Simhash
Users that are interested in Simhash are comparing it to the libraries listed below
Sorting:
- 发现新词 无监督词库生成 医学词库生成 发现未登录词☆79Updated 4 years ago
- 基于Elasticsearch的KBQA☆55Updated 6 years ago
- 2020语言与智能技术竞赛:关系抽取任务(https://aistudio.baidu.com/aistudio/competition/detail/31?lang=zh_CN)☆24Updated 5 years ago
- ZhidaoChatbot, a chatbot that can be an expert on the common questions like why,how,when,who,what based on the online question-answer web…☆42Updated 6 years ago
- 之江-电商评论观点挖掘的比赛,基于pytorch-transformers版本,暂时只实现了BERT做aspect+opinion+属性分类+情感极性的联合标注,还未加上CRF。☆32Updated 6 years ago
- self complemented SpellCorrection based pinyin similairity, edit distance ,基于拼音相似度与编辑距离的查询纠错。☆84Updated 3 years ago
- “AIIA”杯-国家电网-电力专业领域词汇挖掘☆59Updated 3 years ago
- Self complemented Key infomation extraction including keywords, abstract from text using algorithm like textrank ,tfidf 基于Textrank算法的文本摘要…☆54Updated 7 years ago
- Syntax and Ruler-Based Doc sentiment analysis 基于依存句法规则的篇章级情感分析demo☆107Updated 6 years ago
- 专业领域词库构建/中文新词发现/专业词库发现☆29Updated 5 years ago
- 【梳理】FDDC2018金融算法挑战赛02-A股上市公司公告信息抽取☆93Updated 6 years ago
- code collections for the book of qna☆121Updated 2 years ago
- 使用HMM模型实现的机构名实体识别☆47Updated 7 years ago
- 手动实现Elasticsearch的倒排索引以及BM25算法☆47Updated 6 years ago
- ATEC 金融大脑-金融智能NLP服务☆91Updated 7 years ago
- 用tf实现各种文本分类模型,并且封装restful接口,可以直接工程化☆33Updated 6 years ago
- Self complemented text feature extraction using algorithms including CHI, DF, IG, MI for the experiment of text classification based on s…☆49Updated 7 years ago
- 自然语言处理相关实验实现 some experiment of natural language processing, Like text classification, named entity recognition, pos-tags, segment, key …☆54Updated 6 years ago
- 新词发现 基于词频、凝聚系数和左右邻接信息熵☆123Updated 5 years ago
- 一个关于百度2019语言与智能技术竞赛信息抽取 (http://lic2019.ccf.org.cn/kg) 的简单Demo, 模型采用BERT+CNN ( https://github.com/Wangpeiyi9979/IE-Bert-CNN )。 Demo使用Fl…☆126Updated 6 years ago
- NLP相关的paper代码复现。主要包括ACL,AAAI,EMNLP等顶会论文。☆87Updated 3 years ago
- 企业事件抽取☆14Updated 4 years ago
- 使用BERT模型进行文本分类,相似句子判断,以及词性标注☆90Updated 6 years ago
- 练习题︱基于今日头条开源数据的文本挖掘☆84Updated 6 years ago
- 瑞金医院MMC人工智能辅助构建知识图谱大赛-baseline☆68Updated 6 years ago
- 微调预训练语言模型(BERT、Roberta、XLBert等),用于计算两个文本之间的相似度(通过句子对分类任务转换),适用于中文文本☆91Updated 5 years ago
- 天池-新冠疫情相似句对判定大赛 大白_Rank6☆21Updated 5 years ago
- CCL2018客服领域用户意图分类冠军1st方案☆150Updated 3 years ago
- 中文命名实体识别(公司名称),Tensorflow 1.3 + Python3☆38Updated 7 years ago
- multi-label,classifier,text classification,多标签文本分类,文本分类,BERT,ALBERT,multi-label-classification☆141Updated 3 years ago