15810856129 / SimhashLinks
使用Simhash对海量文本进行去重
☆12Updated 7 years ago
Alternatives and similar repositories for Simhash
Users that are interested in Simhash are comparing it to the libraries listed below
Sorting:
- 发现新词 无监督词库生成 医学词库生成 发现未登录词☆78Updated 4 years ago
- NLP 以及相关的学习实践☆40Updated 3 years ago
- CCKS2019面向金融领域的事件主体抽取☆47Updated 6 years ago
- textcnn多标签文本分类☆37Updated 6 years ago
- 专业领域词库构建/中文新词发现/专业词库发现☆29Updated 5 years ago
- 企业事件抽取☆14Updated 4 years ago
- self complemented SpellCorrection based pinyin similairity, edit distance ，基于拼音相似度与编辑距离的查询纠错。☆82Updated 3 years ago
- 之江-电商评论观点挖掘的比赛，基于pytorch-transformers版本，暂时只实现了BERT做aspect+opinion+属性分类+情感极性的联合标注，还未加上CRF。☆32Updated 5 years ago
- self implement of NLP toolkit 个人实现NLP汉语自然语言处理组件，提供基于HMM与CRF的分词，词性标注，命名实体识别接口，提供基于CRF的依存句法接口。☆55Updated 7 years ago
- Self complemented text feature extraction using algorithms including CHI, DF, IG, MI for the experiment of text classification based on s…☆49Updated 7 years ago
- Self complemented Key infomation extraction including keywords, abstract from text using algorithm like textrank ,tfidf 基于Textrank算法的文本摘要…☆54Updated 7 years ago
- 文本相似性☆23Updated 5 years ago
- ZhidaoChatbot, a chatbot that can be an expert on the common questions like why,how,when,who,what based on the online question-answer web…☆42Updated 6 years ago
- 用tf实现各种文本分类模型，并且封装restful接口，可以直接工程化☆32Updated 5 years ago
- 【梳理】FDDC2018金融算法挑战赛02－A股上市公司公告信息抽取☆93Updated 6 years ago
- “AIIA”杯-国家电网-电力专业领域词汇挖掘☆55Updated 3 years ago
- 瑞金医院MMC人工智能辅助构建知识图谱大赛TOP40解决方案☆19Updated 6 years ago
- 使用HMM模型实现的机构名实体识别☆47Updated 6 years ago
- 文本分类：传统机器学习模型和深度学习模型☆50Updated 6 years ago
- 练习题︱基于今日头条开源数据的文本挖掘☆83Updated 6 years ago
- 微调预训练语言模型(BERT、Roberta、XLBert等),用于计算两个文本之间的相似度（通过句子对分类任务转换）,适用于中文文本☆89Updated 4 years ago
- 中文命名实体识别（公司名称），Tensorflow 1.3 + Python3☆38Updated 7 years ago
- 2020语言与智能技术竞赛：关系抽取任务(https://aistudio.baidu.com/aistudio/competition/detail/31?lang=zh_CN)☆24Updated 5 years ago
- Syntax and Ruler-Based Doc sentiment analysis 基于依存句法规则的篇章级情感分析demo☆107Updated 5 years ago
- 新词发现算法(NewWordDetection)☆62Updated 7 years ago
- 使用BERT构建多标签标注模型☆41Updated 5 years ago
- This is a small NLP project "E-commerce Title Data Similarity Matching System". The usage methods are: tfidf+word bag model, cosine simil…☆25Updated 5 years ago
- 2018-“AIIA”杯-国家电网-电力专业领域词汇挖掘：5st/451☆25Updated 6 years ago
- 从门户网站爬取新闻的摘要-标题对使用seq2seq根据摘要生成标题☆45Updated 7 years ago
- 基于ltp的简单评论观点抽取模块☆116Updated 6 years ago