15810856129 / Simhash
使用Simhash对海量文本进行去重
☆12Updated 6 years ago
Alternatives and similar repositories for Simhash:
Users that are interested in Simhash are comparing it to the libraries listed below
- 发现新词 无监督词库生成 医学词库生成 发现未登录词☆77Updated 4 years ago
- 2020语言与智能技术竞赛:关系抽取任务(https://aistudio.baidu.com/aistudio/competition/detail/31?lang=zh_CN)☆24Updated 4 years ago
- textcnn多标签文本分类☆36Updated 6 years ago
- Self complemented Key infomation extraction including keywords, abstract from text using algorithm like textrank ,tfidf 基于Textrank算法的文本摘要…☆54Updated 6 years ago
- 练习题︱基于今日头条开源数据的文本挖掘☆84Updated 6 years ago
- 实体识别和信息抽取☆18Updated 5 years ago
- 使用BERT构建多标签标注模型☆41Updated 5 years ago
- 自然语言处理相关实验实现 some experiment of natural language processing, Like text classification, named entity recognition, pos-tags, segment, key …☆53Updated 6 years ago
- NLP 以及相关的学习实践☆40Updated 2 years ago
- self summary after attending CCL2018 (全国计算语言学学术会议), CCL2018参会总结,包括会议论文下载脚本,会议前言技术报告下载,以及个人的一点总结.☆27Updated 6 years ago
- 专业领域词库构建/中文新词发现/专业词库发现☆29Updated 5 years ago
- CCKS2019面向金融领域的事件主体抽取☆47Updated 5 years ago
- 基于 SVM 的细粒度情感分析☆23Updated 6 years ago
- 企业事件抽取☆14Updated 3 years ago
- 瑞金医院MMC人工智能辅助构建知识图谱大赛TOP40解决方案☆19Updated 6 years ago
- 微调预训练语言模型(BERT、Roberta、XLBert等),用于计算两个文本之间的相似度(通过句子对分类任务转换),适用于中文文本☆89Updated 4 years ago
- 文本相似性☆23Updated 5 years ago
- 基于依存分析的实体关系抽取简单实现,即抽取事实三元组☆87Updated 5 years ago
- 达观算法比赛ner任务,从重新训练bert,到finetune预测。☆75Updated 2 years ago
- “AIIA”杯-国家电网-电力专业领域词汇挖掘☆55Updated 2 years ago
- 之江-电商评论观点挖掘的比赛,基于pytorch-transformers版本,暂时只实现了BERT做aspect+opinion+属性分类+情感极性的联合标注,还未加上CRF。☆33Updated 5 years ago
- ZhidaoChatbot, a chatbot that can be an expert on the common questions like why,how,when,who,what based on the online question-answer web…☆42Updated 6 years ago
- 蚂蚁金服:金融大脑-金融智能NLP大赛(26th/2632)☆14Updated 5 years ago
- 文本分类:传统机器学习模型和深度学习模型☆50Updated 6 years ago
- Code lab for NLP. Including doc2txt,tf-idf,cnn,text classify,hmm cws,crf ner.☆42Updated 6 years ago
- Self complemented text feature extraction using algorithms including CHI, DF, IG, MI for the experiment of text classification based on s…☆49Updated 6 years ago
- Bert中文文本分类☆41Updated 5 years ago
- ☆18Updated 2 years ago
- 基于ELMo, tensorflow的中文命名实体标注 Chinese Named Entity Recognition Based on ELMo☆21Updated 5 years ago
- self complemented SpellCorrection based pinyin similairity, edit distance ,基于拼音相似度与编辑距离的查询纠错。☆82Updated 2 years ago