基于simhash的文本去重算法
☆20Jun 18, 2021Updated 4 years ago
Alternatives and similar repositories for DuplicateRemove
Users that are interested in DuplicateRemove are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 使用Simhash对海量文本进行去重☆12Jun 2, 2018Updated 7 years ago
- 基于Pytorch实现的中文文本分类脚手架，以及常用模型对比。☆18Apr 23, 2021Updated 4 years ago
- this repo is mnbvc text quality classification using fastText☆16Oct 2, 2023Updated 2 years ago
- A concise implementation of SimCSE☆16Aug 2, 2021Updated 4 years ago
- Part-of-speech tagging using BERT☆10Nov 14, 2019Updated 6 years ago
- GUI for pg_timetable☆15Feb 27, 2026Updated 3 weeks ago
- LAVIS - A One-stop Library for Language-Vision Intelligence☆10Apr 18, 2023Updated 2 years ago
- 离线版中文标注工具，支持NER、文本分类、关系标注、对话标注等。☆14Jul 29, 2022Updated 3 years ago
- 企业微信接收/回复消息sdk☆16Oct 30, 2020Updated 5 years ago
- Springboot + ElasticSearch 构建博客检索系统☆12Mar 5, 2020Updated 6 years ago
- Propaganda detection using fine-tuned BERT☆20Jul 21, 2022Updated 3 years ago
- Pitman-Yor processes in python☆26Apr 18, 2014Updated 11 years ago
- pytorch☆13Jul 29, 2019Updated 6 years ago
- 通用向量搜索服务☆32Mar 21, 2022Updated 4 years ago
- Official PyTorch implementation for "Where You Edit is What You Get: Text-Guided Image Editing with Region-Based Attention" (Pattern Reco…☆10Oct 1, 2024Updated last year
- 实现功能：新输入一段文本，与已有数据进行相似度进行比较，返回TOP10的文本。主要实现方法：jieba中文分词、gensim、TF-IDF词汇重要性、cosine余弦相似度。☆11Jul 30, 2020Updated 5 years ago
- ☆12May 3, 2024Updated last year
- 本项目包含几种常用 NLP算法的实现：关键词(keyword)、命名实体(named entity)、自动摘要(abstract)、文本相似度比较(text similarity)等☆16Jan 16, 2022Updated 4 years ago
- aigc evals☆10Dec 2, 2023Updated 2 years ago
- 海量中文文本快速查重☆18Dec 16, 2018Updated 7 years ago
- 一个基于elasticsearch开发的搜索引擎网站☆14Nov 22, 2022Updated 3 years ago
- 【Demo】对新闻标题使用TF-IDF向量化和cosine相似度计算完成相似标题推荐☆14Mar 2, 2020Updated 6 years ago
- WordBias: Visualizing Intersectional Social biases encoded in Word Embeddings☆23Aug 18, 2025Updated 7 months ago
- 计算机相关知识笔记☆10Updated this week
- init☆22May 31, 2019Updated 6 years ago
- ☆10Aug 21, 2021Updated 4 years ago
- Using Seq2Seq transformers for Text2SQL task on WikiSQL dataset.☆12Jan 8, 2022Updated 4 years ago
- How to install and use tesseract OCR on Centos7 - without root access☆14Jan 21, 2021Updated 5 years ago
- https://www.kaggle.com/c/nbme-score-clinical-patient-notes☆10Sep 1, 2022Updated 3 years ago
- 批量下载抖音用户视频☆20Jan 19, 2024Updated 2 years ago
- ☆21Jan 9, 2023Updated 3 years ago
- 长文本相似度模型☆21Nov 24, 2023Updated 2 years ago
- Change FeliCa PMm of HCE-F for Android NFC☆11Apr 30, 2023Updated 2 years ago
- 毕业设计：《基于CLIP模型的视频文本检 索设计与实现》☆18Jul 21, 2024Updated last year
- 微信hook☆11Jan 7, 2020Updated 6 years ago
- Deploy IRC server using Docker☆13Dec 15, 2023Updated 2 years ago
- 基于Scrapy-Redis框架与Mongodb的分布式爬虫-elasticsearch搜索引擎打造☆18Apr 21, 2020Updated 5 years ago
- golang tun nat☆11Jul 20, 2022Updated 3 years ago
- ☆23Mar 11, 2025Updated last year