基于simhash的文本去重算法
☆20Jun 18, 2021Updated 5 years ago
Alternatives and similar repositories for DuplicateRemove
Users that are interested in DuplicateRemove are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 基于谷歌大规模网页去重simhash算法，对海量文章（长文本）进行去重。☆11Dec 8, 2022Updated 3 years ago
- 基于Pytorch实现的中文文本分类脚手架，以及常用模型对比。☆18Apr 23, 2021Updated 5 years ago
- this repo is mnbvc text quality classification using fastText☆16Oct 2, 2023Updated 2 years ago
- A concise implementation of SimCSE☆16Aug 2, 2021Updated 5 years ago
- Part-of-speech tagging using BERT☆10Nov 14, 2019Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- GUI for pg_timetable☆16Apr 13, 2026Updated 4 months ago
- Collapsed Gibbs sampling for Latent Dirichlet Allocation☆18Jun 11, 2012Updated 14 years ago
- 离线版中文标注工具，支持NER、文本分类、关系标注、对话标注等。☆14Jul 29, 2022Updated 4 years ago
- LAVIS - A One-stop Library for Language-Vision Intelligence☆10Apr 18, 2023Updated 3 years ago
- Springboot + ElasticSearch 构建博客检索系统☆12Mar 5, 2020Updated 6 years ago
- Propaganda detection using fine-tuned BERT☆20Jul 21, 2022Updated 4 years ago
- 企业微信接收/回复消息sdk☆16Oct 30, 2020Updated 5 years ago
- a simple and powerful crontab written in golang with web page management. golang实现的简单便捷的计划任务管理系统, 自带 web 界面,方便的管理多个任务. 支持 秒,分,时,日,月,周☆12Mar 14, 2021Updated 5 years ago
- 通用向量搜索服务☆32Mar 21, 2022Updated 4 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- 实现功能：新输入一段文本，与已有数据进行相似度进行比较，返回TOP10的文本。主要实现方法：jieba中文分词、gensim、TF-IDF词汇重要性、cosine余弦相似度。☆11Jul 30, 2020Updated 6 years ago
- Performing Latent Semantic Analysis with Python on large datasets.☆13Jun 21, 2022Updated 4 years ago
- 海量中文文本快速查重☆18Dec 16, 2018Updated 7 years ago
- 一个基于elasticsearch开发的搜索引擎网站☆14Nov 22, 2022Updated 3 years ago
- 【Demo】对新闻标题使用TF-IDF向量化和cosine相似度计算完成相似标题推荐☆14Mar 2, 2020Updated 6 years ago
- WordBias: Visualizing Intersectional Social biases encoded in Word Embeddings☆23Aug 18, 2025Updated last year
- I am a zoo keeper of "computer science" :)☆10Jul 29, 2026Updated last month
- init☆21May 31, 2019Updated 7 years ago
- Pytorch--使用伪标签训练efficientNet模型☆11Dec 28, 2019Updated 6 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Production First and Production Ready End-to-End Keyword Spotting Toolkit☆12May 30, 2022Updated 4 years ago
- ☆10Aug 21, 2021Updated 5 years ago
- 批量下载抖音用户视频☆21Jan 19, 2024Updated 2 years ago
- 使用adb和python等实现电脑端对微信的控制，实现加好友的功能☆14Oct 29, 2020Updated 5 years ago
- https://www.kaggle.com/c/nbme-score-clinical-patient-notes☆10Sep 1, 2022Updated 4 years ago
- a project about Personalization recommendation(UserCF,itemCF,LFM,Personal Rank)☆18Sep 20, 2020Updated 5 years ago
- SuperMinHash: A New Minwise Hashing Algorithm for Jaccard Similarity Estimation, Simhash and SimhashIndex☆19Nov 18, 2022Updated 3 years ago
- 长文本相似度模型☆21Nov 24, 2023Updated 2 years ago
- Change FeliCa PMm of HCE-F for Android NFC☆11Apr 30, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [NeurIPS 2025] Bag of Tricks for Inference-time Computation of LLM Reasoning☆16Sep 20, 2025Updated 11 months ago
- ☆13Jun 19, 2021Updated 5 years ago
- Pitman-Yor processes in python☆26Apr 18, 2014Updated 12 years ago
- A GCN based visual question generation model☆13Aug 21, 2019Updated 7 years ago
- 全球人工智能技术创新大赛-赛道三：小布助手对话短文本语义匹配☆38Mar 29, 2021Updated 5 years ago
- golang tun nat☆11Jul 20, 2022Updated 4 years ago
- MUX-PLMs: Pretraining LMs with Data Multiplexing☆15Jan 29, 2023Updated 3 years ago