基于simhash的文本去重算法
☆20Jun 18, 2021Updated 4 years ago
Alternatives and similar repositories for DuplicateRemove
Users that are interested in DuplicateRemove are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 基于谷歌大规模网页去重simhash算法，对海量文章（长文本）进行去重。☆11Dec 8, 2022Updated 3 years ago
- 基于Pytorch实现的中文文本分类脚手架，以及常用模型对比。☆18Apr 23, 2021Updated 5 years ago
- this repo is mnbvc text quality classification using fastText☆16Oct 2, 2023Updated 2 years ago
- A concise implementation of SimCSE☆16Aug 2, 2021Updated 4 years ago
- GUI for pg_timetable☆15Apr 13, 2026Updated 2 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Collapsed Gibbs sampling for Latent Dirichlet Allocation☆18Jun 11, 2012Updated 13 years ago
- LAVIS - A One-stop Library for Language-Vision Intelligence☆10Apr 18, 2023Updated 3 years ago
- 离线版中文标注工具，支持NER、文本分类、关系标注、对话标注等。☆14Jul 29, 2022Updated 3 years ago
- 基于SG2300X的视频检索【使用自然语言搜索视频内容，定位到符合描述的具体时间段】☆13Feb 29, 2024Updated 2 years ago
- 企业微信接收/回复消息sdk☆16Oct 30, 2020Updated 5 years ago
- Propaganda detection using fine-tuned BERT☆20Jul 21, 2022Updated 3 years ago
- Pitman-Yor processes in python☆26Apr 18, 2014Updated 12 years ago
- a simple and powerful crontab written in golang with web page management. golang实现的简单便捷的计划任务管理系统, 自带 web 界面,方便的管理多个任务. 支持 秒,分,时,日,月,周☆12Mar 14, 2021Updated 5 years ago
- pytorch☆12Jul 29, 2019Updated 6 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- 实现功能：新输入一段文本，与已有数据进行相似度进行比较，返回TOP10的文本。主要实现方法：jieba中文分词、gensim、TF-IDF词汇重要性、cosine余弦相似度。☆11Jul 30, 2020Updated 5 years ago
- [NeurIPS 2025] Bag of Tricks for Inference-time Computation of LLM Reasoning☆17Sep 20, 2025Updated 7 months ago
- 本项目包含几种常用 NLP算法的实现：关键词(keyword)、命名实体(named entity)、自动摘要(abstract)、文本相似度比较(text similarity)等☆16Jan 16, 2022Updated 4 years ago
- Performing Latent Semantic Analysis with Python on large datasets.☆13Jun 21, 2022Updated 3 years ago
- 海量中文文本快速查重☆18Dec 16, 2018Updated 7 years ago
- 一个基于elasticsearch开发的搜索引擎网站☆14Nov 22, 2022Updated 3 years ago
- 【Demo】对新闻标题使用TF-IDF向量化和cosine相似度计算完成相似标题推荐☆14Mar 2, 2020Updated 6 years ago
- WordBias: Visualizing Intersectional Social biases encoded in Word Embeddings☆23Aug 18, 2025Updated 8 months ago
- 计算机相关知识笔记☆10Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13Apr 16, 2022Updated 4 years ago
- Production First and Production Ready End-to-End Keyword Spotting Toolkit☆12May 30, 2022Updated 3 years ago
- ☆10Aug 21, 2021Updated 4 years ago
- 使用adb和python等实现电脑端对微信的控制，实现加好友的功能☆14Oct 29, 2020Updated 5 years ago
- Archer2.0 evolves from its predecessor by introducing ASPO, which overcomes fundamental PPO-Clip limitations to prevent premature converg…☆31Oct 10, 2025Updated 6 months ago
- https://www.kaggle.com/c/nbme-score-clinical-patient-notes☆10Sep 1, 2022Updated 3 years ago
- ☆21Jan 9, 2023Updated 3 years ago
- ☆12Mar 14, 2023Updated 3 years ago
- 一个Android通用svc跟踪以及hook方案——Frida-Seccomp☆19May 14, 2024Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- 微信hook☆11Jan 7, 2020Updated 6 years ago
- Another attempt at a long-context / efficient transformer by me☆38Apr 11, 2022Updated 4 years ago
- 基于Scrapy-Redis框架与Mongodb的分布式爬虫-elasticsearch搜索引擎打造☆18Apr 21, 2020Updated 6 years ago
- ☆23Mar 11, 2025Updated last year
- ☆13Jun 19, 2021Updated 4 years ago
- alternative strace for iOS device(64bit)☆13May 22, 2020Updated 5 years ago
- golang tun nat☆11Jul 20, 2022Updated 3 years ago