基于simhash的文本去重算法
☆20Jun 18, 2021Updated 5 years ago
Alternatives and similar repositories for DuplicateRemove
Users that are interested in DuplicateRemove are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- this repo is mnbvc text quality classification using fastText☆16Oct 2, 2023Updated 3 years ago
- A concise implementation of SimCSE☆16Aug 2, 2021Updated 5 years ago
- Part-of-speech tagging using BERT☆10Nov 14, 2019Updated 6 years ago
- Collapsed Gibbs sampling for Latent Dirichlet Allocation☆18Jun 11, 2012Updated 14 years ago
- 离线版中文标注工具,支持NER、文本分类、关系标注、对话标注等。☆14Jul 29, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Springboot + ElasticSearch 构建博客检索系统☆12Mar 5, 2020Updated 6 years ago
- Propaganda detection using fine-tuned BERT☆20Jul 21, 2022Updated 4 years ago
- pytorch☆11Jul 29, 2019Updated 7 years ago
- 实现功能:新输入一段文本,与已有数据进行相似度进行比较,返回TOP10的文本。主要实现方法:jieba中文分词、gensim、TF-IDF词汇重要性、cosine余弦相似度。☆11Jul 30, 2020Updated 6 years ago
- ☆12May 3, 2024Updated 2 years ago
- 本项目包含几种常用 NLP算法的实现:关键词(keyword)、命名实体(named entity)、自动摘要(abstract)、文本相似度比较(text similarity)等☆16Jan 16, 2022Updated 4 years ago
- aigc evals☆10Dec 2, 2023Updated 2 years ago
- ☆13Apr 16, 2022Updated 4 years ago
- ☆10Aug 21, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Using Seq2Seq transformers for Text2SQL task on WikiSQL dataset.☆12Jan 8, 2022Updated 4 years ago
- https://www.kaggle.com/c/nbme-score-clinical-patient-notes☆10Sep 1, 2022Updated 4 years ago
- ☆12May 13, 2023Updated 3 years ago
- ☆21Jan 9, 2023Updated 3 years ago
- 长文本相似度模型☆21Nov 24, 2023Updated 2 years ago
- ☆12Mar 14, 2023Updated 3 years ago
- Change FeliCa PMm of HCE-F for Android NFC☆11Apr 30, 2023Updated 3 years ago
- 微信hook☆11Jan 7, 2020Updated 6 years ago
- Another attempt at a long-context / efficient transformer by me☆38Apr 11, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13Jun 19, 2021Updated 5 years ago
- 毕业设计:《基于CLIP模 型的视频文本检索设计与实现》☆18Jul 21, 2024Updated 2 years ago
- A GCN based visual question generation model☆13Aug 21, 2019Updated 7 years ago
- golang tun nat☆11Jul 20, 2022Updated 4 years ago
- MUX-PLMs: Pretraining LMs with Data Multiplexing☆15Jan 29, 2023Updated 3 years ago
- codes for GAIIC-Track1☆14Jun 14, 2022Updated 4 years ago
- ☆11Mar 29, 2019Updated 7 years ago
- Help us reverse ios more easily☆19May 30, 2025Updated last year
- Few-Shot Text Classification with Induction Network☆18Apr 23, 2020Updated 6 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆14Oct 28, 2023Updated 2 years ago
- Another terminal emulator for Android.☆11Jun 9, 2026Updated 4 months ago
- A command line tool for comparing JSON files by degree of similarity.☆12Oct 28, 2019Updated 6 years ago
- ☆13Jul 14, 2026Updated 2 months ago
- A Python package for building and cutting sparse layered s-t graphs.☆13Nov 6, 2023Updated 2 years ago
- lightsmile个人的用于爬取网络公开语料数据的mini通用爬虫框架。☆13Sep 30, 2020Updated 6 years ago
- Frida script to dump native libraries from running process on Android, inspired by frida_dump☆14Jul 5, 2026Updated 3 months ago