huggingface / text-clustering
Easily embed, cluster and semantically label text datasets
☆520Updated last year
Alternatives and similar repositories for text-clustering:
Users that are interested in text-clustering are comparing it to the libraries listed below
- ☆504Updated 4 months ago
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.☆419Updated this week
- awesome synthetic (text) datasets☆265Updated 5 months ago
- Generative Representational Instruction Tuning☆613Updated 2 weeks ago
- FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes☆191Updated 5 months ago
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.☆416Updated last year
- Late Interaction Models Training & Retrieval☆264Updated last week
- Notebooks for training universal 0-shot classifiers on many different tasks☆120Updated 3 months ago
- Best practices for distilling large language models.☆511Updated last year
- Let's build better datasets, together!☆257Updated 3 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆253Updated 8 months ago
- Official repository for ORPO☆446Updated 10 months ago
- ☆359Updated last year
- A bagel, with everything.☆317Updated 11 months ago
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy☆1,087Updated last week
- [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …☆669Updated 2 weeks ago
- Fine-Tuning Embedding for RAG with Synthetic Data☆489Updated last year
- A large-scale information-rich web dataset, featuring millions of real clicked query-document labels☆320Updated 3 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,358Updated this week
- Train Models Contrastively in Pytorch☆671Updated last week
- Guideline following Large Language Model for Information Extraction☆358Updated 5 months ago
- SpanMarker for Named Entity Recognition☆424Updated 2 months ago
- Neural Search☆352Updated 3 weeks ago
- Code for fine-tuning Platypus fam LLMs using LoRA☆628Updated last year
- Evaluate your LLM's response with Prometheus and GPT4 💯☆898Updated 2 weeks ago
- Fast Semantic Text Deduplication☆597Updated last week
- A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.☆763Updated last month
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆456Updated last year
- data cleaning and curation for unstructured text☆329Updated 7 months ago
- Generate textbook-quality synthetic LLM pretraining data☆498Updated last year