huggingface / text-clustering
Easily embed, cluster and semantically label text datasets
☆511Updated 11 months ago
Alternatives and similar repositories for text-clustering:
Users that are interested in text-clustering are comparing it to the libraries listed below
- ☆498Updated 3 months ago
- awesome synthetic (text) datasets☆263Updated 4 months ago
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy☆1,033Updated last month
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.☆405Updated last week
- FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes☆188Updated 4 months ago
- Guideline following Large Language Model for Information Extraction☆349Updated 4 months ago
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.☆407Updated last year
- Generative Representational Instruction Tuning☆599Updated last month
- Official repository for ORPO☆441Updated 9 months ago
- Official repository for ICLR 2025 paper "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient an…☆638Updated 2 weeks ago
- Let's build better datasets, together!☆256Updated 2 months ago
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆497Updated 8 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,314Updated last week
- Extend existing LLMs way beyond the original training length with constant memory usage, without retraining☆689Updated 10 months ago
- Best practices for distilling large language models.☆491Updated last year
- Automated Evaluation of RAG Systems☆554Updated 3 months ago
- A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.☆743Updated this week
- Train Models Contrastively in Pytorch☆652Updated last week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,238Updated this week
- Evaluate your LLM's response with Prometheus and GPT4 💯☆877Updated last month
- ☆354Updated last year
- Fast Semantic Text Deduplication☆545Updated this week
- Manage scalable open LLM inference endpoints in Slurm clusters☆253Updated 7 months ago
- All-in-one text de-duplication☆659Updated 9 months ago
- A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).☆808Updated this week
- Generate textbook-quality synthetic LLM pretraining data☆498Updated last year
- Fine-Tuning Embedding for RAG with Synthetic Data☆487Updated last year
- Late Interaction Models Training & Retrieval☆249Updated this week
- This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"☆203Updated 2 months ago
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆209Updated 3 months ago