huggingface / text-clustering
Easily embed, cluster and semantically label text datasets
☆494Updated 10 months ago
Alternatives and similar repositories for text-clustering:
Users that are interested in text-clustering are comparing it to the libraries listed below
- awesome synthetic (text) datasets☆256Updated 3 months ago
- ☆489Updated 2 months ago
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.☆397Updated last week
- Generative Representational Instruction Tuning☆588Updated last week
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy☆990Updated 2 weeks ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,022Updated this week
- FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes☆182Updated 3 months ago
- Neural Search☆349Updated 7 months ago
- Evaluate your LLM's response with Prometheus and GPT4 💯☆854Updated 3 weeks ago
- A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.☆733Updated 4 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,261Updated last week
- Best practices for distilling large language models.☆431Updated 11 months ago
- Let's build better datasets, together!☆250Updated last month
- Generate textbook-quality synthetic LLM pretraining data☆493Updated last year
- Late Interaction Models Training & Retrieval☆228Updated this week
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.☆401Updated 11 months ago
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆204Updated 2 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆249Updated 6 months ago
- Extend existing LLMs way beyond the original training length with constant memory usage, without retraining☆687Updated 9 months ago
- Official repository for ORPO☆432Updated 7 months ago
- Fine-Tuning Embedding for RAG with Synthetic Data☆480Updated last year
- Official repository for ICLR 2025 paper "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient an…☆587Updated last week
- Automated Evaluation of RAG Systems☆532Updated 2 months ago
- Fast Semantic Text Deduplication☆472Updated this week
- Bringing BERT into modernity via both architecture changes and scaling☆1,119Updated last week
- Guideline following Large Language Model for Information Extraction☆335Updated 3 months ago
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,167Updated this week
- SpanMarker for Named Entity Recognition☆414Updated 3 weeks ago
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆450Updated 10 months ago
- Automatically evaluate your LLMs in Google Colab☆583Updated 8 months ago