huggingface / text-clustering
Easily embed, cluster and semantically label text datasets
☆462Updated 7 months ago
Related projects ⓘ
Alternatives and complementary repositories for text-clustering
- ☆451Updated 3 weeks ago
- Generative Representational Instruction Tuning☆567Updated this week
- awesome synthetic (text) datasets☆242Updated 3 weeks ago
- FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes☆183Updated last month
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.☆349Updated last week
- Toolkit for attaching, training, saving and loading of new heads for transformer models☆246Updated 2 weeks ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,095Updated last week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆811Updated this week
- ☆333Updated 11 months ago
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy☆899Updated last week
- Generate textbook-quality synthetic LLM pretraining data☆488Updated last year
- Fine-Tuning Embedding for RAG with Synthetic Data☆469Updated last year
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.☆385Updated 9 months ago
- Let's build better datasets, together!☆205Updated this week
- A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.☆700Updated 2 months ago
- A fast and lightweight pure Python library for splitting text into semantically meaningful chunks.☆182Updated 4 months ago
- Guideline following Large Language Model for Information Extraction☆313Updated 3 weeks ago
- data cleaning and curation for unstructured text☆327Updated 3 months ago
- Official repository for ORPO☆421Updated 5 months ago
- Code for explaining and evaluating late chunking (chunked pooling)☆246Updated last month
- Best practices for distilling large language models.☆397Updated 9 months ago
- An Open Source Toolkit For LLM Distillation☆356Updated 2 months ago
- SpanMarker for Named Entity Recognition☆401Updated 3 months ago
- Extend existing LLMs way beyond the original training length with constant memory usage, without retraining☆675Updated 7 months ago
- Official repository for "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality s…☆491Updated 2 weeks ago
- A large-scale information-rich web dataset, featuring millions of real clicked query-document labels☆308Updated 5 months ago
- Automatically evaluate your LLMs in Google Colab☆559Updated 6 months ago
- Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard☆485Updated last week
- Distill a Small Static Model from any Sentence Transformer☆460Updated this week
- Evaluate your LLM's response with Prometheus and GPT4 💯☆797Updated 2 months ago