embeddings-benchmark / mteb
MTEB: Massive Text Embedding Benchmark
☆2,086Updated this week
Alternatives and similar repositories for mteb:
Users that are interested in mteb are comparing it to the libraries listed below
- This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai,…☆1,930Updated 7 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆1,654Updated 5 months ago
- A blazing fast inference solution for text embeddings models☆3,043Updated last week
- A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.☆1,673Updated 5 months ago
- [ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings☆1,902Updated this week
- ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)☆3,183Updated 2 months ago
- The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval☆1,057Updated 4 months ago
- Efficient Retrieval Augmentation and Generation Framework☆1,419Updated last week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆1,879Updated this week
- Toolkit for creating, sharing and using natural language prompts.☆2,740Updated last year
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy☆970Updated this week
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,238Updated last month
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,172Updated 4 months ago
- Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'☆1,400Updated 3 months ago
- Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09…☆2,015Updated this week
- Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard☆504Updated this week
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,666Updated 3 months ago
- An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.☆1,609Updated 3 weeks ago
- SGPT: GPT Sentence Embeddings for Semantic Search☆857Updated 11 months ago
- Contriever: Unsupervised Dense Information Retrieval with Contrastive Learning☆705Updated last year
- Evaluate your LLM's response with Prometheus and GPT4 💯☆841Updated last week
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆2,311Updated this week
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,147Updated last week
- Automated Evaluation of RAG Systems☆526Updated 2 months ago
- A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)☆2,326Updated 2 months ago
- ☆1,928Updated 8 months ago
- Aligning pretrained language models with instruction data generated by themselves.☆4,239Updated last year
- Supercharge Your LLM Application Evaluations 🚀☆7,889Updated this week
- Bringing BERT into modernity via both architecture changes and scaling☆1,045Updated last week
- [ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.☆2,033Updated 2 weeks ago