embeddings-benchmark / mteb
MTEB: Massive Text Embedding Benchmark
☆2,469Updated this week
Alternatives and similar repositories for mteb:
Users that are interested in mteb are comparing it to the libraries listed below
- This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai,…☆2,061Updated 11 months ago
- Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'☆1,500Updated 3 months ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,671Updated last week
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆1,843Updated 8 months ago
- Toolkit for creating, sharing and using natural language prompts.☆2,834Updated last year
- Efficient Retrieval Augmentation and Generation Framework☆1,531Updated 3 months ago
- A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.☆1,788Updated 2 months ago
- A blazing fast inference solution for text embeddings models☆3,505Updated last week
- Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models …☆2,203Updated this week
- Retrieval and Retrieval-augmented LLMs☆9,524Updated 3 weeks ago
- ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)☆3,354Updated 3 weeks ago
- Measuring Massive Multitask Language Understanding | ICLR 2021☆1,400Updated last year
- [ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings☆1,940Updated 3 months ago
- An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.☆1,736Updated 4 months ago
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy☆1,139Updated 2 weeks ago
- A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)☆2,529Updated 3 months ago
- ☆2,008Updated 11 months ago
- SPLADE: sparse neural search (SIGIR21, SIGIR22)☆839Updated last year
- Aligning pretrained language models with instruction data generated by themselves.☆4,359Updated 2 years ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,482Updated this week
- Official implementation for "Automatic Chain of Thought Prompting in Large Language Models" (stay tuned & more will be updated)☆1,820Updated last year
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters☆1,821Updated last year
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,791Updated 2 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,400Updated last month
- General technology for enabling AI capabilities w/ LLMs and MLLMs☆3,968Updated 2 weeks ago
- Bringing BERT into modernity via both architecture changes and scaling☆1,342Updated last month
- Benchmarking large language models' complex reasoning ability with chain-of-thought prompting☆2,723Updated 9 months ago
- The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval☆1,200Updated 8 months ago
- A framework for few-shot evaluation of language models.☆8,815Updated last week
- SGPT: GPT Sentence Embeddings for Semantic Search☆866Updated last year