embeddings-benchmark / mteb
MTEB: Massive Text Embedding Benchmark
☆2,193Updated this week
Alternatives and similar repositories for mteb:
Users that are interested in mteb are comparing it to the libraries listed below
- This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai,…☆1,976Updated 8 months ago
- Efficient Retrieval Augmentation and Generation Framework☆1,458Updated last month
- A blazing fast inference solution for text embeddings models☆3,175Updated 3 weeks ago
- ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)☆3,247Updated 3 months ago
- ☆1,949Updated 9 months ago
- The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval☆1,101Updated 5 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,295Updated last week
- A framework for few-shot evaluation of language models.☆7,848Updated this week
- Measuring Massive Multitask Language Understanding | ICLR 2021☆1,305Updated last year
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆1,712Updated 6 months ago
- A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.☆1,706Updated 2 weeks ago
- Retrieval and Retrieval-augmented LLMs☆8,555Updated last week
- A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)☆2,374Updated 3 weeks ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,448Updated this week
- Automated Evaluation of RAG Systems☆547Updated 3 months ago
- Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'☆1,420Updated 3 weeks ago
- An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.☆1,654Updated last month
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,266Updated last week
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆2,362Updated last week
- [ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings☆1,915Updated last month
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters☆1,790Updated last year
- General technology for enabling AI capabilities w/ LLMs and MLLMs☆3,845Updated last month
- Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09…☆2,059Updated this week
- AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:☆1,946Updated last month
- ☆835Updated 3 months ago
- ☆1,497Updated last week
- The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".☆1,485Updated 8 months ago
- Bringing BERT into modernity via both architecture changes and scaling☆1,199Updated last week
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,230Updated last week
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy☆1,019Updated last month