Web-scale retrieval for knowledge-intensive NLP
☆553Dec 6, 2022Updated 3 years ago
Alternatives and similar repositories for Sphere
Users that are interested in Sphere are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The AI Knowledge Editor☆183Jul 12, 2022Updated 3 years ago
- Library for Knowledge Intensive Language Tasks☆970Mar 31, 2022Updated 3 years ago
- A library for building and serving multi-node distributed faiss indices.☆278Nov 1, 2023Updated 2 years ago
- Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.☆2,036Mar 9, 2026Updated last week
- Search Engines with Autoregressive Language models☆295Apr 4, 2023Updated 2 years ago
- [NAACL 2021] This is the code for our paper `Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self…☆206Aug 17, 2022Updated 3 years ago
- A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.☆2,107Oct 16, 2025Updated 5 months ago
- FastFormers - highly efficient transformer models for NLU☆709Mar 21, 2025Updated last year
- SPRINT Toolkit helps you evaluate diverse neural sparse models easily using a single click on any IR dataset.☆47Jul 25, 2023Updated 2 years ago
- SPLADE: sparse neural search (SIGIR21, SIGIR22)☆983May 3, 2024Updated last year
- Tevatron - Unified Document Retrieval Toolkit across Scale, Language, and Modality. Demo in SIGIR 2023, SIGIR 2025.☆734Jan 26, 2026Updated last month
- Binary Passage Retriever (BPR) - an efficient passage retriever for open-domain question answering☆175Jun 6, 2021Updated 4 years ago
- The implementation of DeBERTa☆2,202Sep 29, 2023Updated 2 years ago
- Autoregressive Entity Retrieval☆796Jul 6, 2023Updated 2 years ago
- ☆24Oct 23, 2020Updated 5 years ago
- Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: …☆341Jul 6, 2023Updated 2 years ago
- [ACL 2021] Learning Dense Representations of Phrases at Scale; EMNLP'2021: Phrase Retrieval Learns Passage Retrieval, Too https://arxiv.o…☆606Jun 15, 2022Updated 3 years ago
- Efficient few-shot learning with Sentence Transformers☆2,699Dec 11, 2025Updated 3 months ago
- Code and data to support the paper "PAQ 65 Million Probably-Asked Questions andWhat You Can Do With Them"☆209Aug 31, 2021Updated 4 years ago
- The original implementation of Min et al. "Nonparametric Masked Language Modeling" (paper https//arxiv.org/abs/2212.01349)☆158Jan 6, 2023Updated 3 years ago
- Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.☆1,750Dec 20, 2023Updated 2 years ago
- Scalable training for dense retrieval models.☆298Jun 10, 2025Updated 9 months ago
- SGPT: GPT Sentence Embeddings for Semantic Search☆873Feb 17, 2024Updated 2 years ago
- ☆52Jun 21, 2025Updated 9 months ago
- Mr. TyDi is a multi-lingual benchmark dataset built on TyDi, covering eleven typologically diverse languages.☆80Feb 16, 2022Updated 4 years ago
- INCOME: An Easy Repository for Training and Evaluation of Index Compression Methods in Dense Retrieval. Includes BPR and JPQ.☆24Sep 24, 2023Updated 2 years ago
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆164Oct 4, 2023Updated 2 years ago
- [EMNLP 2022] Training Language Models with Memory Augmentation https://arxiv.org/abs/2205.12674☆195Jun 14, 2023Updated 2 years ago
- Fuzzy string matching, grouping, and evaluation.☆792Jul 10, 2025Updated 8 months ago
- A library to synthesize text datasets using Large Language Models (LLM)☆152Jan 17, 2023Updated 3 years ago
- Question-answers, collected from Google☆132Jul 23, 2021Updated 4 years ago
- Dense Passage Retriever - is a set of tools and models for open domain Q&A task.☆1,863Apr 6, 2023Updated 2 years ago
- An Open-Source Package for Information Retrieval.☆442Oct 7, 2022Updated 3 years ago
- SentAugment is a data augmentation technique for NLP that retrieves similar sentences from a large bank of sentences. It can be used in c…☆359Feb 22, 2022Updated 4 years ago
- Tools to download and cleanup Common Crawl data☆1,038Apr 25, 2023Updated 2 years ago
- ☆99Jul 25, 2023Updated 2 years ago
- A toolkit for asynchronously validating dense retriever checkpoints during training.☆27Aug 10, 2023Updated 2 years ago
- Used for adaptive human in the loop evaluation of language and embedding models.☆307Mar 1, 2023Updated 3 years ago
- Inquisitive Parrots for Search☆200Jun 5, 2025Updated 9 months ago