Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint
☆430Mar 26, 2024Updated last year
Alternatives and similar repositories for GradCache
Users that are interested in GradCache are comparing it to the libraries listed below
Sorting:
- Train Dense Passage Retriever (DPR) with a single GPU☆136Jun 16, 2021Updated 4 years ago
- EMNLP 2021 - Pre-training architectures for dense retrieval☆256Mar 18, 2022Updated 4 years ago
- Tevatron - Unified Document Retrieval Toolkit across Scale, Language, and Modality. Demo in SIGIR 2023, SIGIR 2025.☆734Jan 26, 2026Updated last month
- NAACL2021 - COIL Contextualized Lexical Retriever☆157Jul 27, 2021Updated 4 years ago
- [SIGIR 2025] The official repo for "Scaling Sparse and Dense Retrieval in Decoder-Only LLMs"☆20Mar 31, 2025Updated 11 months ago
- Scalable training for dense retrieval models.☆298Jun 10, 2025Updated 9 months ago
- [CVPR 2025 Highlight] The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for C…☆282Jan 16, 2025Updated last year
- SIGIR 2021: Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Sampling☆60Jul 11, 2021Updated 4 years ago
- Build Text Rerankers with Deep Language Models☆265Feb 20, 2024Updated 2 years ago
- A novel embedding training algorithm leveraging ANN search and achieved SOTA retrieval on Trec DL 2019 and OpenQA benchmarks☆385Jan 6, 2026Updated 2 months ago
- Code Roberta version of RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder☆10Mar 16, 2023Updated 3 years ago
- Codebase for RetroMAE and beyond.☆272Jun 7, 2024Updated last year
- Generative Representational Instruction Tuning☆688Jun 25, 2025Updated 8 months ago
- A toolkit for asynchronously validating dense retriever checkpoints during training.☆27Aug 10, 2023Updated 2 years ago
- Code and data of the EMNLP 2022 Main Conference paper "Reduce Catastrophic Forgetting of Dense Retrieval Training with Teleportation Nega…☆18Mar 25, 2024Updated last year
- SIGIR'21: Optimizing DR with hard negatives and achieving SOTA first-stage retrieval performance on TREC DL Track.☆128Feb 15, 2022Updated 4 years ago
- ☆102Dec 17, 2022Updated 3 years ago
- ☆70Jun 16, 2022Updated 3 years ago
- A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.☆2,107Oct 16, 2025Updated 5 months ago
- SGPT: GPT Sentence Embeddings for Semantic Search☆873Feb 17, 2024Updated 2 years ago
- A curated list of awesome papers related to pre-trained models for information retrieval (a.k.a., pretraining for IR).☆677Jan 7, 2024Updated 2 years ago
- Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.☆2,036Mar 9, 2026Updated last week
- Dense Passage Retriever - is a set of tools and models for open domain Q&A task.☆1,863Apr 6, 2023Updated 2 years ago
- Contriever: Unsupervised Dense Information Retrieval with Contrastive Learning☆773Apr 7, 2023Updated 2 years ago
- Code and Models for the paper "End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering" (NeurIPS 20…☆110Apr 18, 2022Updated 3 years ago
- Binary Passage Retriever (BPR) - an efficient passage retriever for open-domain question answering☆175Jun 6, 2021Updated 4 years ago
- Training & evaluation library for text-based neural re-ranking and dense retrieval models built with PyTorch☆265Jan 27, 2023Updated 3 years ago
- [EMNLP 2022] This is the code repo for our EMNLP‘22 paper "COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contr…☆50Oct 12, 2023Updated 2 years ago
- Dense hybrid representations for text retrieval☆64Apr 3, 2023Updated 2 years ago
- ☆47Mar 27, 2022Updated 3 years ago
- Train Models Contrastively in Pytorch☆779Mar 26, 2025Updated 11 months ago
- This is the official repository for NAACL 2021, "XOR QA: Cross-lingual Open-Retrieval Question Answering".☆80Jun 3, 2021Updated 4 years ago
- Unified Learned Sparse Retrieval Framework☆68May 13, 2024Updated last year
- [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821☆3,643Oct 16, 2024Updated last year
- Code release for SLIP Self-supervision meets Language-Image Pre-training☆787Feb 9, 2023Updated 3 years ago
- An Open-Source Package for Information Retrieval.☆442Oct 7, 2022Updated 3 years ago
- ☆14Jul 7, 2024Updated last year
- ☆21Mar 15, 2023Updated 3 years ago
- Library for 8-bit optimizers and quantization routines.☆780Aug 18, 2022Updated 3 years ago