Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint
☆427Mar 26, 2024Updated last year
Alternatives and similar repositories for GradCache
Users that are interested in GradCache are comparing it to the libraries listed below
Sorting:
- Train Dense Passage Retriever (DPR) with a single GPU☆136Jun 16, 2021Updated 4 years ago
- Tevatron - Unified Document Retrieval Toolkit across Scale, Language, and Modality. Demo in SIGIR 2023, SIGIR 2025.☆727Jan 26, 2026Updated last month
- EMNLP 2021 - Pre-training architectures for dense retrieval☆256Mar 18, 2022Updated 3 years ago
- Scalable training for dense retrieval models.☆298Jun 10, 2025Updated 8 months ago
- [SIGIR 2025] The official repo for "Scaling Sparse and Dense Retrieval in Decoder-Only LLMs"☆20Mar 31, 2025Updated 11 months ago
- [CVPR 2025 Highlight] The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for C…☆279Jan 16, 2025Updated last year
- NAACL2021 - COIL Contextualized Lexical Retriever☆157Jul 27, 2021Updated 4 years ago
- A novel embedding training algorithm leveraging ANN search and achieved SOTA retrieval on Trec DL 2019 and OpenQA benchmarks☆383Jan 6, 2026Updated last month
- Build Text Rerankers with Deep Language Models☆265Feb 20, 2024Updated 2 years ago
- Codebase for RetroMAE and beyond.☆272Jun 7, 2024Updated last year
- Generative Representational Instruction Tuning☆686Jun 25, 2025Updated 8 months ago
- ☆70Jun 16, 2022Updated 3 years ago
- A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.☆2,087Oct 16, 2025Updated 4 months ago
- SGPT: GPT Sentence Embeddings for Semantic Search☆873Feb 17, 2024Updated 2 years ago
- Code release for SLIP Self-supervision meets Language-Image Pre-training☆787Feb 9, 2023Updated 3 years ago
- SIGIR 2021: Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Sampling☆60Jul 11, 2021Updated 4 years ago
- Code Roberta version of RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder☆10Mar 16, 2023Updated 2 years ago
- ☆102Dec 17, 2022Updated 3 years ago
- Contriever: Unsupervised Dense Information Retrieval with Contrastive Learning☆772Apr 7, 2023Updated 2 years ago
- Understanding the Difficulty of Training Transformers☆332May 31, 2022Updated 3 years ago
- This is the official repository for NAACL 2021, "XOR QA: Cross-lingual Open-Retrieval Question Answering".☆80Jun 3, 2021Updated 4 years ago
- Library for 8-bit optimizers and quantization routines.☆780Aug 18, 2022Updated 3 years ago
- Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.☆2,023Feb 21, 2026Updated last week
- [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821☆3,641Oct 16, 2024Updated last year
- Binary Passage Retriever (BPR) - an efficient passage retriever for open-domain question answering☆175Jun 6, 2021Updated 4 years ago
- Various test models in WNNX format. It can view with `pip install wnetron && wnetron`☆12Jun 22, 2022Updated 3 years ago
- Learning Features with Parameter-Free Layers, ICLR 2022☆84May 3, 2023Updated 2 years ago
- Dense Passage Retriever - is a set of tools and models for open domain Q&A task.☆1,860Apr 6, 2023Updated 2 years ago
- SIGIR'21: Optimizing DR with hard negatives and achieving SOTA first-stage retrieval performance on TREC DL Track.☆128Feb 15, 2022Updated 4 years ago
- Parallelformers: An Efficient Model Parallelization Toolkit for Deployment☆791Apr 24, 2023Updated 2 years ago
- A curated list of awesome papers related to pre-trained models for information retrieval (a.k.a., pretraining for IR).☆677Jan 7, 2024Updated 2 years ago
- Training & evaluation library for text-based neural re-ranking and dense retrieval models built with PyTorch☆265Jan 27, 2023Updated 3 years ago
- Search Engines with Autoregressive Language models☆295Apr 4, 2023Updated 2 years ago
- Code and data of the EMNLP 2022 Main Conference paper "Reduce Catastrophic Forgetting of Dense Retrieval Training with Teleportation Nega…☆18Mar 25, 2024Updated last year
- Code and Models for the paper "End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering" (NeurIPS 20…☆109Apr 18, 2022Updated 3 years ago
- ☆14Jul 7, 2024Updated last year
- The corresponding code from our paper "DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations". Do not hesitate to o…☆378Apr 21, 2023Updated 2 years ago
- maximal update parametrization (µP)☆1,686Jul 17, 2024Updated last year
- Dense hybrid representations for text retrieval☆64Apr 3, 2023Updated 2 years ago