Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint
☆442Mar 26, 2024Updated 2 years ago
Alternatives and similar repositories for GradCache
Users that are interested in GradCache are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Train Dense Passage Retriever (DPR) with a single GPU☆136Jun 16, 2021Updated 5 years ago
- EMNLP 2021 - Pre-training architectures for dense retrieval☆256Mar 18, 2022Updated 4 years ago
- Tevatron - Unified Document Retrieval Toolkit across Scale, Language, and Modality. Demo in SIGIR 2023, SIGIR 2025.☆742May 18, 2026Updated last month
- NAACL2021 - COIL Contextualized Lexical Retriever☆158Jul 27, 2021Updated 4 years ago
- [SIGIR 2025] The official repo for "Scaling Sparse and Dense Retrieval in Decoder-Only LLMs"☆22Mar 31, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Scalable training for dense retrieval models.☆299May 18, 2026Updated last month
- [CVPR 2025 Highlight] The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for C…☆287Jan 16, 2025Updated last year
- SIGIR 2021: Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Sampling☆60Jul 11, 2021Updated 4 years ago
- Build Text Rerankers with Deep Language Models☆265Feb 20, 2024Updated 2 years ago
- A novel embedding training algorithm leveraging ANN search and achieved SOTA retrieval on Trec DL 2019 and OpenQA benchmarks☆385Jan 6, 2026Updated 5 months ago
- Code Roberta version of RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder☆10Mar 16, 2023Updated 3 years ago
- Codebase for RetroMAE and beyond.☆274Jun 7, 2024Updated 2 years ago
- Generative Representational Instruction Tuning☆695Jun 25, 2025Updated last year
- A toolkit for asynchronously validating dense retriever checkpoints during training.☆27Aug 10, 2023Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Code and data of the EMNLP 2022 Main Conference paper "Reduce Catastrophic Forgetting of Dense Retrieval Training with Teleportation Nega…☆18Mar 25, 2024Updated 2 years ago
- SIGIR'21: Optimizing DR with hard negatives and achieving SOTA first-stage retrieval performance on TREC DL Track.☆127Feb 15, 2022Updated 4 years ago
- ☆102Dec 17, 2022Updated 3 years ago
- ☆70Jun 16, 2022Updated 4 years ago
- SGPT: GPT Sentence Embeddings for Semantic Search☆873Feb 17, 2024Updated 2 years ago
- A curated list of awesome papers related to pre-trained models for information retrieval (a.k.a., pretraining for IR).☆677Jan 7, 2024Updated 2 years ago
- Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.☆2,096Updated this week
- Dense Passage Retriever - is a set of tools and models for open domain Q&A task.☆1,866Apr 6, 2023Updated 3 years ago
- Contriever: Unsupervised Dense Information Retrieval with Contrastive Learning☆779Apr 7, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Code and Models for the paper "End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering" (NeurIPS 20…☆110Apr 18, 2022Updated 4 years ago
- Binary Passage Retriever (BPR) - an efficient passage retriever for open-domain question answering☆175Jun 6, 2021Updated 5 years ago
- Training & evaluation library for text-based neural re-ranking and dense retrieval models built with PyTorch☆265Jan 27, 2023Updated 3 years ago
- [EMNLP 2022] This is the code repo for our EMNLP‘22 paper "COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contr…☆51Oct 12, 2023Updated 2 years ago
- Dense hybrid representations for text retrieval☆65Apr 3, 2023Updated 3 years ago
- ☆47Mar 27, 2022Updated 4 years ago
- This is the official repository for NAACL 2021, "XOR QA: Cross-lingual Open-Retrieval Question Answering".☆80Jun 3, 2021Updated 5 years ago
- Unified Learned Sparse Retrieval Framework☆68May 13, 2024Updated 2 years ago
- [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821☆3,652Oct 16, 2024Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Train Models Contrastively in Pytorch☆794Mar 26, 2025Updated last year
- Code release for SLIP Self-supervision meets Language-Image Pre-training☆792Feb 9, 2023Updated 3 years ago
- An Open-Source Package for Information Retrieval.☆442Oct 7, 2022Updated 3 years ago
- Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch☆81Dec 4, 2022Updated 3 years ago
- ☆14Jul 7, 2024Updated last year
- ☆21Mar 15, 2023Updated 3 years ago
- Parallelformers: An Efficient Model Parallelization Toolkit for Deployment☆788Apr 24, 2023Updated 3 years ago