SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 languages, generated using PaLM 2 and summarize-then-ask prompting.
☆49Nov 13, 2023Updated 2 years ago
Alternatives and similar repositories for swim-ir
Users that are interested in swim-ir are comparing it to the libraries listed below
Sorting:
- This repository helps you evaluate your models on the FreshStack benchmark!☆33Dec 9, 2025Updated 3 months ago
- The Python Implementation of CRISP: Clustering Multi-Vector Representations for Denoising and Pruning☆27Jul 27, 2025Updated 7 months ago
- ☆43Apr 22, 2025Updated 10 months ago
- Code that drives the public web-based tools for the Media Cloud Online News Archive and Directory.☆11Updated this week
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Aug 12, 2023Updated 2 years ago
- Generating Summaries with Controllable Readability Levels (EMNLP 2023)☆15Aug 6, 2025Updated 7 months ago
- BlockRank makes LLMs efficient and scalable for RAG and in-context ranking☆41Dec 12, 2025Updated 2 months ago
- ☆12Feb 22, 2024Updated 2 years ago
- Effective Unsupervised Domain Adaptation of Neural Rankers by Diversifying Synthetic Query Generation☆15Apr 23, 2025Updated 10 months ago
- An unofficial implementation of Tensor4D with support for the D-NeRF dataset☆13Nov 8, 2023Updated 2 years ago
- An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io☆16Apr 18, 2024Updated last year
- [ACL 2025] AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark☆166Oct 14, 2025Updated 4 months ago
- Tevatron - Unified Document Retrieval Toolkit across Scale, Language, and Modality. Demo in SIGIR 2023, SIGIR 2025.☆730Jan 26, 2026Updated last month
- provides a common interface to many IR measure tools☆96Feb 17, 2026Updated 3 weeks ago
- T-Projection is a method to perform high-quality Annotation Projection of Sequence Labeling datasets.☆13Nov 21, 2023Updated 2 years ago
- Scalable training for dense retrieval models.☆298Jun 10, 2025Updated 8 months ago
- Official Implementation of PatentLMM (our AAAI 2025 Paper)☆16Jan 28, 2025Updated last year
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆35Aug 15, 2023Updated 2 years ago
- Use contrastive learning to train a large language model (LLM) as a retriever☆12Jul 19, 2024Updated last year
- Question and answer retrieval in Turkish with BERT☆14Nov 30, 2021Updated 4 years ago
- ☆50Nov 18, 2025Updated 3 months ago
- Huggingface implementation of MVDream for easy import☆16Mar 31, 2025Updated 11 months ago
- Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval☆16Jan 16, 2024Updated 2 years ago
- A Scholarly Knowledge Graph Benchmark Dataset☆22Jan 12, 2026Updated last month
- ☆14Oct 28, 2023Updated 2 years ago
- Cross language information retrieval pipeline☆19Jan 12, 2026Updated last month
- An easy-to-use python toolkit for flexibly adapting various neural ranking models to target domain.☆60May 17, 2023Updated 2 years ago
- A large-scale multilingual dataset for Information Retrieval. Thorough human-annotations across 18 diverse languages.☆199Jul 31, 2024Updated last year
- Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: …☆340Jul 6, 2023Updated 2 years ago
- Codebase of ACL2024 paper "Spiral of Silence: How is Large Language Model Killing Information Retrieval?—A Case Study on Open Domain Ques…☆16Jun 4, 2024Updated last year
- Embedding Recycling for Language models☆38Jul 11, 2023Updated 2 years ago
- ☆18Aug 21, 2025Updated 6 months ago
- Toolkit for domain-specific information retrieval experimentation☆19Feb 24, 2026Updated 2 weeks ago
- This repository hosts the dataset for the paper Computer Science Named Entity Recognition in the Open Research Knowledge Graph☆21Jan 8, 2024Updated 2 years ago
- ☆24Feb 4, 2026Updated last month
- SPLADE: sparse neural search (SIGIR21, SIGIR22)☆980May 3, 2024Updated last year
- Rotation equivariance meets local feature matching☆18Oct 20, 2022Updated 3 years ago
- Generate BERT vocabularies and pretraining examples from Wikipedias☆17May 11, 2020Updated 5 years ago
- Quick lookup for Instant-angelo (https://github.com/hugoycj/Instant-angelo) results☆21Oct 22, 2023Updated 2 years ago