pytrec_eval is an Information Retrieval evaluation tool for Python, based on the popular trec_eval.
☆352Oct 10, 2023Updated 2 years ago
Alternatives and similar repositories for pytrec_eval
Users that are interested in pytrec_eval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A simple toolkit to process TREC files in Python.☆174Aug 24, 2024Updated 2 years ago
- Evaluation software used in the Text Retrieval Conference☆281Jul 20, 2026Updated last month
- A toolkit for end-to-end neural ad hoc retrieval☆97Aug 20, 2024Updated 2 years ago
- Provides a common interface to many IR ranking datasets.☆390May 28, 2026Updated 3 months ago
- Training & evaluation library for text-based neural re-ranking and dense retrieval models built with PyTorch☆267Jan 27, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- An end-to-end neural ad-hoc ranking pipeline.☆153Jul 13, 2025Updated last year
- A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.☆2,285Oct 16, 2025Updated 10 months ago
- ☆24Oct 23, 2020Updated 5 years ago
- A novel embedding training algorithm leveraging ANN search and achieved SOTA retrieval on Trec DL 2019 and OpenQA benchmarks☆389Jan 6, 2026Updated 8 months ago
- Anserini is a Lucene toolkit for reproducible information retrieval research☆1,194Updated this week
- A clone of indri-5.12 with minor customizations.☆25Sep 23, 2024Updated last year
- A toolkit for simulating interactive information retrieval☆21Sep 7, 2018Updated 8 years ago
- Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.☆2,159Updated this week
- pyndri is a Python interface to the Indri search engine.☆89Jun 21, 2022Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Tool for comparing two ranked lists (TREC run files)☆20Nov 9, 2022Updated 3 years ago
- An Open-Source Package for Information Retrieval.☆442Oct 7, 2022Updated 3 years ago
- docTTTTTquery document expansion model☆376Mar 25, 2023Updated 3 years ago
- Python binding to the KrovetzStemmer package (C++ version)☆14Feb 12, 2023Updated 3 years ago
- Rank-Biased Precision, Overlap, Recall, and Alignment☆15Jun 15, 2026Updated 2 months ago
- Neural Vector Space Models☆49Oct 30, 2018Updated 7 years ago
- Tevatron - Unified Document Retrieval Toolkit across Scale, Language, and Modality. Demo in SIGIR 2023, SIGIR 2025.☆749Jul 18, 2026Updated last month
- MS MARCO(Microsoft Machine Reading Comprehension) is a large scale dataset focused on machine reading comprehension, question answering, …☆346Jun 12, 2023Updated 3 years ago
- scripts to download and standardize trec query and document sets☆48Aug 7, 2019Updated 7 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- provides a common interface to many IR measure tools☆102Feb 17, 2026Updated 6 months ago
- Tools for the TREC CAsT benchmark☆30Dec 15, 2022Updated 3 years ago
- Standalone Neural Ranking Model (SNRM)☆76Dec 26, 2018Updated 7 years ago
- A Python framework for performing information retrieval experiments, building on http://terrier.org/☆515Aug 27, 2026Updated last week
- a gaggle of deep neural architectures for text ranking and question answering, designed for Pyserini☆354Dec 21, 2023Updated 2 years ago
- A toolkit for asynchronously validating dense retriever checkpoints during training.☆27Aug 10, 2023Updated 3 years ago
- ☆15Feb 20, 2025Updated last year
- Jig for the Open-Source IR Replicability Challenge (OSIRRC)☆13Dec 8, 2022Updated 3 years ago
- A curated list of awesome multi-modal recommendation.☆10Mar 16, 2022Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Accelerated Confergence for Counterfactual Learning to Rank☆17Jan 21, 2022Updated 4 years ago
- Anserini notebooks☆69Apr 2, 2023Updated 3 years ago
- Dense Passage Retriever - is a set of tools and models for open domain Q&A task.☆1,870Apr 6, 2023Updated 3 years ago
- ↕️ Intuitive axiomatic retrieval experimentation.☆31Aug 11, 2026Updated 3 weeks ago
- One-stop shop for running and fine-tuning transformer-based language models for retrieval☆65Updated this week
- Source code for: On the Effect of Low-Frequency Terms on Neural-IR Models, SIGIR'19☆48Apr 30, 2019Updated 7 years ago
- Semantic Entity Retrieval Toolkit☆111Jul 26, 2017Updated 9 years ago