pytrec_eval is an Information Retrieval evaluation tool for Python, based on the popular trec_eval.
☆344Oct 10, 2023Updated 2 years ago
Alternatives and similar repositories for pytrec_eval
Users that are interested in pytrec_eval are comparing it to the libraries listed below
Sorting:
- A simple toolkit to process TREC files in Python.☆174Aug 24, 2024Updated last year
- Evaluation software used in the Text Retrieval Conference☆276Nov 1, 2024Updated last year
- A toolkit for end-to-end neural ad hoc retrieval☆97Aug 20, 2024Updated last year
- Provides a common interface to many IR ranking datasets.☆381Feb 20, 2026Updated 2 weeks ago
- Training & evaluation library for text-based neural re-ranking and dense retrieval models built with PyTorch☆265Jan 27, 2023Updated 3 years ago
- ☆24Oct 23, 2020Updated 5 years ago
- A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.☆2,095Oct 16, 2025Updated 4 months ago
- An end-to-end neural ad-hoc ranking pipeline.☆152Jul 13, 2025Updated 7 months ago
- A novel embedding training algorithm leveraging ANN search and achieved SOTA retrieval on Trec DL 2019 and OpenQA benchmarks☆383Jan 6, 2026Updated 2 months ago
- Anserini is a Lucene toolkit for reproducible information retrieval research☆1,101Updated this week
- A toolkit for simulating interactive information retrieval☆21Sep 7, 2018Updated 7 years ago
- A clone of indri-5.12 with minor customizations.☆25Sep 23, 2024Updated last year
- Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.☆2,026Updated this week
- Tool for comparing two ranked lists (TREC run files)☆20Nov 9, 2022Updated 3 years ago
- An Open-Source Package for Information Retrieval.☆442Oct 7, 2022Updated 3 years ago
- docTTTTTquery document expansion model☆374Mar 25, 2023Updated 2 years ago
- A Python framework for performing information retrieval experiments, building on http://terrier.org/☆496Mar 2, 2026Updated last week
- Neural Vector Space Models☆49Oct 30, 2018Updated 7 years ago
- provides a common interface to many IR measure tools☆96Feb 17, 2026Updated 2 weeks ago
- MS MARCO(Microsoft Machine Reading Comprehension) is a large scale dataset focused on machine reading comprehension, question answering, …☆339Jun 12, 2023Updated 2 years ago
- Tevatron - Unified Document Retrieval Toolkit across Scale, Language, and Modality. Demo in SIGIR 2023, SIGIR 2025.☆730Jan 26, 2026Updated last month
- scripts to download and standardize trec query and document sets☆48Aug 7, 2019Updated 6 years ago
- Standalone Neural Ranking Model (SNRM)☆76Dec 26, 2018Updated 7 years ago
- pyndri is a Python interface to the Indri search engine.☆89Jun 21, 2022Updated 3 years ago
- a gaggle of deep neural architectures for text ranking and question answering, designed for Pyserini☆352Dec 21, 2023Updated 2 years ago
- ↕️ Intuitive axiomatic retrieval experimentation.☆31Feb 9, 2026Updated 3 weeks ago
- Python binding to the KrovetzStemmer package (C++ version)☆13Feb 12, 2023Updated 3 years ago
- Accelerated Confergence for Counterfactual Learning to Rank☆17Jan 21, 2022Updated 4 years ago
- A Benchmark Workflow and Dataset Collection for Query Refinement☆25Jun 12, 2023Updated 2 years ago
- Rank-Biased Precision, Overlap, Recall, and Alignment☆12Feb 18, 2025Updated last year
- Software for building the IR Anthology.☆11Sep 19, 2023Updated 2 years ago
- Tools for the TREC CAsT benchmark☆30Dec 15, 2022Updated 3 years ago
- A Test Collection of Computer Science Papers for Faceted Query by Example☆22Nov 28, 2021Updated 4 years ago
- A Python interface to PISA☆37Sep 23, 2025Updated 5 months ago
- Tools for working with the TREC CAR dataset.☆36Jul 12, 2025Updated 7 months ago
- Dense Passage Retriever - is a set of tools and models for open domain Q&A task.☆1,860Apr 6, 2023Updated 2 years ago
- Source code for: On the Effect of Low-Frequency Terms on Neural-IR Models, SIGIR'19☆48Apr 30, 2019Updated 6 years ago
- MS MARCO(Microsoft Machine Reading Comprehension) is a large scale dataset focused on machine reading comprehension, question answering, …☆132Jan 3, 2022Updated 4 years ago
- One-stop shop for running and fine-tuning transformer-based language models for retrieval☆63Updated this week