Alternatives and similar repositories for pytrec_eval

Users that are interested in pytrec_eval are comparing it to the libraries listed below

• joaopalotti / trectools

  View on GitHub
  A simple toolkit to process TREC files in Python.
  ☆174Aug 24, 2024Updated last year
• usnistgov / trec_eval

  View on GitHub
  Evaluation software used in the Text Retrieval Conference
  ☆276Nov 1, 2024Updated last year
• capreolus-ir / capreolus

  View on GitHub
  A toolkit for end-to-end neural ad hoc retrieval
  ☆97Aug 20, 2024Updated last year
• allenai / ir_datasets

  View on GitHub
  Provides a common interface to many IR ranking datasets.
  ☆381Oct 16, 2025Updated 4 months ago
• sebastian-hofstaetter / matchmaker

  View on GitHub
  Training & evaluation library for text-based neural re-ranking and dense retrieval models built with PyTorch
  ☆265Jan 27, 2023Updated 3 years ago
• beir-cellar / beir

  View on GitHub
  A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
  ☆2,070Oct 16, 2025Updated 4 months ago
• Georgetown-IR-Lab / covid-neural-ir

  View on GitHub
  ☆24Oct 23, 2020Updated 5 years ago
• Georgetown-IR-Lab / OpenNIR

  View on GitHub
  An end-to-end neural ad-hoc ranking pipeline.
  ☆152Jul 13, 2025Updated 7 months ago
• microsoft / ANCE

  View on GitHub
  A novel embedding training algorithm leveraging ANN search and achieved SOTA retrieval on Trec DL 2019 and OpenQA benchmarks
  ☆383Jan 6, 2026Updated last month
• castorini / anserini

  View on GitHub
  Anserini is a Lucene toolkit for reproducible information retrieval research
  ☆1,096Updated this week
• leifos / simiir

  View on GitHub
  A toolkit for simulating interactive information retrieval
  ☆21Sep 7, 2018Updated 7 years ago
• diazf / indri

  View on GitHub
  A clone of indri-5.12 with minor customizations.
  ☆25Sep 23, 2024Updated last year
• castorini / pyserini

  View on GitHub
  Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
  ☆2,017Updated this week
• capreolus-ir / diffir

  View on GitHub
  Tool for comparing two ranked lists (TREC run files)
  ☆20Nov 9, 2022Updated 3 years ago
• thunlp / OpenMatch

  View on GitHub
  An Open-Source Package for Information Retrieval.
  ☆442Oct 7, 2022Updated 3 years ago
• castorini / docTTTTTquery

  View on GitHub
  docTTTTTquery document expansion model
  ☆374Mar 25, 2023Updated 2 years ago
• terrier-org / pyterrier

  View on GitHub
  A Python framework for performing information retrieval experiments, building on http://terrier.org/
  ☆495Updated this week
• cvangysel / cuNVSM

  View on GitHub
  Neural Vector Space Models
  ☆49Oct 30, 2018Updated 7 years ago
• terrierteam / ir_measures

  View on GitHub
  provides a common interface to many IR measure tools
  ☆95Feb 2, 2026Updated 2 weeks ago
• microsoft / MSMARCO-Passage-Ranking

  View on GitHub
  MS MARCO(Microsoft Machine Reading Comprehension) is a large scale dataset focused on machine reading comprehension, question answering, …
  ☆337Jun 12, 2023Updated 2 years ago
• texttron / tevatron

  View on GitHub
  Tevatron - Unified Document Retrieval Toolkit across Scale, Language, and Modality. Demo in SIGIR 2023, SIGIR 2025.
  ☆723Jan 26, 2026Updated 3 weeks ago
• diazf / trec-data

  View on GitHub
  scripts to download and standardize trec query and document sets
  ☆48Aug 7, 2019Updated 6 years ago
• hamed-zamani / snrm

  View on GitHub
  Standalone Neural Ranking Model (SNRM)
  ☆76Dec 26, 2018Updated 7 years ago
• cvangysel / pyndri

  View on GitHub
  pyndri is a Python interface to the Indri search engine.
  ☆89Jun 21, 2022Updated 3 years ago
• castorini / pygaggle

  View on GitHub
  a gaggle of deep neural architectures for text ranking and question answering, designed for Pyserini
  ☆352Dec 21, 2023Updated 2 years ago
• webis-de / ir_axioms

  View on GitHub
  ↕️ Intuitive axiomatic retrieval experimentation.
  ☆31Feb 9, 2026Updated last week
• rmit-ir / KrovetzStemmer

  View on GitHub
  Python binding to the KrovetzStemmer package (C++ version)
  ☆13Feb 12, 2023Updated 3 years ago
• rjagerman / sigir2020

  View on GitHub
  Accelerated Confergence for Counterfactual Learning to Rank
  ☆17Jan 21, 2022Updated 4 years ago
• hosseinfani / ReQue

  View on GitHub
  A Benchmark Workflow and Dataset Collection for Query Refinement
  ☆25Jun 12, 2023Updated 2 years ago
• ir-anthology / ir-anthology

  View on GitHub
  Software for building the IR Anthology.
  ☆11Sep 19, 2023Updated 2 years ago
• grill-lab / trec-cast-tools

  View on GitHub
  Tools for the TREC CAsT benchmark
  ☆28Dec 15, 2022Updated 3 years ago
• iesl / CSFCube

  View on GitHub
  A Test Collection of Computer Science Papers for Faceted Query by Example
  ☆22Nov 28, 2021Updated 4 years ago
• terrierteam / pyterrier_pisa

  View on GitHub
  A Python interface to PISA
  ☆37Sep 23, 2025Updated 4 months ago
• TREMA-UNH / trec-car-tools

  View on GitHub
  Tools for working with the TREC CAR dataset.
  ☆36Jul 12, 2025Updated 7 months ago
• facebookresearch / DPR

  View on GitHub
  Dense Passage Retriever - is a set of tools and models for open domain Q&A task.
  ☆1,858Apr 6, 2023Updated 2 years ago
• sebastian-hofstaetter / sigir19-neural-ir

  View on GitHub
  Source code for: On the Effect of Low-Frequency Terms on Neural-IR Models, SIGIR'19
  ☆48Apr 30, 2019Updated 6 years ago
• microsoft / MSMARCO-Document-Ranking

  View on GitHub
  MS MARCO(Microsoft Machine Reading Comprehension) is a large scale dataset focused on machine reading comprehension, question answering, …
  ☆132Jan 3, 2022Updated 4 years ago
• webis-de / lightning-ir

  View on GitHub
  One-stop shop for running and fine-tuning transformer-based language models for retrieval
  ☆63Updated this week
• castorini / anserini-notebooks

  View on GitHub
  Anserini notebooks
  ☆69Apr 2, 2023Updated 2 years ago