irgroup / repro_evalLinks
A Python Interface to Reproducibility Measures of System-Oriented IR Experiments
☆11Updated last month
Alternatives and similar repositories for repro_eval
Users that are interested in repro_eval are comparing it to the libraries listed below
Sorting:
- Tool for comparing two ranked lists (TREC run files)☆20Updated 3 years ago
- Software for building the IR Anthology.☆11Updated 2 years ago
- ↕️ Intuitive axiomatic retrieval experimentation.☆31Updated 3 weeks ago
- Fusion for TREC run files with popular fusion techniques☆21Updated 3 years ago
- A Python utility for indexing file lines. Best demo honourable mention at ECIR 2024.☆23Updated 2 months ago
- A toolkit for end-to-end neural ad hoc retrieval☆97Updated last year
- Code for the ECIR'22 paper "Evaluating the Robustness of Retrieval Pipelines with Query Variation Generators"☆16Updated 4 years ago
- HiCAL is a system for efficient high-recall retrieval with an adaptable assessing interface.☆37Updated 3 years ago
- Jig for the Open-Source IR Replicability Challenge (OSIRRC)☆13Updated 3 years ago
- A library for creating complex experimental pipelines☆12Updated 3 years ago
- A framework-agnostic client-side JavaScript library for logging user interactions on webpages.☆18Updated 3 years ago
- ☆30Updated last year
- ☆14Updated 11 months ago
- A Benchmark Workflow and Dataset Collection for Query Refinement☆25Updated 2 years ago
- One-stop shop for running and fine-tuning transformer-based language models for retrieval☆63Updated last month
- An end-to-end neural ad-hoc ranking pipeline.☆152Updated 6 months ago
- A Python interface to PISA☆37Updated 4 months ago
- A simple toolkit to process TREC files in Python.☆174Updated last year
- TREC-COVID results - this is a mirror of data on the TREC website in a more convenient format.☆15Updated 5 years ago
- The source code for the TIRA Shared Task Platform☆17Updated 3 weeks ago
- scripts to download and standardize trec query and document sets☆48Updated 6 years ago
- An evaluation script based on the C/W/L framework that is TREC Compatible and provides a replacement for TREC_EVAL and independent script…☆15Updated 2 years ago
- An opensource TAR framework for experiments and applications☆18Updated last year
- ☆39Updated 3 years ago
- A toolkit for asynchronously validating dense retriever checkpoints during training.☆27Updated 2 years ago
- A Test Collection of Computer Science Papers for Faceted Query by Example☆22Updated 4 years ago
- A toolkit for simulating interactive information retrieval☆21Updated 7 years ago
- A python tool for building large scale Wikipedia-based Information Retrieval datasets☆46Updated 4 years ago
- Anserini notebooks☆69Updated 2 years ago
- A Test Collection for Evaluating Retrieval of Studies for Inclusion in Systematic Reviews☆12Updated 2 years ago