irgroup / repro_eval
A Python Interface to Reproducibility Measures of System-Oriented IR Experiments
☆11Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for repro_eval
- ↕️ Intuitive axiomatic retrieval experimentation.☆23Updated last week
- Tool for comparing two ranked lists (TREC run files)☆20Updated 2 years ago
- A wrapper on trec_eval☆9Updated last month
- Fusion for TREC run files with popular fusion techniques☆22Updated 2 years ago
- ☆28Updated 2 months ago
- Code for the ECIR'22 paper "Evaluating the Robustness of Retrieval Pipelines with Query Variation Generators"☆15Updated 2 years ago
- One-stop shop for running and fine-tuning transformer-based language models for retrieval☆31Updated this week
- A library for creating complex experimental pipelines☆12Updated 2 years ago
- HiCAL is a system for efficient high-recall retrieval with an adaptable assessing interface.☆37Updated last year
- A toolkit for end-to-end neural ad hoc retrieval☆95Updated 3 months ago
- A framework-agnostic client-side JavaScript library for logging user interactions on webpages.☆18Updated 2 years ago
- A Python utility for indexing file lines. Best demo honourable mention at ECIR 2024.☆19Updated 8 months ago
- An opensource TAR framework for experiments and applications☆16Updated 8 months ago
- The source code for the TIRA Shared Task Platform☆14Updated this week
- Jig for the Open-Source IR Replicability Challenge (OSIRRC)☆13Updated last year
- ☆37Updated 2 years ago
- A toolkit for asynchronously validating dense retriever checkpoints during training.☆27Updated last year
- A Test Collection of Computer Science Papers for Faceted Query by Example☆21Updated 2 years ago
- SIGIR'20: An Analysis of BERT in Document Ranking☆22Updated 4 years ago
- ☆15Updated last month
- A Python interface to PISA☆28Updated last month
- The server component of LogUI, a framework-agnostic JavaScript library for logging user interactions on webpages.☆16Updated 2 years ago
- A clone of indri-5.12 with minor customizations.☆25Updated 2 months ago
- ☆23Updated last year
- An evaluation script based on the C/W/L framework that is TREC Compatible and provides a replacement for TREC_EVAL and independent script…☆15Updated last year
- Information Retrieval Relevance Judging System☆28Updated 2 years ago
- Tools for the TREC CAsT benchmark☆26Updated last year
- TREC-COVID results - this is a mirror of data on the TREC website in a more convenient format.☆14Updated 4 years ago
- A large scale feature extraction tool for text-based machine learning☆31Updated 2 years ago
- ☆13Updated this week