capreolus-ir / diffir
Tool for comparing two ranked lists (TREC run files)
☆20Updated 2 years ago
Alternatives and similar repositories for diffir:
Users that are interested in diffir are comparing it to the libraries listed below
- Code for the ECIR'22 paper "Evaluating the Robustness of Retrieval Pipelines with Query Variation Generators"☆15Updated 3 years ago
- ☆13Updated 3 weeks ago
- A Python interface to PISA☆29Updated 3 weeks ago
- Fusion for TREC run files with popular fusion techniques☆21Updated 2 years ago
- ☆28Updated 5 months ago
- The source code for the TIRA Shared Task Platform☆14Updated this week
- Information Retrieval Relevance Judging System☆28Updated 3 years ago
- An evaluation script based on the C/W/L framework that is TREC Compatible and provides a replacement for TREC_EVAL and independent script…☆15Updated last year
- A Python utility for indexing file lines. Best demo honourable mention at ECIR 2024.☆20Updated last year
- A wrapper on trec_eval☆9Updated 5 months ago
- A Python Interface to Reproducibility Measures of System-Oriented IR Experiments☆11Updated 3 years ago
- HiCAL is a system for efficient high-recall retrieval with an adaptable assessing interface.☆37Updated 2 years ago
- Jig for the Open-Source IR Replicability Challenge (OSIRRC)☆13Updated 2 years ago
- A toolkit for end-to-end neural ad hoc retrieval☆95Updated 6 months ago
- A toolkit for asynchronously validating dense retriever checkpoints during training.☆27Updated last year
- A toolkit for simulating interactive information retrieval☆20Updated 6 years ago
- Tools for the TREC CAsT benchmark☆28Updated 2 years ago
- Toolkit for domain-specific information retrieval experimentation☆18Updated 9 months ago
- ↕️ Intuitive axiomatic retrieval experimentation.☆24Updated this week
- IR module for experimaestro☆11Updated this week
- A large scale feature extraction tool for text-based machine learning☆32Updated 2 years ago
- CODEC is a document and entity ranking dataset that focuses on complex essay-style topics.☆17Updated 3 months ago
- A Test Collection of Computer Science Papers for Faceted Query by Example☆21Updated 3 years ago
- Deep Learning Hard (DL-HARD) is a new annotated dataset extending TREC Deep Learning benchmark.☆36Updated 3 years ago
- One-stop shop for running and fine-tuning transformer-based language models for retrieval☆49Updated last week
- provides a common interface to many IR measure tools☆82Updated 2 weeks ago
- A Benchmark Workflow and Dataset Collection for Query Refinement☆25Updated last year
- ☆23Updated last year
- A clone of indri-5.12 with minor customizations.☆25Updated 5 months ago
- An end-to-end neural ad-hoc ranking pipeline.☆150Updated 10 months ago