ireval / cwlLinks
An evaluation script based on the C/W/L framework that is TREC Compatible and provides a replacement for TREC_EVAL and independent scripts for INST, RBP, TBG and U-Measure, etc. All measurements are reported in the same units making all metrics directly comparable.
☆15Updated 2 years ago
Alternatives and similar repositories for cwl
Users that are interested in cwl are comparing it to the libraries listed below
Sorting:
- Code for the ECIR'22 paper "Evaluating the Robustness of Retrieval Pipelines with Query Variation Generators"☆15Updated 3 years ago
- Fusion for TREC run files with popular fusion techniques☆21Updated 2 years ago
- A large scale feature extraction tool for text-based machine learning☆32Updated 2 years ago
- Tool for comparing two ranked lists (TREC run files)☆20Updated 2 years ago
- Source code for: On the Effect of Low-Frequency Terms on Neural-IR Models, SIGIR'19☆46Updated 6 years ago
- A Benchmark Workflow and Dataset Collection for Query Refinement☆25Updated 2 years ago
- A toolkit for end-to-end neural ad hoc retrieval☆96Updated 10 months ago
- SIGIR'20: An Analysis of BERT in Document Ranking☆21Updated 4 years ago
- A Test Collection of Computer Science Papers for Faceted Query by Example☆21Updated 3 years ago
- ☆34Updated 4 years ago
- HiCAL is a system for efficient high-recall retrieval with an adaptable assessing interface.☆37Updated 2 years ago
- Jig for the Open-Source IR Replicability Challenge (OSIRRC)☆13Updated 2 years ago
- A toolkit for simulating interactive information retrieval☆21Updated 6 years ago
- scripts to download and standardize trec query and document sets☆48Updated 5 years ago
- ↕️ Intuitive axiomatic retrieval experimentation.☆26Updated last week
- Information Retrieval Relevance Judging System☆29Updated 3 years ago
- My most frequently used learning-to-rank algorithms ported to rust for efficiency. Try it: "pip install fastrank".☆52Updated 3 months ago
- Meta-Analysis of Robust04 Papers (Yang et al., SIGIR 2019)☆12Updated 6 years ago
- WSDM2021 Tutorial: Beyond Probability Ranking Principle: Modeling the Dependencies among Documents☆24Updated 4 years ago
- ☆38Updated 2 years ago
- A collection of product search embedding models☆19Updated 5 years ago
- Tools for the TREC CAsT benchmark☆28Updated 2 years ago
- A wrapper on trec_eval☆9Updated 8 months ago
- Qulac: A dataset on asking Questions for Lack of Clarity in open-domain information-seeking conversations.☆75Updated 3 years ago
- Standalone Neural Ranking Model (SNRM)☆76Updated 6 years ago
- Knowledge graph based information retrieval☆13Updated 6 years ago
- A Python interface to PISA☆36Updated last week
- A clone of indri-5.12 with minor customizations.☆25Updated 9 months ago
- Implementation of Hierarchical Neural maTching model proposed in SIGIR'18 for ad-hoc retrieval☆22Updated 7 years ago
- Submission archive for the MS MARCO document ranking leaderboard☆30Updated last year