TREMA-UNH / rubric-grading-workbench
A Workbench for Autograding Retrieve/Generate Systems
☆14Updated 4 months ago
Alternatives and similar repositories for rubric-grading-workbench:
Users that are interested in rubric-grading-workbench are comparing it to the libraries listed below
- Retrieval-Augmented Generation battle!☆48Updated 2 months ago
- Dense hybrid representations for text retrieval☆62Updated last year
- One-stop shop for running and fine-tuning transformer-based language models for retrieval☆49Updated this week
- ☆45Updated last year
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆46Updated last year
- ☆42Updated 9 months ago
- 🌾 Universal, customizable and deployable fine-grained evaluation for text generation.☆22Updated last year
- Code and dataset for the emnlp paper titled Instruct and Extract: Instruction Tuning for On-Demand Information Extraction☆49Updated last year
- Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval☆43Updated 4 months ago
- A Human-LLM Collaborative Dataset for Generative Information-seeking with Attribution☆30Updated last year
- ☆38Updated 2 months ago
- An easy-to-use python toolkit for flexibly adapting various neural ranking models to target domain.☆59Updated last year
- ☆29Updated last year
- A toolkit for asynchronously validating dense retriever checkpoints during training.☆27Updated last year
- ☆16Updated 3 years ago
- PyTorch code for "FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization" (NAACL 2022)☆38Updated 2 years ago
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆41Updated last year
- Code and pre-trained models for "ReasonBert: Pre-trained to Reason with Distant Supervision", EMNLP'2021☆29Updated 2 years ago
- Mr. TyDi is a multi-lingual benchmark dataset built on TyDi, covering eleven typologically diverse languages.☆74Updated 3 years ago
- Resources for the shared task on conversational question answering SCAI-QReCC 2021☆27Updated 2 years ago
- Efficient Memory-Augmented Transformers☆34Updated 2 years ago
- Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…☆43Updated 7 months ago
- INCOME: An Easy Repository for Training and Evaluation of Index Compression Methods in Dense Retrieval. Includes BPR and JPQ.☆22Updated last year
- Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"☆59Updated last month
- ☆40Updated last month
- ☆54Updated 2 years ago
- ☆28Updated last year
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆18Updated last month
- ☆45Updated 2 years ago
- Companion repo for "Evaluating Verifiability in Generative Search Engines".☆83Updated last year