allenai / SciRIFF
Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
☆38Updated 3 weeks ago
Alternatives and similar repositories for SciRIFF:
Users that are interested in SciRIFF are comparing it to the libraries listed below
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆79Updated 4 months ago
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 2 months ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆19Updated 2 months ago
- Implementation of "SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models"☆27Updated 2 months ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆48Updated last year
- Exploration of automated dataset selection approaches at large scales.☆37Updated last month
- Code/data for MARG (multi-agent review generation)☆42Updated 5 months ago
- Few-shot Learning with Auxiliary Data☆27Updated last year
- ☆39Updated 2 years ago
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆35Updated last month
- ☆41Updated 8 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆47Updated last year
- ☆17Updated 6 months ago
- Tasks for describing differences between text distributions.☆16Updated 8 months ago
- ☆21Updated 6 months ago
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆41Updated 4 months ago
- ☆34Updated last year
- OpenPI dataset for tracking entities in open domain procedural text☆22Updated 8 months ago
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆39Updated 5 months ago
- Repository for "Attribute First, then Generate: Locally-attributable Grounded Text Generation", ACL 2024☆29Updated 3 months ago
- This repository contains ScholarQABench data and evaluation pipeline.☆70Updated 2 months ago
- IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…☆31Updated 10 months ago
- ☆69Updated last year
- [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"☆34Updated 4 months ago
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆36Updated 3 months ago
- [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation☆47Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 7 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆72Updated 7 months ago
- Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)☆45Updated 2 months ago
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions☆42Updated 9 months ago