allenai / SciRIFFLinks
Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
☆44Updated 8 months ago
Alternatives and similar repositories for SciRIFF
Users that are interested in SciRIFF are comparing it to the libraries listed below
Sorting:
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆101Updated 11 months ago
- Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty☆87Updated last year
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 9 months ago
- Aioli: A unified optimization framework for language model data mixing☆28Updated 10 months ago
- ☆74Updated last year
- Discovering Data-driven Hypotheses in the Wild☆117Updated 5 months ago
- Evaluating LLMs with fewer examples☆167Updated last year
- LangCode - Improving alignment and reasoning of large language models (LLMs) with natural language embedded program (NLEP).☆47Updated 2 years ago
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions☆49Updated last year
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆91Updated last year
- ☆29Updated last year
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆86Updated last year
- Code of ICLR paper: https://openreview.net/forum?id=-cqvvvb-NkI☆95Updated 2 years ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆135Updated last year
- Pretraining Efficiently on S2ORC!☆172Updated last year
- ☆49Updated 7 months ago
- ☆81Updated this week
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- ☆58Updated last year
- ☆156Updated last year
- This repository contains ScholarQABench data and evaluation pipeline.☆85Updated 3 months ago
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆42Updated last year
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆82Updated last year
- EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…☆27Updated 11 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- ☆44Updated last year
- ☆23Updated 3 weeks ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- Finding semantically meaningful and accurate prompts.☆48Updated 2 years ago
- Code and Data for "Language Modeling with Editable External Knowledge"☆36Updated last year