allenai / SciRIFF
Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
☆28Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for SciRIFF
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆61Updated 4 months ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆44Updated last year
- ReBase: Training Task Experts through Retrieval Based Distillation☆27Updated 4 months ago
- ☆68Updated 3 months ago
- ☆46Updated this week
- ☆27Updated 5 months ago
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆36Updated 3 weeks ago
- Embedding Recycling for Language models☆38Updated last year
- ☆19Updated last month
- ☆56Updated 9 months ago
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆78Updated 8 months ago
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆30Updated 3 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆44Updated 10 months ago
- ☆38Updated 7 months ago
- Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty☆68Updated 7 months ago
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions☆40Updated 4 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆46Updated 2 months ago
- Code/data for MARG (multi-agent review generation)☆33Updated last week
- Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval☆38Updated 3 weeks ago
- Discovering Data-driven Hypotheses in the Wild☆41Updated this week
- Codebase accompanying the Summary of a Haystack paper.☆72Updated 2 months ago
- PyTorch implementation for MRL☆18Updated 9 months ago
- This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…☆55Updated last year
- Few-shot Learning with Auxiliary Data☆26Updated 11 months ago
- Tasks for describing differences between text distributions.☆16Updated 3 months ago
- This is the official PyTorch repo for "UNIREX: A Unified Learning Framework for Language Model Rationale Extraction" (ICML 2022).☆23Updated last year
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆48Updated 7 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆41Updated 9 months ago
- DSBench: How Far are Data Science Agents from Becoming Data Science Experts?☆35Updated last month
- ☆21Updated this week