allenai / SciRIFFLinks
Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
☆40Updated 2 months ago
Alternatives and similar repositories for SciRIFF
Users that are interested in SciRIFF are comparing it to the libraries listed below
Sorting:
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 3 months ago
- Exploration of automated dataset selection approaches at large scales.☆41Updated 3 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆57Updated 9 months ago
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆43Updated 6 months ago
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆40Updated 7 months ago
- [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"☆33Updated 5 months ago
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆36Updated 3 months ago
- ☆35Updated 2 years ago
- ☆38Updated last year
- Python package for serving a local search engine. One command to download and serve a datastore---that's it 😎.☆14Updated 3 weeks ago
- Official implementation of "BERTs are Generative In-Context Learners"☆28Updated 2 months ago
- Aioli: A unified optimization framework for language model data mixing☆25Updated 4 months ago
- Embedding Recycling for Language models☆38Updated last year
- ☆42Updated 2 months ago
- Repository for "Attribute First, then Generate: Locally-attributable Grounded Text Generation", ACL 2024☆29Updated 5 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆47Updated last year
- ☆17Updated last month
- ☆24Updated last year
- Benchmarking Benchmark Leakage in Large Language Models☆51Updated last year
- 🌾 Universal, customizable and deployable fine-grained evaluation for text generation.☆23Updated last year
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆84Updated 9 months ago
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆84Updated last year
- ☆45Updated 9 months ago
- Evaluate the Quality of Critique☆35Updated last year
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆54Updated last year
- Discovering Data-driven Hypotheses in the Wild☆85Updated 6 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated 9 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions☆44Updated 11 months ago
- Few-shot Learning with Auxiliary Data☆28Updated last year