allenai / SciRIFFLinks
Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
☆40Updated 3 months ago
Alternatives and similar repositories for SciRIFF
Users that are interested in SciRIFF are comparing it to the libraries listed below
Sorting:
- ☆35Updated 2 years ago
- [ICLR'25] "Attention in Large Language Models Yields Efficient Zero-Shot Re-Rankers"☆22Updated 2 months ago
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 4 months ago
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆89Updated 6 months ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆48Updated last year
- Few-shot Learning with Auxiliary Data☆28Updated last year
- Aioli: A unified optimization framework for language model data mixing☆27Updated 5 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆57Updated 9 months ago
- ☆38Updated last year
- ☆45Updated 10 months ago
- 🌾 Universal, customizable and deployable fine-grained evaluation for text generation.☆23Updated last year
- Repository for "Attribute First, then Generate: Locally-attributable Grounded Text Generation", ACL 2024☆29Updated 6 months ago
- Embedding Recycling for Language models☆38Updated last year
- Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval☆14Updated last year
- [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"☆33Updated 6 months ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆21Updated 4 months ago
- ☆71Updated last year
- ☆44Updated 7 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated 10 months ago
- Exploration of automated dataset selection approaches at large scales.☆45Updated 3 months ago
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆43Updated 6 months ago
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆37Updated 5 months ago
- This repository contains ScholarQABench data and evaluation pipeline.☆72Updated 2 months ago
- Python package for serving a local search engine. One command to download and serve a datastore---that's it 😎.☆21Updated 2 weeks ago
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆84Updated 10 months ago
- IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…☆32Updated last year
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions☆44Updated 11 months ago
- Code/data for MARG (multi-agent review generation)☆44Updated 7 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆129Updated last year
- Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"☆28Updated 3 years ago