allenai / olmes
Reproducible, flexible LLM evaluations
☆19Updated this week
Related projects ⓘ
Alternatives and complementary repositories for olmes
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆46Updated 2 months ago
- Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)☆25Updated 4 months ago
- Understanding the correlation between different LLM benchmarks☆29Updated 10 months ago
- LLM training in simple, raw C/CUDA☆12Updated last month
- Q-Probe: A Lightweight Approach to Reward Maximization for Language Models☆37Updated 5 months ago
- Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)☆12Updated last month
- ☆41Updated 2 weeks ago
- ☆55Updated last month
- PyTorch building blocks for OLMo☆18Updated this week
- ☆39Updated 10 months ago
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆30Updated 9 months ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆37Updated 7 months ago
- Code for NeurIPS LLM Efficiency Challenge☆54Updated 7 months ago
- ☆16Updated last month
- ☆36Updated 3 months ago
- ☆24Updated last year
- Collection of autoregressive model implementation☆67Updated this week
- Tree prompting: easy-to-use scikit-learn interface for improved prompting.☆33Updated last year
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆78Updated 8 months ago
- ☆68Updated 3 months ago
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆14Updated last year
- The repository contains code for Adaptive Data Optimization☆18Updated last month
- Using FlexAttention to compute attention with different masking patterns☆40Updated 2 months ago
- ☆49Updated 6 months ago
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆24Updated 3 weeks ago
- Codebase accompanying the Summary of a Haystack paper.☆72Updated 2 months ago
- A Data Source for Reasoning Embodied Agents☆19Updated last year
- DPO, but faster 🚀☆23Updated 3 weeks ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆44Updated 10 months ago