arcprize / model_baseline
Testing baseline LLMs performance across various models
☆257Updated last week
Alternatives and similar repositories for model_baseline:
Users that are interested in model_baseline are comparing it to the libraries listed below
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆139Updated this week
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym☆438Updated 3 weeks ago
- ☆108Updated 4 months ago
- Verdict is a library for scaling judge-time compute.☆199Updated last week
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆432Updated 6 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆171Updated 3 months ago
- ⚖️ Awesome LLM Judges ⚖️☆93Updated 2 months ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆320Updated 4 months ago
- procedural reasoning datasets☆571Updated this week
- Aidan Bench attempts to measure <big_model_smell> in LLMs.☆291Updated this week
- Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"☆304Updated 5 months ago
- Open source interpretability artefacts for R1.☆82Updated this week
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆187Updated 4 months ago
- ☆128Updated 3 weeks ago
- ☆97Updated 6 months ago
- ☆122Updated last month
- Long context evaluation for large language models☆207Updated last month
- ☆145Updated last month
- Build your own visual reasoning model☆341Updated this week
- Draw more samples☆189Updated 10 months ago
- ☆144Updated last month
- ☆519Updated last week
- ☆137Updated last month
- ☆220Updated last week
- OpenPipe ART (Agent Reinforcement Trainer): train LLM agents☆108Updated this week
- Pretraining code for a large-scale depth-recurrent language model☆745Updated last week
- System 2 Reasoning Link Collection☆826Updated last month
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆170Updated last month
- smol models are fun too☆92Updated 5 months ago
- MLGym A New Framework and Benchmark for Advancing AI Research Agents☆484Updated 2 weeks ago