arcprize / arc-agi-benchmarkingLinks
Testing baseline LLMs performance across various models
☆268Updated this week
Alternatives and similar repositories for arc-agi-benchmarking
Users that are interested in arc-agi-benchmarking are comparing it to the libraries listed below
Sorting:
- Open source interpretability artefacts for R1.☆138Updated last month
- ☆111Updated 5 months ago
- ⚖️ Awesome LLM Judges ⚖️☆103Updated last month
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆169Updated this week
- ☆274Updated last week
- Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"☆309Updated 6 months ago
- Draw more samples☆190Updated 11 months ago
- Plotting (entropy, varentropy) for small LMs☆96Updated last week
- Our solution for the arc challenge 2024☆141Updated 3 months ago
- prime-rl is a codebase for decentralized async RL training at scale☆311Updated this week
- Darwin Gödel Machine: Open-Ended Evolution of Self-Improving Agents☆349Updated this week
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆171Updated 4 months ago
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆443Updated 8 months ago
- Aidan Bench attempts to measure <big_model_smell> in LLMs.☆299Updated last month
- Scale your LLM-as-a-judge.☆232Updated last week
- Implementation of the board game Codenames, re-imagined as a collaborative game between LLM agents☆107Updated 3 months ago
- Simple Transformer in Jax☆137Updated 11 months ago
- explore token trajectory trees on instruct and base models☆122Updated this week
- procedural reasoning datasets☆625Updated this week
- smolLM with Entropix sampler on pytorch☆150Updated 7 months ago
- Evaluation of LLMs on latest math competitions☆129Updated 2 weeks ago
- ☆54Updated 3 months ago
- Long context evaluation for large language models☆211Updated 2 months ago
- Scaling Data for SWE-agents☆212Updated this week
- The history files when recording human interaction while solving ARC tasks☆110Updated last week
- ☆126Updated 2 months ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆333Updated 5 months ago
- smol models are fun too☆92Updated 6 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆173Updated 2 months ago
- Build your own visual reasoning model☆370Updated this week