Alternatives and similar repositories for arc-agi-benchmarking

Users that are interested in arc-agi-benchmarking are comparing it to the libraries listed below

• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆154Updated 2 months ago
• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆207Updated this week
• ekinakyurek / marc
  Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"
  ☆318Updated 7 months ago
• aidanmclaughlin / AidanBench
  Aidan Bench attempts to measure <big_model_smell> in LLMs.
  ☆306Updated 2 weeks ago
• jerber / lang-jepa
  ☆115Updated 6 months ago
• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆447Updated 9 months ago
• open-thought / reasoning-gym
  procedural reasoning datasets
  ☆938Updated last week
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆173Updated 6 months ago
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]
  ☆498Updated 2 months ago
• NousResearch / atropos
  Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …
  ☆535Updated this week
• PrimeIntellect-ai / prime-rl
  prime-rl is a codebase for decentralized async RL training at scale
  ☆368Updated this week
• arcprize / ARC-AGI-2
  ☆363Updated last month
• PrimeIntellect-ai / genesys
  ☆128Updated 3 months ago
• anthropic-experimental / agentic-misalignment
  ☆261Updated 3 weeks ago
• simple-bench / SimpleBench
  ☆132Updated 6 months ago
• rgreenblatt / arc_draw_more_samples_pub
  Draw more samples
  ☆192Updated last year
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆107Updated 2 months ago
• emergent-misalignment / emergent-misalignment
  ☆168Updated 4 months ago
• xjdr-alt / entropix-local
  smol models are fun too
  ☆93Updated 8 months ago
• doomslide / hyperobject
  Plotting (entropy, varentropy) for small LMs
  ☆97Updated last month
• METR / public-tasks
  ☆99Updated 4 months ago
• SWE-bench / SWE-smith
  Scaling Data for SWE-agents
  ☆293Updated this week
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆250Updated last week
• hijohnnylin / neuronpedia
  open source interpretability platform 🧠
  ☆293Updated this week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆173Updated 4 months ago
• magicproduct / hash-hop
  Long context evaluation for large language models
  ☆220Updated 4 months ago
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆223Updated 7 months ago
• pyember / ember
  ☆187Updated 3 weeks ago
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆314Updated 8 months ago
• google-deepmind / mishax
  ☆134Updated 3 months ago