Alternatives and similar repositories for SimpleBench

Users that are interested in SimpleBench are comparing it to the libraries listed below

• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆452Updated last year
• EQ-bench / EQ-Bench
  A benchmark for emotional intelligence in large language models
  ☆389Updated last year
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆173Updated 10 months ago
• arcprize / arc-agi-benchmarking
  Testing baseline LLMs performance across various models
  ☆325Updated last week
• aidanmclaughlin / AidanBench
  Aidan Bench attempts to measure <big_model_smell> in LLMs.
  ☆315Updated 5 months ago
• poetiq-ai / poetiq-arc-agi-solver
  This repository allows reproduction of Poetiq's record-breaking submission to the ARC-AGI-1 and ARC-AGI-2 benchmarks.
  ☆366Updated this week
• METR / public-tasks
  ☆108Updated 2 weeks ago
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆314Updated last month
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆146Updated 9 months ago
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆140Updated 8 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆234Updated last year
• symflower / eval-dev-quality
  DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
  ☆182Updated 6 months ago
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆194Updated 11 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• alexzhang13 / rlm
  Super basic implementation (gist-like) of RLMs with REPL environments.
  ☆278Updated last month
• PrimeIntellect-ai / genesys
  ☆136Updated 8 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆107Updated 9 months ago
• QuixiAI / OpenChatML
  ☆164Updated 4 months ago
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆382Updated this week
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆134Updated 7 months ago
• jerber / lang-jepa
  ☆129Updated 11 months ago
• harishsg993010 / LLM-Research-Scripts
  ☆434Updated last year
• ScalingIntelligence / codemonkeys
  ☆59Updated 10 months ago
• doomslide / hyperobject
  Plotting (entropy, varentropy) for small LMs
  ☆99Updated 6 months ago
• xjdr-alt / entropix-local
  smol models are fun too
  ☆92Updated last year
• SinatrasC / entropix-smollm
  smolLM with Entropix sampler on pytorch
  ☆149Updated last year
• PrimeIntellect-ai / prime-environments
  Training-Ready RL Environments + Evals
  ☆185Updated this week
• GoodAI / goodai-ltm-benchmark
  A library for benchmarking the Long Term Memory and Continual learning capabilities of LLM based agents. With all the tests and code you…
  ☆81Updated 11 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆226Updated last year
• rgreenblatt / arc_draw_more_samples_pub
  Draw more samples
  ☆195Updated last year