Alternatives and similar repositories for SimpleBench

Users that are interested in SimpleBench are comparing it to the libraries listed below

• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆450Updated 11 months ago
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆146Updated 6 months ago
• aidanmclaughlin / AidanBench
  Aidan Bench attempts to measure <big_model_smell> in LLMs.
  ☆313Updated 2 months ago
• EQ-bench / EQ-Bench
  A benchmark for emotional intelligence in large language models
  ☆356Updated last year
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆172Updated 8 months ago
• arcprize / arc-agi-benchmarking
  Testing baseline LLMs performance across various models
  ☆307Updated last month
• QuixiAI / OpenChatML
  ☆161Updated last month
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆127Updated 4 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆217Updated last year
• xjdr-alt / entropix-local
  smol models are fun too
  ☆93Updated 10 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆106Updated 6 months ago
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆172Updated this week
• javirandor / anthropic-tokenizer
  Approximation of the Claude 3 tokenizer by inspecting generation stream
  ☆140Updated last year
• Danau5tin / calculator_agent_rl
  Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.
  ☆49Updated 4 months ago
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆297Updated 2 weeks ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• magicproduct / hash-hop
  Long context evaluation for large language models
  ☆221Updated 6 months ago
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆315Updated this week
• GoodAI / goodai-ltm-benchmark
  A library for benchmarking the Long Term Memory and Continual learning capabilities of LLM based agents. With all the tests and code you…
  ☆78Updated 9 months ago
• harishsg993010 / LLM-Research-Scripts
  ☆433Updated 11 months ago
• willccbb / claude-deep-research
  Claude Deep Research config for Claude Code.
  ☆214Updated 6 months ago
• adobe-research / NoLiMa
  Official repository for "NoLiMa: Long-Context Evaluation Beyond Literal Matching"
  ☆152Updated 2 months ago
• microsoft / GRIN-MoE
  GRadient-INformed MoE
  ☆264Updated 11 months ago
• PrimeIntellect-ai / genesys
  ☆133Updated 5 months ago
• Royaltyprogram / Crux
  The State Of The Art, intelligence
  ☆152Updated last month
• rgreenblatt / arc_draw_more_samples_pub
  Draw more samples
  ☆193Updated last year
• jerber / lang-jepa
  ☆120Updated 8 months ago
• symflower / eval-dev-quality
  DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
  ☆179Updated 4 months ago
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆179Updated 8 months ago
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆222Updated last year