☆219Dec 20, 2024Updated last year
Alternatives and similar repositories for SimpleBench
Users that are interested in SimpleBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆137May 2, 2025Updated last year
- Rank-LLMs is a CLI tool for evaluating local LLMs via Ollama.☆11Jul 5, 2026Updated 3 months ago
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆93Dec 9, 2025Updated 10 months ago
- LiveBench: A Challenging, Contamination-Free LLM Benchmark☆1,350Oct 18, 2026Updated last week
- utilities for batched llm calls with retries☆54Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Public repository for the Remote Labor Index (RLI)☆81Nov 3, 2025Updated 11 months ago
- PyTorch code for System-1.x: Learning to Balance Fast and Slow Planning with Language Models☆26Jul 22, 2024Updated 2 years ago
- Common Voice Generator using Speech Synthesizer☆14Jul 28, 2021Updated 5 years ago
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆74Apr 16, 2026Updated 6 months ago
- Aidan Bench attempts to measure <big_model_smell> in LLMs.☆321Jun 26, 2025Updated last year
- ☆11Jun 12, 2025Updated last year
- Train your own SOTA deductive reasoning model☆111Mar 6, 2025Updated last year
- Code and data for the paper "Understanding Hidden Context in Preference Learning: Consequences for RLHF"☆28Aug 21, 2024Updated 2 years ago
- world's stupidest moe llm in 103M parameters☆20Jul 18, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- FamilyBench evaluation tool for testing the relational reasoning capabilities of Large Language Models (LLMs).☆46Sep 3, 2026Updated last month
- Coding problems used in aider's polyglot benchmark☆225Dec 22, 2024Updated last year
- SVGBench: A challenging LLM benchmark that tests knowledge, coding, physical reasoning capabilities of LLMs.☆81Feb 12, 2026Updated 8 months ago
- Sandboxed tools and JS runtime for AI agents☆18Jul 13, 2026Updated 3 months ago
- Adversarial multi-turn benchmark for LLM debate quality, using side-swapped matchups and multi-model judging to rank models by judged deb…☆38Updated this week
- slack status, without the slack☆13Aug 9, 2026Updated 2 months ago
- Analysis code for Neurips 2025 paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"☆57Aug 6, 2025Updated last year
- PIBench is an open-source benchmark for evaluating AI coding agents on realistic, end-to-end payment integration tasks.☆27Aug 6, 2026Updated 2 months ago
- Evaluating LLMs with CommonGen-Lite☆94Mar 21, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Drift detection module for machine learning pipelines.☆25Jun 21, 2023Updated 3 years ago
- Clue inspired puzzles for testing LLM deduction abilities☆48Mar 19, 2026Updated 7 months ago
- LLM public goods game☆11Feb 22, 2025Updated last year
- A benchmark for emotional intelligence in large language models☆466Jul 26, 2024Updated 2 years ago
- Universal Q&A database tool☆10Mar 10, 2024Updated 2 years ago
- BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution☆63Oct 13, 2025Updated last year
- ☆30Oct 23, 2026Updated last week
- Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents☆3,322Oct 23, 2026Updated last week
- ☆13Oct 23, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Frontend (and soon also midleware and backend) for a new, opensource image generation platform.☆14Nov 5, 2022Updated 3 years ago
- Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.☆250Aug 7, 2025Updated last year
- Public Goods Game (PGG) Benchmark: Contribute & Punish is a multi-agent benchmark that tests cooperative and self-interested strategies a…☆43Apr 10, 2025Updated last year
- Scalable toolkit for efficient model reinforcement☆13Oct 22, 2026Updated last week
- Slipstream is a syncing and ingestion pipeline for atproto, built on Cloudflare.☆13Mar 11, 2026Updated 7 months ago
- ☆84Mar 11, 2025Updated last year
- Thermodynamics-informed symbolic regression☆15Jan 11, 2026Updated 9 months ago