Benchmarking Open-Ended Inference Optimization by AI Agents
☆54Oct 26, 2026Updated 2 weeks ago
Alternatives and similar repositories for InferenceBench
Users that are interested in InferenceBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Agent Skills Enable a New Class of Realistic and Trivially Simple Prompt Injections☆24Jul 2, 2026Updated 4 months ago
- ☆21Oct 4, 2026Updated last month
- ☆17May 21, 2026Updated 5 months ago
- ☆44Aug 21, 2026Updated 2 months ago
- ☆11Oct 29, 2026Updated 2 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- SWE-Serve: an agentic benchmark of 53 production inference-engineering tasks derived from merged SGLang pull requests, run with Harbor.☆24Oct 9, 2026Updated last month
- [ICLR 2026] Monitoring Decomposition Attacks with Lightweight Sequential Monitors☆12Apr 20, 2026Updated 6 months ago
- ☆13Jun 18, 2024Updated 2 years ago
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆620Updated this week
- A Long-Horizon Benchmark for Self-Improving Inference Systems☆157Oct 26, 2026Updated 2 weeks ago
- ☆58Jun 25, 2026Updated 4 months ago
- ☆27Jun 22, 2026Updated 4 months ago
- Building the Virtuous Cycle for AI-driven LLM Systems☆307Sep 25, 2026Updated last month
- ☆26Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Training terminal-agents☆343Nov 2, 2026Updated last week
- Official Repository for "Training Versatile Coding Agents in Synthetic Environments"☆22Jan 11, 2026Updated 10 months ago
- ☆12Sep 23, 2026Updated last month
- ☆18Jun 19, 2026Updated 4 months ago
- Estimate MFU for DeepSeekV3☆26Jan 5, 2025Updated last year
- Python package for serving a local search engine. One command to download and serve a datastore---that's it 😎.☆26Jun 6, 2025Updated last year
- ☆16Jun 4, 2025Updated last year
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)☆1,329Mar 24, 2026Updated 7 months ago
- DeepDialogue: A Multi-Turn Emotionally-Rich Spoken Dialogue Dataset (code for SER Task)☆11May 28, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- AgentX Harness - Realistic 1mil Long Context, Multi Turn Agentic Workload Trace Replayer, collected from over $3mil USD of Traces | Agent…☆44Updated this week
- Official repository for the paper "AlphaForgeBench: Benchmarking End-to-End Trading Strategy Design with Large Language Models".☆21Jun 26, 2026Updated 4 months ago
- ☆58Mar 18, 2026Updated 7 months ago
- ☆21Apr 3, 2026Updated 7 months ago
- [EMNLP 2026 Oral] An official implementation of "OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal L…☆64Oct 22, 2026Updated 3 weeks ago
- Science's Last Exam☆21Updated this week
- ☆29May 1, 2026Updated 6 months ago
- ☆15Sep 22, 2025Updated last year
- Rethinking the Evaluation of Harness Evolution for Agents☆50Oct 15, 2026Updated 3 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Official Repository for Frame Representation Hypothesis paper☆10Oct 26, 2026Updated 2 weeks ago
- I seek to draw from the philosophies embedded in AI research to inspire deeper reflection on life — exploring how the principles that gui…☆13Aug 11, 2025Updated last year
- [COLM-LLA 2026] The official implementation for paper "AdaExplore: Failure-Driven Adaptation and Diversity-Preserving Search for Efficien…☆24Aug 23, 2026Updated 2 months ago
- Code Repo for paper: EurekaBench: Measuring Agentic Ability to Discover New Scientific Insights☆37Oct 2, 2026Updated last month
- Code for 'Answer Matching Outperforms Multiple Choice for Language Model Evaluation' paper☆20Jul 4, 2025Updated last year
- ☆19Oct 31, 2026Updated last week
- ☆13Mar 27, 2026Updated 7 months ago
Are these results useful?