Benchmarking Open-Ended Inference Optimization by AI Agents
☆47Jul 6, 2026Updated 3 months ago
Alternatives and similar repositories for InferenceBench
Users that are interested in InferenceBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Phi-Bench (Φ-Bench): 85 open-source LLM-infrastructure engineering tasks for frontier LLMs & coding agents (KFC/LH/E2E). Self-contained p…☆69Oct 13, 2026Updated last week
- Agent Skills Enable a New Class of Realistic and Trivially Simple Prompt Injections☆23Jul 2, 2026Updated 3 months ago
- SWE-Serve: an agentic benchmark of 53 production inference-engineering tasks derived from merged SGLang pull requests, run with Harbor.☆19Oct 9, 2026Updated 2 weeks ago
- ☆18Jun 19, 2026Updated 4 months ago
- ☆52Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Training terminal-agents☆324Sep 20, 2026Updated last month
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆602Oct 2, 2026Updated 3 weeks ago
- ☆25Jun 18, 2026Updated 4 months ago
- ☆32Oct 7, 2026Updated 2 weeks ago
- A small plugin for Claude Code and Codex to optimize PyTorch workloads.☆39Sep 30, 2026Updated 3 weeks ago
- Python package for serving a local search engine. One command to download and serve a datastore---that's it 😎.☆26Jun 6, 2025Updated last year
- ☆23Updated this week
- Official Repository for "Training Versatile Coding Agents in Synthetic Environments"☆22Jan 11, 2026Updated 9 months ago
- Rethinking the Evaluation of Harness Evolution for Agents☆44Oct 15, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆57Jun 25, 2026Updated 3 months ago
- ☆21Jul 21, 2026Updated 3 months ago
- Estimate MFU for DeepSeekV3☆26Jan 5, 2025Updated last year
- A Systematic Verification and Structured Revision of Humanity’s Last Exam☆16Feb 27, 2026Updated 7 months ago
- A Top-Down Profiler for GPU Applications☆24Feb 29, 2024Updated 2 years ago
- FORTSearcher: Synthesizing Hard-to-Shortcut Search Tasks for Deep Search Agents☆29Jun 11, 2026Updated 4 months ago
- ☆28May 1, 2026Updated 5 months ago
- Official implementation of WHALE (Weight-Harness Alternating Learning)☆60Sep 15, 2026Updated last month
- ☆57Mar 18, 2026Updated 7 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- An open, visual atlas of looped transformers, recurrent computation, adaptive depth, and latent reasoning.☆33Sep 26, 2026Updated 3 weeks ago
- Building the Virtuous Cycle for AI-driven LLM Systems☆295Sep 25, 2026Updated 3 weeks ago
- ☆21Apr 3, 2026Updated 6 months ago
- ☆20Aug 7, 2025Updated last year
- ☆57Sep 14, 2026Updated last month
- Official eval scripts for JobBench☆64Oct 6, 2026Updated 2 weeks ago
- EdgeBench: Unveiling scaling laws of learning from real-world environments☆468Sep 20, 2026Updated last month
- A light-weight and high-efficient training framework for accelerating diffusion tasks.☆55Sep 24, 2026Updated 3 weeks ago
- ☆36Apr 29, 2026Updated 5 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Decomposing and measuring evaluation awareness in existing benchmarks and our proposed EvalAwareBench.☆20Sep 29, 2026Updated 3 weeks ago
- 🏝️ Code for our paper: "Privasis: Synthesizing the Largest 'Public' Private Dataset from Scratch"☆16Jul 10, 2026Updated 3 months ago
- Simple template for quick prototyping and standardization of deep learning projects☆11Dec 29, 2023Updated 2 years ago
- SPADE: Self-Play in Adaptive Synthetic Executable Environments☆123Aug 26, 2026Updated last month
- Official Implementation of "Multi-View Point Tracking as Geometric Supervision for 4D Video Generation"☆39Jun 25, 2026Updated 3 months ago
- ☆123Oct 6, 2026Updated 2 weeks ago
- ☆38Oct 6, 2026Updated 2 weeks ago