Benchmarking Open-Ended Inference Optimization by AI Agents
☆47Jul 6, 2026Updated 2 months ago
Alternatives and similar repositories for InferenceBench
Users that are interested in InferenceBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Agent Skills Enable a New Class of Realistic and Trivially Simple Prompt Injections☆23Jul 2, 2026Updated 3 months ago
- ☆13Jun 18, 2024Updated 2 years ago
- Python package for serving a local search engine. One command to download and serve a datastore---that's it 😎.☆26Jun 6, 2025Updated last year
- ☆51Updated this week
- Estimate MFU for DeepSeekV3☆26Jan 5, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆580Updated this week
- A certifier for bias in LLMs☆25Apr 11, 2025Updated last year
- Decomposing and measuring evaluation awareness in existing benchmarks and our proposed EvalAwareBench.☆20Updated this week
- Training terminal-agents☆317Sep 20, 2026Updated last week
- Terminal-Bench 2.1☆120Sep 19, 2026Updated last week
- Simple template for quick prototyping and standardization of deep learning projects☆11Dec 29, 2023Updated 2 years ago
- ☆49Oct 1, 2024Updated 2 years ago
- Benchmark SGLang on SLURM☆24Apr 20, 2026Updated 5 months ago
- An evaluation suite for Retrieval-Augmented Generation (RAG).☆25Apr 26, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Measuring and evolving with the frontier of agent work☆834Updated this week
- ☆21Jun 12, 2026Updated 3 months ago
- A research workbench for developing and testing attacks against large language models, with a focus on prompt injection vulnerabilities a…☆62Jul 24, 2026Updated 2 months ago
- A collection of judges for evaluating LLM model output for safety & toxicity with a standardized API.☆16Jan 7, 2026Updated 8 months ago
- ☆120Updated this week
- Code for the paper "Harnessing Discrete Representations for Continual Reinforcement Learning"☆16Jun 16, 2024Updated 2 years ago
- Accelerating Transfer Learning with Robust Neural Nets☆11Oct 2, 2020Updated 6 years ago
- Official Repo of CudaForge☆90Dec 2, 2025Updated 10 months ago
- Code for "Evaluating Spatial Understanding of Large Language Models" TMLR 2024.☆16Feb 22, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Convert GitHub PRs into Harbor tasks☆89Jul 13, 2026Updated 2 months ago
- context-efficient terminal agent powered by an RLM☆61Feb 7, 2026Updated 7 months ago
- [CHIL 2024] Interpretation of Intracardiac Electrograms Through Textual Representations☆12Sep 4, 2024Updated 2 years ago
- Skill-Inject: Measuring Agent Vulnerability to Skill File Attacks☆99Aug 29, 2026Updated last month
- ACL24☆11Jun 7, 2024Updated 2 years ago
- Minimal Transformer base in JAX. A single backbone for language modelling, diffusion, classification, etc...☆16May 28, 2025Updated last year
- [NeurIPS 2025 spotlight] Mitigating the AI Safety Impact of Multi-Agent Scaffolds☆20Sep 22, 2025Updated last year
- ☆16Dec 9, 2023Updated 2 years ago
- Comparison of gradient estimation techniques for black-box adversarial examples☆11Oct 31, 2018Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A curated list of awesome Harbor ecosystem projects☆54May 29, 2026Updated 4 months ago
- Tinkering RL☆29Updated this week
- ☆17Apr 11, 2025Updated last year
- Code companion for the RL Post-Training Handbook - training reasoning models on a single GPU☆20Jan 30, 2026Updated 8 months ago
- ☆19Apr 28, 2024Updated 2 years ago
- Code and data for NAACL 2025 paper "IHEval: Evaluating Language Models on Following the Instruction Hierarchy"☆18Feb 25, 2025Updated last year
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆146May 6, 2026Updated 4 months ago