Benchmarking Open-Ended Inference Optimization by AI Agents
β34Jul 6, 2026Updated 3 weeks ago
Alternatives and similar repositories for InferenceBench
Users that are interested in InferenceBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- β13Jun 18, 2024Updated 2 years ago
- Python package for serving a local search engine. One command to download and serve a datastore---that's it π.β26Jun 6, 2025Updated last year
- β42Jul 15, 2026Updated 2 weeks ago
- Estimate MFU for DeepSeekV3β26Jan 5, 2025Updated last year
- A Top-Down Profiler for GPU Applicationsβ23Feb 29, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hoursβ484Jul 22, 2026Updated last week
- β20Jun 18, 2026Updated last month
- A Difficulty-Calibrated Benchmark for Building Terminal Agentsβ29Feb 20, 2026Updated 5 months ago
- Training terminal-agentsβ260Jul 22, 2026Updated last week
- Decomposing and measuring evaluation awareness in existing benchmarks and our proposed EvalAwareBench.β19Jun 1, 2026Updated 2 months ago
- Terminal-Bench 2.1β63Jul 22, 2026Updated last week
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scalingβ34Updated this week
- Simple template for quick prototyping and standardization of deep learning projectsβ11Dec 29, 2023Updated 2 years ago
- β14Aug 9, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- β48Oct 1, 2024Updated last year
- Official eval scripts for JobBenchβ35Jul 18, 2026Updated 2 weeks ago
- Benchmark SGLang on SLURMβ24Apr 20, 2026Updated 3 months ago
- An evaluation suite for Retrieval-Augmented Generation (RAG).β25Apr 26, 2025Updated last year
- Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"β22Sep 21, 2025Updated 10 months ago
- Official implementation of the ΞBelief-RL method.β31Feb 28, 2026Updated 5 months ago
- A research workbench for developing and testing attacks against large language models, with a focus on prompt injection vulnerabilities aβ¦β58Jul 24, 2026Updated last week
- A collection of judges for evaluating LLM model output for safety & toxicity with a standardized API.β16Jan 7, 2026Updated 6 months ago
- Official implementation of Our NeurIPS 2024 Paper "Boundary Matters: A Bi-Level Active Finetuning Method"β14Feb 11, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform β’ AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- β81Updated this week
- Code for the paper "Harnessing Discrete Representations for Continual Reinforcement Learning"β16Jun 16, 2024Updated 2 years ago
- Accelerating Transfer Learning with Robust Neural Netsβ11Oct 2, 2020Updated 5 years ago
- Official Repo of CudaForgeβ85Dec 2, 2025Updated 8 months ago
- Cell-Level RSRP Estimation with the Image-to-Image Wireless Propagation Model Based on Measured data.β13Oct 10, 2023Updated 2 years ago
- Measuring and evolving with the frontier of agent workβ436Updated this week
- Convert GitHub PRs into Harbor tasksβ73Jul 13, 2026Updated 3 weeks ago
- Prompter for Embodied Instruction Followingβ18Nov 30, 2023Updated 2 years ago
- [CHIL 2024] Interpretation of Intracardiac Electrograms Through Textual Representationsβ12Sep 4, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [NeurIPS 2025 spotlight] Mitigating the AI Safety Impact of Multi-Agent Scaffoldsβ19Sep 22, 2025Updated 10 months ago
- Skill-Inject: Measuring Agent Vulnerability to Skill File Attacksβ88Updated this week
- Using PCA, Autoencoder and Fisher linear discriminant to extract the effective representations from the face images. Do the reconstructioβ¦β12Apr 23, 2019Updated 7 years ago
- ACL24β11Jun 7, 2024Updated 2 years ago
- Dreamer on JAXβ16Jan 19, 2022Updated 4 years ago
- NVIDIA Inference Benchmarks provide recipes in ready-to-use templates for evaluating platform speed. Validate your platform across speciβ¦β40Updated this week
- A curated list of awesome Harbor ecosystem projectsβ51May 29, 2026Updated 2 months ago