An open source benchmarking framework for IT automation
☆494Aug 17, 2026Updated this week
Alternatives and similar repositories for ITBench
Users that are interested in ITBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ⚠️ ARCHIVED - All development moved to https://github.com/itbench-hub/ITBench/tree/main/scenarios☆16Feb 24, 2026Updated 5 months ago
- AssetOpsBench - Industry 4.0: A unified benchmark and framework for building, orchestrating, and evaluating domain-specific AI agents for…☆2,168Updated this week
- A library of components to help agent builders boost their agent performance (tool-calling, instruction following, policy, etc.)☆119Updated this week
- A Benchmark for Evaluating Multi-Hop, Multi-Source Tool-Calling in AI Agents☆64Aug 10, 2026Updated last week
- ⚠️ ARCHIVED - All development moved to https://github.com/itbench-hub/ITBench-CISO-SRE-FinOps-Agent☆21Sep 9, 2025Updated 11 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- CUGA is an open-source generalist agent harness for the enterprise, supporting complex task execution on web and APIs, OpenAPI/MCP integr…☆868Updated this week
- Multi-agent system for resolving Site Reliability Engineering tasks.☆22Oct 23, 2025Updated 9 months ago
- Interactive web-based digital logic circuit designer & simulator with AI-powered features.☆34May 11, 2026Updated 3 months ago
- A holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.☆11May 21, 2025Updated last year
- This is a base-react agent for AssetOpsBench☆24Updated this week
- RL environments + evals for AI agents. Define once, train anything.☆291Updated this week
- ☆36May 9, 2025Updated last year
- The AI Steerability 360 toolkit is an extensible library for general purpose steering of LLMs.☆103Aug 7, 2026Updated last week
- A holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.☆952Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Granite Switch — Build AI models like you build software☆92Updated this week
- A collection of Model Context Protocol (MCP) servers, clients and developer tools by IBM.☆401Jul 28, 2026Updated 2 weeks ago
- Deploy, and share agents with open infrastructure, free from vendor lock-in.☆1,141Updated this week
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆218May 27, 2026Updated 2 months ago
- Build production-ready AI agents in both Python and Typescript.☆3,380Aug 8, 2026Updated last week
- The lightweight framework for building agents☆549Aug 5, 2026Updated last week
- A framework for designing, executing and analysing experiment campaigns☆62Updated this week
- FailureSensorIQ, a dataset and benchmark to probe LLMs’ reasoning and comprehension of sensor–failure relationships in industrial systems…☆49Updated this week
- General agent evaluation framework☆70Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- System Intelligence Benchmark☆54Jul 30, 2026Updated 2 weeks ago
- Python library for Synthetic Data Generation☆54Mar 31, 2026Updated 4 months ago
- An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized di…☆4,333Updated this week
- KAR: A Runtime for the Hybrid Cloud☆31Sep 17, 2025Updated 11 months ago
- InstructLab Core package. Use this to chat with a model and execute the InstructLab workflow to train a model using custom taxonomy data…☆1,420Mar 30, 2026Updated 4 months ago
- Cloud incidents/failures related work.☆21Jan 7, 2025Updated last year
- IasCable is a node/typescript library to build installable component infrastructure components from a catalog of available modules☆13Jul 4, 2024Updated 2 years ago
- Cloud Service Management for IBM Cloud Private☆25Oct 30, 2019Updated 6 years ago
- Provision and bind IBM Cloud services to your Kubernetes cluster in a Kubernetes-native way☆42Aug 6, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- In-Situ Evaluator: Real-Time Subsample Analysis☆16Jan 25, 2026Updated 6 months ago
- ☆405Jul 23, 2025Updated last year
- langX101☆16Updated this week
- Open protocol for communication between AI agents, applications, and humans.☆1,018Aug 25, 2025Updated 11 months ago
- Open Source AI Project Governance and Security Baseline (OSAIPGS Baseline)☆25Aug 9, 2026Updated last week
- A Python library for inference-time scaling LLMs☆38Updated this week
- SysMoBench: Evaluating AI on Formally Modeling Complex Real-World Systems☆24Jul 13, 2026Updated last month