An open source benchmarking framework for IT automation
☆508Sep 26, 2026Updated this week
Alternatives and similar repositories for ITBench
Users that are interested in ITBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ⚠️ ARCHIVED - All development moved to https://github.com/itbench-hub/ITBench/tree/main/scenarios☆16Feb 24, 2026Updated 7 months ago
- AssetOpsBench - Industry 4.0: A unified benchmark and framework for building, orchestrating, and evaluating domain-specific AI agents for…☆2,311Updated this week
- A library of components to help agent builders boost their agent performance (tool-calling, instruction following, policy, etc.)☆119Aug 19, 2026Updated last month
- A Benchmark for Evaluating Multi-Hop, Multi-Source Tool-Calling in AI Agents☆69Updated this week
- ⚠️ ARCHIVED - All development moved to https://github.com/itbench-hub/ITBench-CISO-SRE-FinOps-Agent☆20Sep 9, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- CUGA is an open-source generalist agent harness for the enterprise, supporting complex task execution on web and APIs, OpenAPI/MCP integr…☆880Updated this week
- Multi-agent system for resolving Site Reliability Engineering tasks.☆26Oct 23, 2025Updated 11 months ago
- Interactive web-based digital logic circuit designer & simulator with AI-powered features.☆34Sep 3, 2026Updated 3 weeks ago
- A holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.☆11May 21, 2025Updated last year
- This is a base-react agent for AssetOpsBench☆25Updated this week
- Can AI agents resolve production incidents?☆301Updated this week
- ☆36May 9, 2025Updated last year
- A holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.☆995Sep 19, 2026Updated last week
- Prompt Declaration Language (PDL) is a declarative prompt programming language.☆312Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Granite Switch — Build AI models like you build software☆97Updated this week
- A collection of Model Context Protocol (MCP) servers, clients and developer tools by IBM.☆407Sep 2, 2026Updated 3 weeks ago
- Deploy, and share agents with open infrastructure, free from vendor lock-in.☆1,164Updated this week
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆216Sep 20, 2026Updated last week
- In-Context Explainability 360 toolkit☆72Mar 9, 2026Updated 6 months ago
- ⚠️ Deprecated: This library's functionality has been rolled into Mellea (https://github.com/generative-computing/mellea)☆56Jun 30, 2026Updated 2 months ago
- Build production-ready AI agents in both Python and Typescript.☆3,414Updated this week
- General agent evaluation framework☆76Sep 15, 2026Updated last week
- System Intelligence Benchmark☆55Jul 30, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Python library for Synthetic Data Generation☆55Mar 31, 2026Updated 5 months ago
- KAR: A Runtime for the Hybrid Cloud☆31Sep 17, 2025Updated last year
- ansible-policy is a prototype implementation which allows us to define and set constraints to the Ansible project in OPA Rego language.☆26Feb 2, 2026Updated 7 months ago
- InstructLab Core package. Use this to chat with a model and execute the InstructLab workflow to train a model using custom taxonomy data…☆1,416Mar 30, 2026Updated 5 months ago
- Cloud incidents/failures related work.☆21Jan 7, 2025Updated last year
- Observability Volume Management☆40Mar 19, 2025Updated last year
- Cloud Service Management for IBM Cloud Private☆25Oct 30, 2019Updated 6 years ago
- IasCable is a node/typescript library to build installable component infrastructure components from a catalog of available modules☆13Jul 4, 2024Updated 2 years ago
- Solution Service Architecture☆26Jun 5, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Cloud Native Benchmarking of Foundation Models☆46Jul 31, 2025Updated last year
- AI-Driven Scientific, Algorithmic, and Systems Discovery☆697Sep 14, 2026Updated last week
- In-Situ Evaluator: Real-Time Subsample Analysis☆17Jan 25, 2026Updated 8 months ago
- The AI Agents behind the IBM Granite Playground☆17Jul 15, 2026Updated 2 months ago
- FMS Model Optimizer is a framework for developing reduced precision neural network models.☆21Updated this week
- ☆45Jul 30, 2026Updated last month
- Open protocol for communication between AI agents, applications, and humans.☆1,016Aug 25, 2025Updated last year