An open source benchmarking framework for IT automation
☆503Sep 5, 2026Updated this week
Alternatives and similar repositories for ITBench
Users that are interested in ITBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ⚠️ ARCHIVED - All development moved to https://github.com/itbench-hub/ITBench/tree/main/scenarios☆16Feb 24, 2026Updated 6 months ago
- AssetOpsBench - Industry 4.0: A unified benchmark and framework for building, orchestrating, and evaluating domain-specific AI agents for…☆2,267Updated this week
- ⚠️ ARCHIVED - All development moved to https://github.com/itbench-hub/ITBench-CISO-SRE-FinOps-Agent☆21Sep 9, 2025Updated 11 months ago
- CUGA is an open-source generalist agent harness for the enterprise, supporting complex task execution on web and APIs, OpenAPI/MCP integr…☆873Updated this week
- Code repository for CISO agent as part of ITBench☆22May 8, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Can AI agents resolve production incidents?☆272Updated this week
- ☆36May 9, 2025Updated last year
- The Steerability toolkit is an extensible library for general purpose steering of language models.☆111Updated this week
- A holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.☆973Updated this week
- Prompt Declaration Language (PDL) is a declarative prompt programming language.☆311Updated this week
- Tackle Data-intensive Validity Analyzer☆38Dec 7, 2023Updated 2 years ago
- A collection of Model Context Protocol (MCP) servers, clients and developer tools by IBM.☆401Updated this week
- Deploy, and share agents with open infrastructure, free from vendor lock-in.☆1,155Updated this week
- The lightweight framework for building agents☆580Aug 25, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- In-Context Explainability 360 toolkit☆72Mar 9, 2026Updated 5 months ago
- ⚠️ Deprecated: This library's functionality has been rolled into Mellea (https://github.com/generative-computing/mellea)☆56Jun 30, 2026Updated 2 months ago
- A framework for designing, executing and analysing experiment campaigns☆62Updated this week
- General agent evaluation framework☆76Aug 11, 2026Updated 3 weeks ago
- System Intelligence Benchmark☆55Jul 30, 2026Updated last month
- An opinionated tooling platform for managing compliance as code, using continuous integration and NIST's OSCAL standard.☆274Updated this week
- An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized di…☆4,426Updated this week
- ansible-policy is a prototype implementation which allows us to define and set constraints to the Ansible project in OPA Rego language.☆26Feb 2, 2026Updated 7 months ago
- InstructLab Core package. Use this to chat with a model and execute the InstructLab workflow to train a model using custom taxonomy data…☆1,419Mar 30, 2026Updated 5 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Cloud incidents/failures related work.☆21Jan 7, 2025Updated last year
- Observability Volume Management☆40Mar 19, 2025Updated last year
- ☆23Mar 29, 2021Updated 5 years ago
- AI-Driven Scientific, Algorithmic, and Systems Discovery☆632Updated this week
- Solution Service Architecture☆26Jun 5, 2024Updated 2 years ago
- Cloud Native Benchmarking of Foundation Models☆46Jul 31, 2025Updated last year
- ☆415Jul 23, 2025Updated last year
- The AI Agents behind the IBM Granite Playground☆17Jul 15, 2026Updated last month
- FMS Model Optimizer is a framework for developing reduced precision neural network models.☆21Jun 24, 2026Updated 2 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Graph-vector database that queried 1 billion edges for $2.50. Rust, OpenCypher, vector search, 14 graph algorithms. 74M nodes / 1B edges …☆171Updated this week
- Open protocol for communication between AI agents, applications, and humans.☆1,017Aug 25, 2025Updated last year
- Open Source AI Project Governance and Security Baseline (OSAIPGS Baseline)☆26Updated this week
- A Python library for inference-time scaling LLMs☆38Aug 24, 2026Updated last week
- SysMoBench: Evaluating AI on Formally Modeling Complex Real-World Systems☆24Jul 13, 2026Updated last month
- Run the entire bee application stack using docker-compose☆155Mar 18, 2025Updated last year
- InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing☆30Nov 27, 2024Updated last year