Alternatives and similar repositories for ITBench

Users that are interested in ITBench are comparing it to the libraries listed below

• fmperf-project / fmperf
  Cloud Native Benchmarking of Foundation Models
  ☆42Updated last month
• llm-d / llm-d-deployer
  Helm charts for llm-d
  ☆50Updated 2 months ago
• caikit / caikit
  Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.
  ☆107Updated 2 months ago
• instructlab / training
  InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data
  ☆42Updated this week
• itbench-hub / ITBench-SRE-Agent
  Code repository for SRE agent as part of ITBench
  ☆18Updated 2 weeks ago
• instructlab / taxonomy
  Taxonomy tree that will allow you to create models tuned with your data
  ☆281Updated 2 weeks ago
• opendatahub-io / caikit-tgis-serving
  ☆19Updated last week
• llm-d / llm-d-benchmark
  llm-d benchmark scripts and tooling
  ☆26Updated this week
• intel / intent-driven-orchestration
  Intent Driven Orchestration enables management of applications through their Service Level Objectives, while minimizing developer and adm…
  ☆43Updated last month
• alibaba / CloudEval-YAML
  ☁️ Benchmarking LLMs for Cloud Config Generation ｜ 云场景下的大模型基准测试
  ☆34Updated 10 months ago
• sustainable-computing-io / kepler-model-server
  Model Server for Kepler
  ☆28Updated last month
• yinfangchen / cloud-incident-lit
  Cloud incidents/failures related work.
  ☆19Updated 8 months ago
• foundation-model-stack / fms-hf-tuning
  🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
  ☆49Updated last week
• instructlab / sdg
  Python library for Synthetic Data Generation
  ☆50Updated 2 weeks ago
• fybrik / fybrik
  Fybrik
  ☆132Updated 2 weeks ago
• xlab-uiuc / acto
  Push-Button End-to-End Testing of Kubernetes Operators and Controllers
  ☆127Updated 3 weeks ago
• mSvcBench / muBench
  µBench is a tool for benchmarking cloud/edge computing platforms that run microservice applications. The tool creates dummy microservice …
  ☆70Updated 3 months ago
• llm-d / llm-d
  llm-d enables high-performance distributed LLM inference on Kubernetes
  ☆1,755Updated this week
• sustainablecomputing / caspian
  ☆15Updated last year
• xlab-uiuc / AIOpsLab
  A holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.
  ☆12Updated 4 months ago
• opea-project / GenAIInfra
  Containerization and cloud native suite for OPEA
  ☆70Updated last month
• sigstore / model-transparency
  Supply chain security for ML
  ☆193Updated last week
• IBM / autopilot
  A tool to detect infrastructure issues on cloud native AI systems
  ☆47Updated this week
• openshift-psap / llm-load-test
  ☆49Updated last month
• IBM / LLM-performance-prediction
  Predict the performance of LLM inference services
  ☆19Updated this week
• IBM / kar
  KAR: A Runtime for the Hybrid Cloud
  ☆30Updated this week
• rh-aiservices-bu / gpu-partitioning-guide
  Repository to demo GPU Sharing with Time Slicing, MPS, MIG and others
  ☆48Updated 11 months ago
• autoiac-project / iac-eval
  [NeurIPS 24] IaC-Eval: A Code Generation Benchmark for Cloud Infrastructure-as-Code programs
  ☆29Updated 9 months ago
• DescartesResearch / TeaStore
  A micro-service reference test application for model extraction, cloud management, energy efficiency, power prediction, single- and multi…
  ☆141Updated 8 months ago
• kagenti / kagenti
  Kubernetes Agent Platform for AI with secure identity
  ☆31Updated this week