Alternatives and similar repositories for ITBench

Users that are interested in ITBench are comparing it to the libraries listed below

• fmperf-project / fmperf
  Cloud Native Benchmarking of Foundation Models
  ☆39Updated last week
• opendatahub-io / caikit-tgis-serving
  ☆19Updated last week
• rh-aiservices-bu / gpu-partitioning-guide
  Repository to demo GPU Sharing with Time Slicing, MPS, MIG and others
  ☆47Updated 9 months ago
• openshift-psap / llm-load-test
  ☆47Updated last week
• llm-d / llm-d-benchmark
  llm-d benchmark scripts and tooling
  ☆21Updated this week
• xlab-uiuc / acto
  Push-Button End-to-End Testing of Kubernetes Operators and Controllers
  ☆126Updated last week
• sustainablecomputing / caspian
  ☆15Updated last year
• caikit / caikit
  Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.
  ☆106Updated last month
• redhat-et / foundation-models-for-documentation
  Improve ROSA customer experience (and customer retention) by leveraging foundation models to do “gpt-chat” style search of Red Hat custo…
  ☆27Updated last year
• caikit / caikit-nlp
  ☆12Updated this week
• intel / intent-driven-orchestration
  Intent Driven Orchestration enables management of applications through their Service Level Objectives, while minimizing developer and adm…
  ☆38Updated last week
• sustainable-computing-io / kepler-model-server
  Model Server for Kepler
  ☆27Updated 2 weeks ago
• instructlab / training
  InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data
  ☆42Updated this week
• IBM / autopilot
  A tool to detect infrastructure issues on cloud native AI systems
  ☆44Updated 2 weeks ago
• IBM / LLM-performance-prediction
  Predict the performance of LLM inference services
  ☆19Updated 3 months ago
• UWNetworksLab / meshinsight
  MeshInsight: Dissecting Overheads of Service Mesh Sidecars
  ☆47Updated last year
• IBM / kar
  KAR: A Runtime for the Hybrid Cloud
  ☆30Updated 3 months ago
• llm-d / llm-d-deployer
  Helm charts for llm-d
  ☆51Updated 2 weeks ago
• instructlab / community
  InstructLab Community wide collaboration space including contributing, security, code of conduct, etc
  ☆91Updated last week
• ml-energy / leaderboard
  How much energy do GenAI models consume?
  ☆46Updated 2 months ago
• project-codeflare / codeflare-sdk
  An intuitive, easy-to-use python interface for batch resource requesting, access, job submission, and observation. Simplifying the develo…
  ☆29Updated last week
• kagenti / kagenti
  Kubernetes Agent Platform for AI with secure identity
  ☆26Updated this week
• IBM / kube-safe-scheduler
  ☆49Updated 3 months ago
• microsoft / AIOpsLab
  A holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.
  ☆653Updated last week
• r2e-project / r2e
  r2e: turn any github repository into a programming agent environment
  ☆129Updated 3 months ago
• xlab-uiuc / AIOpsLab
  A holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.
  ☆12Updated 2 months ago
• alibaba / CloudEval-YAML
  ☁️ Benchmarking LLMs for Cloud Config Generation ｜ 云场景下的大模型基准测试
  ☆33Updated 9 months ago
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆71Updated this week
• LMCache / LMBenchmark
  Systematic and comprehensive benchmarks for LLM systems.
  ☆25Updated this week
• pfnet-research / k8s-cluster-simulator
  Kubernetes cluster simulator for evaluating schedulers.
  ☆127Updated 5 years ago