IBM / autopilotLinks
A tool to detect infrastructure issues on cloud native AI systems
☆52Updated 4 months ago
Alternatives and similar repositories for autopilot
Users that are interested in autopilot are comparing it to the libraries listed below
Sorting:
- Cloud Native Benchmarking of Foundation Models☆44Updated 5 months ago
- NVIDIA NCCL Tests for Distributed Training☆133Updated last week
- Health checks for Azure N- and H-series VMs.☆56Updated last month
- An efficient GPU resource sharing system with fine-grained control for Linux platforms.☆87Updated last year
- Systematic and comprehensive benchmarks for LLM systems.☆48Updated last month
- MIG Partition Editor for NVIDIA GPUs☆235Updated this week
- A toolkit for discovering cluster network topology.☆90Updated this week
- ☆43Updated last year
- Offline optimization of your disaggregated Dynamo graph☆151Updated this week
- llm-d benchmark scripts and tooling☆41Updated last week
- GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster (IC2E'23)☆34Updated 2 years ago
- Share GPU between Pods in Kubernetes☆216Updated 2 years ago
- Lightweight daemon for monitoring CUDA runtime API calls with eBPF uprobes☆145Updated 9 months ago
- CUDA checkpoint and restore utility☆403Updated 4 months ago
- A TUI-based utility for real-time monitoring of InfiniBand traffic and performance metrics on the local node☆62Updated last month
- DOCA Platform manages provisioning and service orchestration for Bluefield DPUs☆71Updated this week
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆356Updated this week
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆122Updated 2 years ago
- Intelligent platform for AI workloads☆37Updated 2 years ago
- ☆70Updated last week
- A workload for deploying LLM inference services on Kubernetes☆156Updated last week
- Splits single Nvidia GPU into multiple partitions with complete compute and memory isolation (wrt to performace) between the partitions☆165Updated 6 years ago
- Holistic job manager on Kubernetes☆115Updated last year
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆74Updated 6 months ago
- A light weight vLLM simulator, for mocking out replicas.☆83Updated this week
- An I/O benchmark for deep Learning applications☆98Updated 2 weeks ago
- Automatic tuning for ML model deployment on Kubernetes☆81Updated last year
- Intent Driven Orchestration enables management of applications through their Service Level Objectives, while minimizing developer and adm…☆47Updated 2 months ago
- RDMA CNI plugin for containerized workloads☆58Updated last week
- Kubernetes enhancements for Network Topology Aware Gang Scheduling & Autoscaling☆143Updated this week