IBM / autopilotLinks
A tool to detect infrastructure issues on cloud native AI systems
☆51Updated 2 months ago
Alternatives and similar repositories for autopilot
Users that are interested in autopilot are comparing it to the libraries listed below
Sorting:
- NVIDIA NCCL Tests for Distributed Training☆123Updated last week
- Cloud Native Benchmarking of Foundation Models☆44Updated 3 months ago
- Health checks for Azure N- and H-series VMs.☆54Updated this week
- Systematic and comprehensive benchmarks for LLM systems.☆40Updated last month
- llm-d benchmark scripts and tooling☆33Updated this week
- An efficient GPU resource sharing system with fine-grained control for Linux platforms.☆86Updated last year
- CUDA checkpoint and restore utility☆384Updated 2 months ago
- A toolkit for discovering cluster network topology.☆81Updated last week
- Lightweight daemon for monitoring CUDA runtime API calls with eBPF uprobes☆140Updated 7 months ago
- ☆43Updated last year
- An I/O benchmark for deep Learning applications☆94Updated 2 weeks ago
- Intent Driven Orchestration enables management of applications through their Service Level Objectives, while minimizing developer and adm…☆44Updated 2 months ago
- OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)☆312Updated this week
- MIG Partition Editor for NVIDIA GPUs☆227Updated this week
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆122Updated 2 years ago
- NCCL Profiling Kit☆146Updated last year
- Offline optimization of your disaggregated Dynamo graph☆105Updated last week
- CloudAI Benchmark Framework☆73Updated last week
- This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.☆193Updated this week
- NVIDIA Network Operator☆292Updated this week
- GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster (IC2E'23)☆34Updated 2 years ago
- RDMA and SHARP plugins for nccl library☆212Updated 3 weeks ago
- Hooked CUDA-related dynamic libraries by using automated code generation tools.☆169Updated last year
- Kubernetes enhancements for Network Topology Aware Gang Scheduling & Autoscaling☆110Updated this week
- DCPerf benchmark suite for hyperscale cloud applications☆214Updated this week
- Splits single Nvidia GPU into multiple partitions with complete compute and memory isolation (wrt to performace) between the partitions☆161Updated 6 years ago
- A light weight vLLM simulator, for mocking out replicas.☆57Updated last week
- cricket is a virtualization solution for GPUs☆221Updated 2 months ago
- ☆37Updated last month
- Share GPU between Pods in Kubernetes☆214Updated 2 years ago