Alternatives and similar repositories for autopilot

Users that are interested in autopilot are comparing it to the libraries listed below

• fmperf-project / fmperf
  Cloud Native Benchmarking of Foundation Models
  ☆44Updated 5 months ago
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆130Updated last week
• Azure / azurehpc-health-checks
  Health checks for Azure N- and H-series VMs.
  ☆55Updated 2 weeks ago
• LMCache / LMBenchmark
  Systematic and comprehensive benchmarks for LLM systems.
  ☆45Updated last month
• NTHU-LSALAB / Gemini
  An efficient GPU resource sharing system with fine-grained control for Linux platforms.
  ☆87Updated last year
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆398Updated 3 months ago
• GPUprobe / gpuprobe-daemon
  Lightweight daemon for monitoring CUDA runtime API calls with eBPF uprobes
  ☆143Updated 9 months ago
• Mellanox / ofed-docker
  ☆43Updated last year
• llm-d / llm-d-benchmark
  llm-d benchmark scripts and tooling
  ☆40Updated last week
• ai-dynamo / aiconfigurator
  Offline optimization of your disaggregated Dynamo graph
  ☆136Updated last week
• NVIDIA / topograph
  A toolkit for discovering cluster network topology.
  ☆88Updated 2 weeks ago
• argonne-lcf / dlio_benchmark
  An I/O benchmark for deep Learning applications
  ☆96Updated 2 weeks ago
• microsoft / NPKit
  NCCL Profiling Kit
  ☆149Updated last year
• NVIDIA / mig-parted
  MIG Partition Editor for NVIDIA GPUs
  ☆235Updated this week
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆122Updated 2 years ago
• intel / intent-driven-orchestration
  Intent Driven Orchestration enables management of applications through their Service Level Objectives, while minimizing developer and adm…
  ☆47Updated last month
• NTHU-LSALAB / KubeShare
  Share GPU between Pods in Kubernetes
  ☆215Updated 2 years ago
• RWTH-ACS / cricket
  cricket is a virtualization solution for GPUs
  ☆228Updated 3 months ago
• googleinterns / cluster-resource-forecast
  This repository contains experimental tools we developed to forecast a clusters' resource (CPU or memory) usage.
  ☆44Updated 4 years ago
• Bruce-Lee-LY / cuda_hook
  Hooked CUDA-related dynamic libraries by using automated code generation tools.
  ☆172Updated 2 years ago
• sgl-project / rbg
  A workload for deploying LLM inference services on Kubernetes
  ☆148Updated this week
• llm-d / llm-d-inference-sim
  A light weight vLLM simulator, for mocking out replicas.
  ☆68Updated this week
• checkpoint-restore / criu-coordinator
  A tool for coordinated checkpoint/restore of distributed applications with CRIU
  ☆30Updated 3 months ago
• heyfey / vodascheduler
  GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster (IC2E'23)
  ☆34Updated 2 years ago
• Mellanox / nccl-rdma-sharp-plugins
  RDMA and SHARP plugins for nccl library
  ☆218Updated last month
• cjg / GVirtuS
  This repository is an archive. Refer to https://github.com/gvirtus/GVirtuS
  ☆44Updated 3 years ago
• sgl-project / ome
  Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…
  ☆351Updated this week
• sakjain92 / Fractional-GPUs
  Splits single Nvidia GPU into multiple partitions with complete compute and memory isolation (wrt to performace) between the partitions
  ☆164Updated 6 years ago
• SymbioticLab / Salus
  Fine-grained GPU sharing primitives
  ☆147Updated 5 months ago
• Mellanox / network-operator
  NVIDIA Network Operator
  ☆315Updated this week