GPUprobe / gpuprobe-daemonLinks
Lightweight daemon for monitoring CUDA runtime API calls with eBPF uprobes
☆146Updated 10 months ago
Alternatives and similar repositories for gpuprobe-daemon
Users that are interested in gpuprobe-daemon are comparing it to the libraries listed below
Sorting:
- CUDA checkpoint and restore utility☆410Updated 4 months ago
- cricket is a virtualization solution for GPUs☆234Updated 4 months ago
- Fast OS-level support for GPU checkpoint and restore☆271Updated 4 months ago
- Hooked CUDA-related dynamic libraries by using automated code generation tools.☆172Updated 2 years ago
- Systematic and comprehensive benchmarks for LLM systems.☆50Updated last week
- AI/GPU flame graph☆242Updated 4 months ago
- DCPerf benchmark suite for hyperscale cloud applications☆231Updated this week
- A tool for coordinated checkpoint/restore of distributed applications with CRIU☆31Updated 5 months ago
- Dynolog is a telemetry daemon for performance monitoring and tracing. It exports metrics from different components in the system like the…☆362Updated last week
- NVIDIA NCCL Tests for Distributed Training☆134Updated last week
- Offline optimization of your disaggregated Dynamo graph☆177Updated last week
- A tool to detect infrastructure issues on cloud native AI systems☆52Updated 4 months ago
- An efficient GPU resource sharing system with fine-grained control for Linux platforms.☆88Updated last year
- ☆38Updated 3 months ago
- ☆20Updated 6 months ago
- A light weight vLLM simulator, for mocking out replicas.☆85Updated this week
- KV cache store for distributed LLM inference☆390Updated 2 months ago
- NCCL Profiling Kit☆150Updated last year
- NVIDIA GPUDirect Storage Driver☆331Updated last month
- ☆235Updated last month
- ☆71Updated 11 months ago
- An I/O benchmark for deep Learning applications☆102Updated last month
- GPUd automates monitoring, diagnostics, and issue identification for GPUs☆475Updated this week
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆365Updated this week
- A collection of CUDA programming examples to learn GPU programming☆61Updated 3 months ago
- example code for using DC QP for providing RDMA READ and WRITE operations to remote GPU memory☆152Updated last year
- qCUDA: GPGPU Virtualization at a New API Remoting Method with Para-virtualization☆133Updated 3 years ago
- Serverless Paper Reading and Discussion☆38Updated 3 years ago
- Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond☆773Updated this week
- A workload for deploying LLM inference services on Kubernetes☆168Updated last week