GPUprobe / gpuprobe-daemonLinks
Lightweight daemon for monitoring CUDA runtime API calls with eBPF uprobes
☆131Updated 6 months ago
Alternatives and similar repositories for gpuprobe-daemon
Users that are interested in gpuprobe-daemon are comparing it to the libraries listed below
Sorting:
- AI/GPU flame graph☆188Updated 2 weeks ago
- A tool to detect infrastructure issues on cloud native AI systems☆48Updated last month
- CUDA checkpoint and restore utility☆376Updated last month
- Systematic and comprehensive benchmarks for LLM systems.☆38Updated 3 weeks ago
- Dynolog is a telemetry daemon for performance monitoring and tracing. It exports metrics from different components in the system like the…☆347Updated last week
- cricket is a virtualization solution for GPUs☆214Updated last month
- A tool for coordinated checkpoint/restore of distributed applications with CRIU☆29Updated last month
- ☆37Updated this week
- DCPerf benchmark suite for hyperscale cloud applications☆210Updated last week
- Hooked CUDA-related dynamic libraries by using automated code generation tools.☆166Updated last year
- Fast OS-level support for GPU checkpoint and restore☆241Updated 3 weeks ago
- ☆21Updated 3 months ago
- OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)☆292Updated this week
- NVIDIA NCCL Tests for Distributed Training☆114Updated last week
- An I/O benchmark for deep Learning applications☆91Updated last month
- An efficient GPU resource sharing system with fine-grained control for Linux platforms.☆85Updated last year
- NVIDIA GPUDirect Storage Driver☆292Updated 2 months ago
- qCUDA: GPGPU Virtualization at a New API Remoting Method with Para-virtualization☆129Updated 3 years ago
- ☆71Updated 8 months ago
- GPUd automates monitoring, diagnostics, and issue identification for GPUs☆440Updated this week
- Distributed KV cache coordinator☆78Updated last week
- A collection of CUDA programming examples to learn GPU programming☆40Updated last week
- A light weight vLLM simulator, for mocking out replicas.☆52Updated 3 weeks ago
- KV cache store for distributed LLM inference☆345Updated last month
- [NSDI '24] DINT: Fast In-Kernel Distributed Transactions with eBPF☆48Updated last year
- ☆194Updated 2 months ago
- Cloud Native Benchmarking of Foundation Models☆44Updated 2 months ago
- Splits single Nvidia GPU into multiple partitions with complete compute and memory isolation (wrt to performace) between the partitions☆159Updated 6 years ago
- Meta's fleetwide profiler framework☆326Updated last month
- NCCL Profiling Kit☆145Updated last year