NVIDIA / nvidia-container-toolkit
Build and run containers leveraging NVIDIA GPUs
☆2,873Updated this week
Alternatives and similar repositories for nvidia-container-toolkit:
Users that are interested in nvidia-container-toolkit are comparing it to the libraries listed below
- NVIDIA container runtime library☆900Updated last week
- NVIDIA container runtime☆1,116Updated last year
- Simple, safe way to store and distribute tensors☆3,117Updated 2 weeks ago
- An Open Source Machine Learning Framework for Everyone☆1,087Updated 4 months ago
- NVIDIA device plugin for Kubernetes☆3,029Updated this week
- CUDA Python: Performance meets Productivity☆1,105Updated this week
- NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes☆1,999Updated this week
- Optimized primitives for collective multi-GPU communication☆3,473Updated 3 weeks ago
- Tools for building GPU clusters☆1,296Updated last month
- TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain…☆9,468Updated this week
- NVIDIA GPU metrics exporter for Prometheus leveraging DCGM☆1,052Updated this week
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs…☆2,190Updated this week
- AIStore: scalable storage for AI applications☆1,393Updated this week
- Nvidia GPU exporter for prometheus using nvidia-smi binary☆1,017Updated this week
- SGLang is a fast serving framework for large language models and vision language models.☆10,325Updated this week
- Build and run Docker containers leveraging NVIDIA GPUs☆17,328Updated last year
- Multi-GPU CUDA stress test☆1,551Updated 6 months ago
- GPU & Accelerator process monitoring for AMD, Apple, Huawei, Intel, NVIDIA and Qualcomm☆8,729Updated this week
- Samples for CUDA Developers which demonstrates features in CUDA Toolkit☆6,949Updated this week
- NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs☆460Updated this week
- Machine Learning Containers for NVIDIA Jetson and JetPack-L4T☆2,699Updated this week
- CUDA Core Compute Libraries☆1,468Updated this week
- Tensor library for machine learning☆11,902Updated last week
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,842Updated last year
- NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…☆11,200Updated 3 weeks ago
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆1,740Updated this week
- An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.☆5,183Updated 3 weeks ago
- A machine learning compiler for GPUs, CPUs, and ML accelerators☆2,966Updated this week
- AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (N…☆4,598Updated 2 months ago
- This repository contains tutorials and examples for Triton Inference Server☆648Updated this week