NVIDIA / nvidia-container-toolkit
Build and run containers leveraging NVIDIA GPUs
☆3,203Updated this week
Alternatives and similar repositories for nvidia-container-toolkit
Users that are interested in nvidia-container-toolkit are comparing it to the libraries listed below
Sorting:
- NVIDIA container runtime library☆951Updated this week
- NVIDIA container runtime☆1,115Updated last year
- Build and run Docker containers leveraging NVIDIA GPUs☆17,371Updated last year
- NVIDIA GPU metrics exporter for Prometheus leveraging DCGM☆1,185Updated this week
- NVIDIA device plugin for Kubernetes☆3,200Updated this week
- Simple, safe way to store and distribute tensors☆3,257Updated last week
- Multi-GPU CUDA stress test☆1,689Updated 8 months ago
- An Open Source Machine Learning Framework for Everyone☆1,140Updated 7 months ago
- Development repository for the Triton language and compiler☆15,568Updated this week
- GPU & Accelerator process monitoring for AMD, Apple, Huawei, Intel, NVIDIA and Qualcomm☆9,088Updated 3 weeks ago
- Fast and memory-efficient exact attention☆17,346Updated last week
- SGLang is a fast serving framework for large language models and vision language models.☆14,392Updated this week
- TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizati…☆10,476Updated this week
- Tensor library for machine learning☆12,532Updated this week
- Optimized primitives for collective multi-GPU communication☆3,710Updated 2 weeks ago
- NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs☆510Updated 2 weeks ago
- NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes☆2,114Updated this week
- Fast inference engine for Transformer models☆3,797Updated last month
- A Datacenter Scale Distributed Inference Serving Framework☆4,011Updated this week
- lightweight, standalone C++ inference engine for Google's Gemma models.☆6,396Updated last week
- CUDA Core Compute Libraries☆1,636Updated this week
- Nvidia GPU exporter for prometheus using nvidia-smi binary☆1,122Updated last week
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Bla…☆2,412Updated this week
- 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…☆8,708Updated this week
- Large Language Model Text Generation Inference☆10,119Updated this week
- Manage GPU clusters for running AI models☆2,680Updated this week
- 🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization…☆2,898Updated this week
- LM Studio CLI☆3,044Updated this week
- The official Meta Llama 3 GitHub site☆28,671Updated 3 months ago
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆1,845Updated this week