Build and run containers leveraging NVIDIA GPUs
☆4,572Sep 16, 2026Updated this week
Alternatives and similar repositories for nvidia-container-toolkit
Users that are interested in nvidia-container-toolkit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- NVIDIA container runtime library☆1,130Updated this week
- NVIDIA device plugin for Kubernetes☆3,872Updated this week
- Build and run Docker containers leveraging NVIDIA GPUs☆17,599Dec 6, 2023Updated 2 years ago
- NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes☆2,878Updated this week
- NVIDIA GPU metrics exporter for Prometheus leveraging DCGM☆1,872Sep 10, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The NVIDIA GPU driver container allows the provisioning of the NVIDIA driver through the use of containers.☆186Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆92,107Updated this week
- NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs☆792Aug 19, 2026Updated last month
- Heterogeneous GPU Sharing on Kubernetes☆4,634Updated this week
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆1,525Updated this week
- NVIDIA container runtime☆1,127Oct 27, 2023Updated 2 years ago
- SGLang is a high-performance serving framework for large language models and multimodal models.☆36,140Updated this week
- Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆181,209Updated this week
- An open and reliable container runtime☆21,312Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizat…☆14,652Updated this week
- Samples for CUDA Developers which demonstrates features in CUDA Toolkit☆9,642Sep 9, 2026Updated last week
- DRA Driver for NVIDIA GPUs☆711Updated this week
- LLM inference in C/C++☆128,690Updated this week
- GPU plugin to the node feature discovery for Kubernetes☆308May 27, 2024Updated 2 years ago
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆10,995Updated this week
- A Datacenter Scale Distributed Inference Serving Framework☆8,114Updated this week
- NVIDIA Linux open GPU kernel module source☆17,402Sep 9, 2026Updated last week
- NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…☆13,355Sep 10, 2026Updated last week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- AIStore: scalable storage for AI applications☆1,937Updated this week
- ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator☆21,885Updated this week
- CUDA Core Compute Libraries☆2,515Updated this week
- ☆313Sep 4, 2026Updated 2 weeks ago
- A Cloud Native Batch System (Project under CNCF)☆5,960Updated this week
- An extremely fast Python package and project manager, written in Rust.☆89,950Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆152,463Updated this week
- Kubernetes-native Job Queueing☆2,984Updated this week
- Optimized primitives for collective multi-GPU communication☆5,096Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆383Updated this week
- contaiNERD CTL - Docker-compatible CLI for containerd, with support for Compose, Rootless, eStargz, OCIcrypt, IPFS, ...☆10,381Updated this week
- A toolkit to run Ray applications on Kubernetes☆2,691Updated this week
- Podman: A tool for managing OCI containers and pods.☆32,891Updated this week
- A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Auto…☆18,473Updated this week
- An Open Source Machine Learning Framework for Everyone☆1,147Jul 31, 2025Updated last year
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.☆76,370Updated this week