NVIDIA / nvidia-container-toolkitLinks
Build and run containers leveraging NVIDIA GPUs
☆3,941Updated last week
Alternatives and similar repositories for nvidia-container-toolkit
Users that are interested in nvidia-container-toolkit are comparing it to the libraries listed below
Sorting:
- NVIDIA container runtime library☆1,053Updated 2 weeks ago
- NVIDIA container runtime☆1,123Updated 2 years ago
- NVIDIA device plugin for Kubernetes☆3,599Updated this week
- NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes☆2,462Updated this week
- NVIDIA GPU metrics exporter for Prometheus leveraging DCGM☆1,537Updated 2 weeks ago
- An Open Source Machine Learning Framework for Everyone☆1,147Updated 4 months ago
- Multi-GPU CUDA stress test☆2,044Updated last month
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆1,997Updated last week
- Simple, safe way to store and distribute tensors☆3,568Updated this week
- Build and run Docker containers leveraging NVIDIA GPUs☆17,465Updated 2 years ago
- ⚠️DirectML is in maintenance mode ⚠️ DirectML is a high-performance, hardware-accelerated DirectX 12 library for machine learning. Direct…☆2,541Updated 3 weeks ago
- TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizat…☆12,433Updated last week
- AIStore: scalable storage for AI applications☆1,711Updated this week
- LM Studio CLI☆3,985Updated this week
- Nvidia GPU exporter for prometheus using nvidia-smi binary☆1,346Updated 2 weeks ago
- NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…☆12,489Updated 2 weeks ago
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆10,153Updated this week
- Optimized primitives for collective multi-GPU communication☆4,326Updated 3 weeks ago
- This repository contains tutorials and examples for Triton Inference Server☆814Updated 2 weeks ago
- CUDA Python: Performance meets Productivity☆3,098Updated last week
- Docker CLI plugin for extended build capabilities with BuildKit☆4,210Updated last week
- Olive: Simplify ML Model Finetuning, Conversion, Quantization, and Optimization for CPUs, GPUs and NPUs.☆2,211Updated this week
- Tools for building GPU clusters☆1,405Updated 5 months ago
- Heterogeneous AI Computing Virtualization Middleware(Project under CNCF)☆2,794Updated this week
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,911Updated this week
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆3,027Updated this week
- A machine learning compiler for GPUs, CPUs, and ML accelerators☆3,849Updated this week
- OpenVINO™ is an open source toolkit for optimizing and deploying AI inference☆9,403Updated this week
- A Datacenter Scale Distributed Inference Serving Framework☆5,673Updated this week
- Generative AI extensions for onnxruntime☆911Updated this week