Alternatives and similar repositories for nvidia-container-toolkit

Users that are interested in nvidia-container-toolkit are comparing it to the libraries listed below

• NVIDIA / libnvidia-container
  NVIDIA container runtime library
  ☆1,021Updated this week
• NVIDIA / nvidia-container-runtime
  NVIDIA container runtime
  ☆1,121Updated last year
• NVIDIA / k8s-device-plugin
  NVIDIA device plugin for Kubernetes
  ☆3,455Updated this week
• NVIDIA / dcgm-exporter
  NVIDIA GPU metrics exporter for Prometheus leveraging DCGM
  ☆1,414Updated last week
• NVIDIA / gpu-operator
  NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes
  ☆2,335Updated this week
• huggingface / safetensors
  Simple, safe way to store and distribute tensors
  ☆3,470Updated 2 weeks ago
• NVIDIA / tensorflow
  An Open Source Machine Learning Framework for Everyone
  ☆1,152Updated 2 months ago
• NVIDIA / nccl
  Optimized primitives for collective multi-GPU communication
  ☆4,134Updated 2 weeks ago
• utkuozdemir / nvidia_gpu_exporter
  Nvidia GPU exporter for prometheus using nvidia-smi binary
  ☆1,281Updated this week
• wilicc / gpu-burn
  Multi-GPU CUDA stress test
  ☆1,931Updated last year
• NVIDIA / TensorRT-LLM
  TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizati…
  ☆11,801Updated this week
• NVIDIA / DCGM
  NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs
  ☆598Updated last month
• intel / intel-extension-for-pytorch
  A Python package for extending the official PyTorch that can easily obtain performance on Intel platform
  ☆1,973Updated this week
• NVIDIA / aistore
  AIStore: scalable storage for AI applications
  ☆1,598Updated this week
• NVIDIA / cuda-python
  CUDA Python: Performance meets Productivity
  ☆2,995Updated this week
• huggingface / optimum
  🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization…
  ☆3,110Updated this week
• kubeflow / trainer
  Distributed AI Model Training and Fine-Tuning on Kubernetes
  ☆1,932Updated this week
• NVIDIA / TransformerEngine
  A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Bla…
  ☆2,763Updated this week
• Project-HAMi / HAMi
  Heterogeneous AI Computing Virtualization Middleware(Project under CNCF)
  ☆2,219Updated this week
• docker / buildx
  Docker CLI plugin for extended build capabilities with BuildKit
  ☆4,105Updated this week
• run-ai / genv
  GPU environment and cluster management with LLM support
  ☆642Updated last year
• XuehaiPan / nvitop
  An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.
  ☆6,187Updated this week
• triton-inference-server / tutorials
  This repository contains tutorials and examples for Triton Inference Server
  ☆782Updated 2 weeks ago
• ai-dynamo / dynamo
  A Datacenter Scale Distributed Inference Serving Framework
  ☆5,244Updated this week
• ray-project / kuberay
  A toolkit to run Ray applications on Kubernetes
  ☆2,071Updated this week
• kserve / kserve
  Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
  ☆4,632Updated this week
• openvinotoolkit / openvino
  OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
  ☆8,987Updated this week
• triton-inference-server / client
  Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
  ☆648Updated last week
• gpustack / gpustack
  Simple, scalable AI model deployment on GPU clusters
  ☆3,838Updated this week
• NVIDIA / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆6,320Updated last year