Alternatives and similar repositories for nvidia-container-toolkit

Users that are interested in nvidia-container-toolkit are comparing it to the libraries listed below

• NVIDIA / libnvidia-container
  NVIDIA container runtime library
  ☆1,061Updated last month
• NVIDIA / nvidia-container-runtime
  NVIDIA container runtime
  ☆1,124Updated 2 years ago
• NVIDIA / gpu-operator
  NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes
  ☆2,485Updated this week
• NVIDIA / k8s-device-plugin
  NVIDIA device plugin for Kubernetes
  ☆3,621Updated this week
• NVIDIA / dcgm-exporter
  NVIDIA GPU metrics exporter for Prometheus leveraging DCGM
  ☆1,570Updated last month
• huggingface / safetensors
  Simple, safe way to store and distribute tensors
  ☆3,589Updated 3 weeks ago
• NVIDIA / tensorflow
  An Open Source Machine Learning Framework for Everyone
  ☆1,150Updated 5 months ago
• wilicc / gpu-burn
  Multi-GPU CUDA stress test
  ☆2,065Updated 2 months ago
• NVIDIA / TensorRT-LLM
  TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizat…
  ☆12,637Updated this week
• triton-inference-server / server
  The Triton Inference Server provides an optimized cloud and edge inferencing solution.
  ☆10,221Updated this week
• NVIDIA / aistore
  AIStore: scalable storage for AI applications
  ☆1,725Updated this week
• NVIDIA / nccl
  Optimized primitives for collective multi-GPU communication
  ☆4,367Updated last week
• NVIDIA / cuda-python
  CUDA Python: Performance meets Productivity
  ☆3,135Updated this week
• ai-dynamo / dynamo
  A Datacenter Scale Distributed Inference Serving Framework
  ☆5,759Updated this week
• huggingface / optimum
  🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization…
  ☆3,250Updated 3 weeks ago
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,728Updated last week
• utkuozdemir / nvidia_gpu_exporter
  Nvidia GPU exporter for prometheus using nvidia-smi binary
  ☆1,368Updated last week
• NVIDIA / nvidia-docker
  Build and run Docker containers leveraging NVIDIA GPUs
  ☆17,477Updated 2 years ago
• NVIDIA / DCGM
  NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs
  ☆642Updated last month
• bitsandbytes-foundation / bitsandbytes
  Accessible large language models via k-bit quantization for PyTorch.
  ☆7,881Updated last week
• NVIDIA / TensorRT
  NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…
  ☆12,582Updated last month
• NVIDIA / gpu-monitoring-tools
  Tools for monitoring NVIDIA GPUs on Linux
  ☆1,065Updated 4 years ago
• XuehaiPan / nvitop
  An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.
  ☆6,477Updated this week
• NVIDIA / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆6,382Updated last year
• NVIDIA / TransformerEngine
  A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…
  ☆3,081Updated this week
• microsoft / Olive
  Olive: Simplify ML Model Finetuning, Conversion, Quantization, and Optimization for CPUs, GPUs and NPUs.
  ☆2,224Updated this week
• huggingface / huggingface_hub
  The official Python client for the Hugging Face Hub.
  ☆3,237Updated this week
• InternLM / lmdeploy
  LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
  ☆7,521Updated this week
• dusty-nv / jetson-containers
  Machine Learning Containers for NVIDIA Jetson and JetPack-L4T
  ☆4,137Updated this week
• NVIDIA / cuda-samples
  Samples for CUDA Developers which demonstrates features in CUDA Toolkit
  ☆8,701Updated last week