Alternatives and similar repositories for genv:

Users that are interested in genv are comparing it to the libraries listed below

• run-ai / runai-model-streamer
  ☆205Updated last month
• clearml / clearml-fractional-gpu
  ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing
  ☆77Updated 9 months ago
• run-ai / rntop
  A top-like tool for monitoring GPUs in a cluster
  ☆86Updated last year
• grgalex / nvshare
  Practical GPU Sharing Without Memory Size Constraints
  ☆264Updated last month
• triton-inference-server / pytriton
  PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
  ☆789Updated 2 months ago
• pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆360Updated this week
• nebuly-ai / nos
  Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elas…
  ☆656Updated last year
• imbue-ai / cluster-health
  ☆304Updated 8 months ago
• aimhubio / aimlflow
  aim-mlflow integration
  ☆210Updated last year
• run-ai / docs
  markdown docs
  ☆86Updated this week
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆225Updated 2 months ago
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆330Updated 3 months ago
• NVIDIA / mig-parted
  MIG Partition Editor for NVIDIA GPUs
  ☆198Updated last week
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆199Updated 2 weeks ago
• NVIDIA / KAI-Scheduler
  KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale
  ☆531Updated this week
• NVIDIA / DCGM
  NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs
  ☆500Updated this week
• kserve / modelmesh-serving
  Controller for ModelMesh
  ☆229Updated last month
• NVIDIA / dcgm-exporter
  NVIDIA GPU metrics exporter for Prometheus leveraging DCGM
  ☆1,174Updated 2 weeks ago
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆351Updated this week
• triton-inference-server / model_analyzer
  Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…
  ☆474Updated 2 weeks ago
• clearml / clearml-serving
  ClearML - Model-Serving Orchestration and Repository Solution
  ☆150Updated 3 months ago
• NVIDIA / gpu-feature-discovery
  GPU plugin to the node feature discovery for Kubernetes
  ☆300Updated 11 months ago
• facebookresearch / HolisticTraceAnalysis
  A library to analyze PyTorch traces.
  ☆367Updated last week
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆765Updated 8 months ago
• triton-inference-server / tutorials
  This repository contains tutorials and examples for Triton Inference Server
  ☆692Updated 3 weeks ago
• pytorch / torchft
  PyTorch per step fault tolerance (actively under development)
  ☆291Updated this week
• NVIDIA / enroot
  A simple yet powerful tool to turn traditional container/OS images into unprivileged sandboxes.
  ☆741Updated 4 months ago
• NVIDIA / cloud-native-stack
  Run cloud native workloads on NVIDIA GPUs
  ☆168Updated last week
• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆179Updated last week
• triton-inference-server / backend
  Common source, scripts and utilities for creating Triton backends.
  ☆318Updated this week