Alternatives and similar repositories for genv

Users that are interested in genv are comparing it to the libraries listed below

• run-ai / runai-model-streamer
  ☆215Updated this week
• run-ai / rntop
  A top-like tool for monitoring GPUs in a cluster
  ☆85Updated last year
• nebuly-ai / nos
  Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elas…
  ☆662Updated last year
• triton-inference-server / pytriton
  PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
  ☆796Updated 3 months ago
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆234Updated last week
• NVIDIA / KAI-Scheduler
  KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale
  ☆604Updated this week
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆202Updated last month
• grgalex / nvshare
  Practical GPU Sharing Without Memory Size Constraints
  ☆269Updated 2 months ago
• run-ai / docs
  markdown docs
  ☆88Updated last week
• facebookresearch / HolisticTraceAnalysis
  A library to analyze PyTorch traces.
  ☆384Updated this week
• clearml / clearml-serving
  ClearML - Model-Serving Orchestration and Repository Solution
  ☆150Updated 4 months ago
• pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆366Updated 2 weeks ago
• clearml / clearml-fractional-gpu
  ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing
  ☆78Updated 10 months ago
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆341Updated 4 months ago
• imbue-ai / cluster-health
  ☆308Updated 9 months ago
• triton-inference-server / model_analyzer
  Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…
  ☆478Updated this week
• NVIDIA / k8s-dra-driver-gpu
  Dynamic Resource Allocation (DRA) for NVIDIA GPUs in Kubernetes
  ☆366Updated this week
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆767Updated 9 months ago
• pytorch / torchft
  PyTorch per step fault tolerance (actively under development)
  ☆302Updated this week
• aimhubio / aimlflow
  aim-mlflow integration
  ☆213Updated last year
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆362Updated this week
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆92Updated this week
• NVIDIA / DCGM
  NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs
  ☆520Updated last month
• lambdal / deeplearning-benchmark
  Benchmark Suite for Deep Learning
  ☆268Updated 3 months ago
• Lightning-AI / litData
  Transform datasets at scale. Optimize datasets for fast AI model training.
  ☆485Updated this week
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆269Updated this week
• Preemo-Inc / text-generation-inference
  ☆198Updated last year
• hidet-org / hidet
  An open-source efficient deep learning framework/compiler, written in python.
  ☆700Updated this week
• huggingface / gpu-fryer
  Where GPUs get cooked 👩‍🍳🔥
  ☆230Updated 3 months ago
• kubernetes-sigs / lws
  LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
  ☆457Updated last week