Alternatives and similar repositories for genv

Users that are interested in genv are comparing it to the libraries listed below

• nebuly-ai / nos
  Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elas…
  ☆679Updated last year
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆283Updated 4 months ago
• run-ai / runai-model-streamer
  ☆275Updated this week
• clearml / clearml-fractional-gpu
  ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing
  ☆88Updated last month
• meta-pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆411Updated this week
• triton-inference-server / pytriton
  PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
  ☆833Updated 4 months ago
• run-ai / rntop
  A top-like tool for monitoring GPUs in a cluster
  ☆84Updated last year
• huggingface / gpu-fryer
  Where GPUs get cooked 👩‍🍳🔥
  ☆345Updated 3 months ago
• imbue-ai / cluster-health
  ☆320Updated last year
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆214Updated 8 months ago
• grgalex / nvshare
  Practical GPU Sharing Without Memory Size Constraints
  ☆296Updated 9 months ago
• kserve / modelmesh-serving
  Controller for ModelMesh
  ☆242Updated 7 months ago
• kserve / modelmesh
  Distributed Model Serving Framework
  ☆182Updated 3 months ago
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆401Updated 3 months ago
• meta-pytorch / torchft
  Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)
  ☆467Updated 2 weeks ago
• triton-inference-server / model_analyzer
  Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…
  ☆502Updated last week
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆135Updated 3 months ago
• NVIDIA / KAI-Scheduler
  KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale
  ☆1,059Updated this week
• NVIDIA / pyxis
  Container plugin for Slurm Workload Manager
  ☆407Updated this week
• NVIDIA / mig-parted
  MIG Partition Editor for NVIDIA GPUs
  ☆235Updated this week
• Lightning-AI / litData
  Speed up model training by fixing data loading.
  ☆568Updated this week
• run-house / kubetorch
  Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.
  ☆1,143Updated this week
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆325Updated 3 months ago
• lambdal / deeplearning-benchmark
  Benchmark Suite for Deep Learning
  ☆280Updated 3 weeks ago
• aimhubio / aimlflow
  aim-mlflow integration
  ☆232Updated 2 years ago
• facebookresearch / HolisticTraceAnalysis
  A library to analyze PyTorch traces.
  ☆454Updated 3 weeks ago
• lambdal / lambda-stack-dockerfiles
  ☆282Updated 9 months ago
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆468Updated last week
• nebius / soperator
  Run Slurm in Kubernetes
  ☆343Updated this week
• ray-project / ray-llm
  RayLLM - LLMs on Ray (Archived). Read README for more info.
  ☆1,263Updated 9 months ago