Alternatives and similar repositories for genv:

Users that are interested in genv are comparing it to the libraries listed below

• run-ai / rntop
  A top-like tool for monitoring GPUs in a cluster
  ☆86Updated last year
• run-ai / runai-model-streamer
  ☆174Updated this week
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆220Updated last month
• nebuly-ai / nos
  Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elas…
  ☆649Updated 11 months ago
• triton-inference-server / pytriton
  PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
  ☆784Updated last month
• run-ai / docs
  markdown docs
  ☆82Updated this week
• kserve / modelmesh-serving
  Controller for ModelMesh
  ☆226Updated this week
• NVIDIA / DCGM
  NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs
  ☆480Updated last month
• pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆354Updated this week
• aimhubio / aimlflow
  aim-mlflow integration
  ☆205Updated last year
• imbue-ai / cluster-health
  ☆296Updated 7 months ago
• triton-inference-server / model_analyzer
  Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…
  ☆462Updated 2 weeks ago
• NVIDIA / pyxis
  Container plugin for Slurm Workload Manager
  ☆327Updated 4 months ago
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆199Updated 2 months ago
• facebookresearch / HolisticTraceAnalysis
  A library to analyze PyTorch traces.
  ☆350Updated last week
• kserve / modelmesh
  Distributed Model Serving Framework
  ☆159Updated 2 weeks ago
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆50Updated 8 months ago
• clearml / clearml-fractional-gpu
  ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing
  ☆75Updated 7 months ago
• SeldonIO / MLServer
  An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more
  ☆774Updated this week
• Lightning-AI / litdata
  Transform datasets at scale. Optimize datasets for fast AI model training.
  ☆430Updated this week
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆315Updated 2 months ago
• basetenlabs / truss
  The simplest way to serve AI/ML models in production
  ☆968Updated this week
• rapidsai / cuvs
  cuVS - a library for vector search and clustering on the GPU
  ☆344Updated this week
• ray-project / ray-llm
  RayLLM - LLMs on Ray (Archived). Read README for more info.
  ☆1,263Updated 2 weeks ago
• npuichigo / openai_trtllm
  OpenAI compatible API for TensorRT LLM triton backend
  ☆201Updated 7 months ago
• grgalex / nvshare
  Practical GPU Sharing Without Memory Size Constraints
  ☆258Updated 6 months ago
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆90Updated this week
• NVIDIA / mig-parted
  MIG Partition Editor for NVIDIA GPUs
  ☆191Updated this week
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆289Updated last month
• NVIDIA / cloud-native-stack
  Run cloud native workloads on NVIDIA GPUs
  ☆164Updated last week