Alternatives and similar repositories for rntop

Users that are interested in rntop are comparing it to the libraries listed below

• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆111Updated last week
• clearml / clearml-fractional-gpu
  ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing
  ☆80Updated last year
• mlcommons / mlcube
  MLCube® is a project that reduces friction for machine learning by ensuring that models are easily portable and reproducible.
  ☆157Updated last year
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆268Updated last month
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆59Updated 4 months ago
• run-ai / vscode-genv
  GPU Environment Management for Visual Studio Code
  ☆39Updated 2 years ago
• kserve / modelmesh-serving
  Controller for ModelMesh
  ☆237Updated 3 months ago
• run-ai / docs
  markdown docs
  ☆93Updated this week
• kserve / modelmesh
  Distributed Model Serving Framework
  ☆178Updated this week
• coreweave / ml-containers
  ☆40Updated this week
• run-ai / genv
  GPU environment and cluster management with LLM support
  ☆641Updated last year
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆46Updated 3 years ago
• meta-pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆392Updated this week
• run-ai / runai-model-streamer
  ☆255Updated this week
• ForestFlow / ForestFlow
  ForestFlow is a policy-driven Machine Learning Model Server. It is an LF AI Foundation incubation project.
  ☆73Updated last year
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆159Updated last week
• lambdal / lambda-stack-dockerfiles
  ☆279Updated 6 months ago
• triton-inference-server / fil_backend
  FIL backend for the Triton Inference Server
  ☆83Updated 3 weeks ago
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆211Updated 5 months ago
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆162Updated last week
• NVIDIA / mig-parted
  MIG Partition Editor for NVIDIA GPUs
  ☆215Updated last week
• chassisml / chassis
  Chassis turns machine learning models into portable container images that can run just about anywhere.
  ☆86Updated last year
• NVIDIA / cloud-native-stack
  Run cloud native workloads on NVIDIA GPUs
  ☆198Updated this week
• kserve / website
  User documentation for KServe.
  ☆108Updated last week
• terrytangyuan / awesome-kubeflow
  A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)
  ☆215Updated 2 months ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆61Updated 2 weeks ago
• SeldonIO / mlgraph
  Machine Learning Inference Graph Spec
  ☆21Updated 6 years ago
• coreweave / kubernetes-cloud
  Getting Started with the CoreWeave Kubernetes GPU Cloud
  ☆75Updated 3 months ago
• mlspec / MLSpec
  Unified specification for defining and executing ML workflows, making reproducibility, consistency, and governance easier across the ML p…
  ☆94Updated last year
• NVIDIA / pyxis
  Container plugin for Slurm Workload Manager
  ☆382Updated last week