Alternatives and similar repositories for nim-deploy

Users that are interested in nim-deploy are comparing it to the libraries listed below

• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆165Updated last month
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆107Updated this week
• run-ai / runai-model-streamer
  ☆215Updated this week
• NVIDIA / nvidia-terraform-modules
  Infrastructure as code for GPU accelerated managed Kubernetes clusters.
  ☆54Updated last month
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆56Updated 3 weeks ago
• NVIDIA / cloud-native-stack
  Run cloud native workloads on NVIDIA GPUs
  ☆172Updated 3 weeks ago
• kserve / modelmesh-serving
  Controller for ModelMesh
  ☆230Updated 3 weeks ago
• langchain-ai / langchain-nvidia
  ☆156Updated this week
• NVIDIA / topograph
  A toolkit for discovering cluster network topology.
  ☆53Updated this week
• NVIDIA-AI-Blueprints / rag
  This NVIDIA RAG blueprint serves as a reference solution for a foundational Retrieval Augmented Generation (RAG) pipeline.
  ☆105Updated last week
• aws-samples / awsome-inference
  ☆47Updated last month
• AI-Hypercomputer / JetStream
  JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
  ☆334Updated this week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆127Updated last month
• kserve / modelmesh
  Distributed Model Serving Framework
  ☆168Updated 3 weeks ago
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆317Updated this week
• NVIDIA / KAI-Scheduler
  KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale
  ☆590Updated this week
• triton-inference-server / triton_cli
  Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…
  ☆62Updated 2 weeks ago
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆95Updated 3 weeks ago
• NVIDIA / NeMo-Framework-Launcher
  Provides end-to-end model development pipelines for LLMs and Multimodal models that can be launched on-prem or cloud-native.
  ☆504Updated last month
• NVIDIA / mig-parted
  MIG Partition Editor for NVIDIA GPUs
  ☆198Updated 2 weeks ago
• triton-inference-server / vllm_backend
  ☆260Updated 2 weeks ago
• kubernetes-sigs / gateway-api-inference-extension
  Gateway API Inference Extension
  ☆317Updated this week
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆234Updated this week
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆227Updated last week
• substratusai / kubeai
  AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-te…
  ☆970Updated last week
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆60Updated 3 weeks ago
• NVIDIA / k8s-dra-driver-gpu
  Dynamic Resource Allocation (DRA) for NVIDIA GPUs in Kubernetes
  ☆363Updated this week
• kserve / models-web-app
  KServe models web UI
  ☆38Updated this week
• huggingface / Google-Cloud-Containers
  Hugging Face Deep Learning Containers (DLCs) for Google Cloud
  ☆143Updated last month
• aws-neuron / upstreaming-to-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆16Updated this week