Alternatives and similar repositories for nim-deploy

Users that are interested in nim-deploy are comparing it to the libraries listed below

• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆170Updated last month
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆114Updated this week
• NVIDIA / cloud-native-stack
  Run cloud native workloads on NVIDIA GPUs
  ☆180Updated last month
• run-ai / runai-model-streamer
  ☆221Updated this week
• langchain-ai / langchain-nvidia
  ☆157Updated this week
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆358Updated this week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆129Updated last month
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆56Updated last month
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆98Updated last week
• GoogleCloudPlatform / ai-on-gke
  AI on GKE is a collection of examples, best-practices, and prebuilt solutions to help build, deploy, and scale AI Platforms on Google Kub…
  ☆321Updated this week
• triton-inference-server / triton_cli
  Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…
  ☆64Updated 2 weeks ago
• NVIDIA / k8s-dra-driver-gpu
  Dynamic Resource Allocation (DRA) for NVIDIA GPUs in Kubernetes
  ☆377Updated last week
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆123Updated this week
• NVIDIA-AI-Blueprints / rag
  This NVIDIA RAG blueprint serves as a reference solution for a foundational Retrieval Augmented Generation (RAG) pipeline.
  ☆127Updated this week
• NVIDIA / mig-parted
  MIG Partition Editor for NVIDIA GPUs
  ☆201Updated last week
• kserve / modelmesh-serving
  Controller for ModelMesh
  ☆232Updated 2 weeks ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆210Updated 11 months ago
• kserve / models-web-app
  KServe models web UI
  ☆38Updated last week
• aws-neuron / transformers-neuronx
  ☆110Updated 5 months ago
• NVIDIA / workbench-example-mistral-finetune
  An NVIDIA AI Workbench example project for fine-tuning a Mistral 7B model
  ☆59Updated last year
• opea-project / GenAIInfra
  Containerization and cloud native suite for OPEA
  ☆67Updated this week
• kserve / website
  User documentation for KServe.
  ☆106Updated this week
• opea-project / GenAIComps
  GenAI components at micro-service level; GenAI service composer to create mega-service
  ☆160Updated this week
• triton-inference-server / vllm_backend
  ☆267Updated 2 weeks ago
• NVIDIA / topograph
  A toolkit for discovering cluster network topology.
  ☆54Updated last week
• kubernetes-sigs / gateway-api-inference-extension
  Gateway API Inference Extension
  ☆351Updated this week
• kserve / modelmesh
  Distributed Model Serving Framework
  ☆170Updated 3 weeks ago
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆67Updated last week
• AI-Hypercomputer / JetStream
  JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
  ☆349Updated 2 weeks ago
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆76Updated this week