Alternatives and similar repositories for nim-deploy:

Users that are interested in nim-deploy are comparing it to the libraries listed below

• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆159Updated last week
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆100Updated this week
• run-ai / runai-model-streamer
  ☆207Updated this week
• NVIDIA-AI-Blueprints / rag
  This NVIDIA RAG blueprint serves as a reference solution for a foundational Retrieval Augmented Generation (RAG) pipeline.
  ☆89Updated this week
• langchain-ai / langchain-nvidia
  ☆152Updated this week
• NVIDIA / nvidia-terraform-modules
  Infrastructure as code for GPU accelerated managed Kubernetes clusters.
  ☆55Updated last week
• kserve / modelmesh-serving
  Controller for ModelMesh
  ☆229Updated this week
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆109Updated this week
• NVIDIA / cloud-native-stack
  Run cloud native workloads on NVIDIA GPUs
  ☆168Updated 2 weeks ago
• triton-inference-server / triton_cli
  Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…
  ☆62Updated 2 weeks ago
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆54Updated 9 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆202Updated 9 months ago
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆291Updated this week
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆229Updated this week
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated last year
• NVIDIA / k8s-dra-driver-gpu
  Dynamic Resource Allocation (DRA) for NVIDIA GPUs in Kubernetes
  ☆353Updated this week
• ray-project / kuberay-helm
  Helm charts for the KubeRay project
  ☆43Updated last month
• deepset-ai / rag-with-nvidia-nims
  🚀 Use NVIDIA NIMs with Haystack pipelines
  ☆31Updated 8 months ago
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆110Updated last week
• opea-project / GenAIInfra
  Containerization and cloud native suite for OPEA
  ☆57Updated this week
• kubeflow / model-registry
  Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. I…
  ☆119Updated this week
• aws-samples / awsome-inference
  ☆46Updated last week
• triton-inference-server / vllm_backend
  ☆253Updated this week
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆94Updated this week
• NVIDIA / metropolis-nim-workflows
  Collection of reference workflows for building intelligent agents with NIMs
  ☆155Updated 3 months ago
• NVIDIA / mig-parted
  MIG Partition Editor for NVIDIA GPUs
  ☆198Updated this week
• NVIDIA / KAI-Scheduler
  KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale
  ☆539Updated this week
• AI21Labs / ai21-python
  AI21 Python SDK
  ☆63Updated this week
• NVIDIA / NeMo-Framework-Launcher
  Provides end-to-end model development pipelines for LLMs and Multimodal models that can be launched on-prem or cloud-native.
  ☆501Updated 3 weeks ago
• kserve / modelmesh
  Distributed Model Serving Framework
  ☆165Updated this week