Alternatives and similar repositories for nim-deploy

Users that are interested in nim-deploy are comparing it to the libraries listed below

• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆199Updated 8 months ago
• NVIDIA / nvidia-terraform-modules
  Infrastructure as code for GPU accelerated managed Kubernetes clusters.
  ☆57Updated 8 months ago
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆140Updated this week
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆62Updated 8 months ago
• NVIDIA-AI-Blueprints / rag
  This NVIDIA RAG blueprint serves as a reference solution for a foundational Retrieval Augmented Generation (RAG) pipeline.
  ☆431Updated this week
• NVIDIA / cloud-native-stack
  Run cloud native workloads on NVIDIA GPUs
  ☆215Updated this week
• opea-project / GenAIComps
  GenAI components at micro-service level; GenAI service composer to create mega-service
  ☆193Updated last week
• GoogleCloudPlatform / ai-on-gke
  AI on GKE is a collection of examples, best-practices, and prebuilt solutions to help build, deploy, and scale AI Platforms on Google Kub…
  ☆327Updated 6 months ago
• run-ai / runai-model-streamer
  ☆274Updated this week
• langchain-ai / langchain-nvidia
  ☆181Updated last week
• NVIDIA / NeMo-Agent-Toolkit-UI
  The NVIDIA NeMo Agent Toolkit UI streamlines interacting with NeMo Agent Toolkit workflows in an easy-to-use web application.
  ☆65Updated this week
• opea-project / GenAIEval
  Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety…
  ☆38Updated last week
• aws-neuron / upstreaming-to-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆25Updated 2 months ago
• NVIDIA / NeMo-Framework-Launcher
  Provides end-to-end model development pipelines for LLMs and Multimodal models that can be launched on-prem or cloud-native.
  ☆508Updated 8 months ago
• kserve / modelmesh-serving
  Controller for ModelMesh
  ☆243Updated 7 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆163Updated last month
• NVIDIA / workbench-example-hybrid-rag
  An NVIDIA AI Workbench example project for Retrieval Augmented Generation (RAG)
  ☆361Updated 5 months ago
• run-ai / docs
  markdown docs
  ☆93Updated last month
• NVIDIA / workbench-example-mistral-finetune
  An NVIDIA AI Workbench example project for fine-tuning a Mistral 7B model
  ☆69Updated last year
• opea-project / GenAIInfra
  Containerization and cloud native suite for OPEA
  ☆74Updated last week
• vllm-project / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆799Updated this week
• triton-inference-server / triton_cli
  Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…
  ☆73Updated this week
• kserve / modelmesh
  Distributed Model Serving Framework
  ☆183Updated 3 months ago
• aws-samples / awsome-inference
  ☆58Updated last week
• aws-neuron / transformers-neuronx
  ☆111Updated last year
• huggingface / Google-Cloud-Containers
  Hugging Face Deep Learning Containers (DLCs) for Google Cloud
  ☆162Updated last month
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆161Updated last week
• ray-project / kuberay-helm
  Helm charts for the KubeRay project
  ☆59Updated last month
• NVIDIA / topograph
  A toolkit for discovering cluster network topology.
  ☆89Updated this week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆131Updated 3 months ago