A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deployment.
☆241Sep 4, 2026Updated last month
Alternatives and similar repositories for nim-deploy
Users that are interested in nim-deploy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench☆281Sep 3, 2026Updated last month
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆160Oct 4, 2026Updated last week
- 🚀 Use NVIDIA NIMs with Haystack pipelines☆31Sep 4, 2024Updated 2 years ago
- ☆65Jul 15, 2026Updated 2 months ago
- Run cloud native workloads on NVIDIA GPUs☆248Jul 14, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Infrastructure as code for GPU accelerated managed Kubernetes clusters.☆62Sep 29, 2026Updated last week
- Training NVIDIA NeMo Megatron Large Language Model (LLM) using NeMo Framework on Google Kubernetes Engine☆16Apr 28, 2025Updated last year
- Provides end-to-end model development pipelines for LLMs and Multimodal models that can be launched on-prem or cloud-native.☆522Apr 18, 2025Updated last year
- ☆12Mar 16, 2026Updated 6 months ago
- HyDE based RAG using NVIDIA NIM.☆16Mar 20, 2024Updated 2 years ago
- The NVIDIA NeMo Agent Toolkit UI streamlines interacting with NeMo Agent Toolkit workflows in an easy-to-use web application.☆110Sep 16, 2026Updated 3 weeks ago
- Community examples utilizing NVIDIA NeMo Agent Toolkit.☆32Aug 12, 2026Updated last month
- Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…☆73Sep 16, 2026Updated 3 weeks ago
- The NVIDIA NeMo Agent toolkit is an open-source library for efficiently connecting and optimizing teams of AI agents.☆2,662Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆217Updated this week
- NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes☆2,921Updated this week
- Enhance your knowledge in medical research with the help of LLM and RAG.☆36Oct 24, 2024Updated last year
- Implementation of SCINS☆17Nov 6, 2024Updated last year
- Custom Scheduler to deploy ML models to TRTIS for GPU Sharing☆12Apr 1, 2020Updated 6 years ago
- Experimenting text-embeddings-inference server on both CPU and GPU☆18Oct 25, 2023Updated 2 years ago
- An NVIDIA AI Workbench example project for Retrieval Augmented Generation (RAG)☆380Aug 12, 2025Updated last year
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆69Aug 27, 2026Updated last month
- Tools to deploy GPU clusters in the Cloud☆34Apr 4, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Kubernetes Operator, Helm Charts, Ansible Playbooks, and utility scripts for large-scale AIStore deployments on Kubernetes.☆137Updated this week
- A Datacenter Scale Distributed Inference Serving Framework☆8,256Updated this week
- Example ML projects that use the Determined library.☆33Sep 11, 2024Updated 2 years ago
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆869Updated this week
- This repository contains the results and code for the MLPerf™ Training v3.0 benchmark.☆12Aug 10, 2023Updated 3 years ago
- Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.☆141Sep 8, 2026Updated last month
- ☆14May 29, 2024Updated 2 years ago
- [DEPRECATED] Moved to ROCm/rocm-libraries repo☆27Sep 28, 2026Updated last week
- ☆25Apr 4, 2026Updated 6 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- GPU Environment Management for JupyterLab☆26Feb 19, 2024Updated 2 years ago
- htop-like TUI for real-time RDMA network monitoring.☆113Oct 2, 2026Updated last week
- ☆15Mar 6, 2024Updated 2 years ago
- This repository contains tutorials and examples for Triton Inference Server☆869Updated this week
- ☆388Updated this week
- TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizat…☆14,787Updated this week
- A collection of container tutorials that gets you on-boarded to CONTAINER WORLD!☆20Sep 25, 2019Updated 7 years ago