A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deployment.
☆238May 15, 2026Updated last month
Alternatives and similar repositories for nim-deploy
Users that are interested in nim-deploy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench☆249May 1, 2025Updated last year
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆160Jun 25, 2026Updated last week
- 🚀 Use NVIDIA NIMs with Haystack pipelines☆32Sep 4, 2024Updated last year
- ☆62Feb 5, 2026Updated 4 months ago
- Infrastructure as code for GPU accelerated managed Kubernetes clusters.☆60Apr 30, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.☆4,092May 29, 2026Updated last month
- Run cloud native workloads on NVIDIA GPUs☆239Jan 22, 2026Updated 5 months ago
- ☆13Dec 20, 2025Updated 6 months ago
- DRA Driver for NVIDIA GPUs☆662Jun 25, 2026Updated last week
- Easy to use python wrapper around Deepstream Python bindings☆14Oct 11, 2021Updated 4 years ago
- ☆44Mar 13, 2026Updated 3 months ago
- MIG Partition Editor for NVIDIA GPUs☆255Updated this week
- Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.☆134Updated this week
- Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…☆73Jun 10, 2026Updated 3 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- The NVIDIA NeMo Agent toolkit is an open-source library for efficiently connecting and optimizing teams of AI agents.☆2,444Jun 25, 2026Updated last week
- Enhance your knowledge in medical research with the help of LLM and RAG.☆35Oct 24, 2024Updated last year
- Gateway API Inference Extension☆699Jun 17, 2026Updated 2 weeks ago
- ☆318Updated this week
- ☆206Updated this week
- Context-Aware RAG library for Knowledge Graph ingestion and retrieval functions.☆87Jun 23, 2026Updated last week
- NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes☆2,752Updated this week
- Issues related to MLPerf® Inference policies, including rules and suggested changes☆62Mar 27, 2026Updated 3 months ago
- Custom Scheduler to deploy ML models to TRTIS for GPU Sharing☆12Apr 1, 2020Updated 6 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference…☆19Mar 12, 2026Updated 3 months ago
- An NVIDIA AI Workbench example project for Retrieval Augmented Generation (RAG)☆369Aug 12, 2025Updated 10 months ago
- WG Serving☆38Mar 24, 2026Updated 3 months ago
- ☆15Apr 13, 2026Updated 2 months ago
- The NVIDIA NeMo Agent Toolkit UI streamlines interacting with NeMo Agent Toolkit workflows in an easy-to-use web application.☆102Jun 23, 2026Updated last week
- This repository contains the results and code for the MLPerf™ Training v3.0 benchmark.☆12Aug 10, 2023Updated 2 years ago
- [DEPRECATED] Moved to ROCm/rocm-libraries repo☆27Jun 24, 2026Updated last week
- ☆14May 29, 2024Updated 2 years ago
- GPU Environment Management for JupyterLab☆26Feb 19, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A Datacenter Scale Distributed Inference Serving Framework☆7,352Updated this week
- Graph-based learning in Python☆17Mar 9, 2018Updated 8 years ago
- TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizat…☆13,994Updated this week
- This lab is a starter for quickly and easily applying SLM/LLM fine-tuning, evaluation, and quantization with torchtune on Azure ML.☆15Jun 11, 2026Updated 3 weeks ago
- ☆38Updated this week
- A collection of useful Go libraries for use with NVIDIA GPU management tools☆56Jun 21, 2026Updated last week
- A collection of container tutorials that gets you on-boarded to CONTAINER WORLD!☆20Sep 25, 2019Updated 6 years ago