NVIDIA / nim-deployLinks
A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deployment.
☆189Updated this week
Alternatives and similar repositories for nim-deploy
Users that are interested in nim-deploy are comparing it to the libraries listed below
Sorting:
- Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench☆178Updated 3 months ago
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆120Updated this week
- ☆232Updated this week
- Repository for open inference protocol specification☆59Updated 2 months ago
- Controller for ModelMesh☆237Updated last month
- Infrastructure as code for GPU accelerated managed Kubernetes clusters.☆54Updated 3 months ago
- GenAI components at micro-service level; GenAI service composer to create mega-service☆167Updated last week
- Run cloud native workloads on NVIDIA GPUs☆188Updated this week
- AI on GKE is a collection of examples, best-practices, and prebuilt solutions to help build, deploy, and scale AI Platforms on Google Kub…☆324Updated last month
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆461Updated this week
- ☆160Updated this week
- Distributed Model Serving Framework☆174Updated 2 months ago
- markdown docs☆90Updated this week
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆723Updated this week
- User documentation for KServe.☆107Updated last month
- Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.☆106Updated last week
- Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. I…☆138Updated this week
- This NVIDIA RAG blueprint serves as a reference solution for a foundational Retrieval Augmented Generation (RAG) pipeline.☆212Updated 2 weeks ago
- Helm charts for the KubeRay project☆50Updated 3 weeks ago
- Self-host LLMs with vLLM and BentoML☆139Updated last week
- MIG Partition Editor for NVIDIA GPUs☆207Updated this week
- ☆47Updated 4 months ago
- KServe models web UI☆38Updated last week
- ☆28Updated 11 months ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆128Updated 3 weeks ago
- GPU environment and cluster management with LLM support☆624Updated last year
- An NVIDIA AI Workbench example project for Retrieval Augmented Generation (RAG)☆335Updated 2 months ago
- ☆134Updated this week
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆364Updated last month
- AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-te…☆1,034Updated 2 weeks ago