NVIDIA / nim-deploy
A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deployment.
☆177Updated 2 weeks ago
Alternatives and similar repositories for nim-deploy:
Users that are interested in nim-deploy are comparing it to the libraries listed below
- Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench☆151Updated 2 weeks ago
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆88Updated this week
- ☆173Updated last week
- Run cloud native workloads on NVIDIA GPUs☆164Updated this week
- ☆142Updated 3 weeks ago
- Infrastructure as code for GPU accelerated managed Kubernetes clusters.☆54Updated 3 months ago
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆299Updated this week
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆224Updated this week
- Helm charts for the KubeRay project☆43Updated this week
- Self-host LLMs with vLLM and BentoML☆94Updated this week
- IBM development fork of https://github.com/huggingface/text-generation-inference☆60Updated 3 months ago
- AI on GKE is a collection of examples, best-practices, and prebuilt solutions to help build, deploy, and scale AI Platforms on Google Kub…☆292Updated this week
- Containerization and cloud native suite for OPEA☆44Updated this week
- Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.☆221Updated this week
- Tutorial for building LLM router☆187Updated 8 months ago
- ☆238Updated this week
- Hugging Face Deep Learning Containers (DLCs) for Google Cloud☆142Updated last month
- Community-maintained Kubernetes config and Helm chart for Langfuse☆89Updated this week
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆122Updated 3 weeks ago
- ☆54Updated 6 months ago
- xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…☆107Updated this week
- ☆113Updated this week
- GenAI components at micro-service level; GenAI service composer to create mega-service☆126Updated this week
- Controller for ModelMesh☆225Updated 3 weeks ago
- OpenTelemetry Instrumentation for AI Observability☆339Updated this week
- Repository for open inference protocol specification☆50Updated 8 months ago
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated last year
- ☆43Updated last month
- ☆54Updated 2 months ago
- An NVIDIA AI Workbench example project for Retrieval Augmented Generation (RAG)☆307Updated 3 months ago