Alternatives and similar repositories for nim-deploy:

Users that are interested in nim-deploy are comparing it to the libraries listed below

• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆136Updated this week
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆74Updated this week
• run-ai / runai-model-streamer
  ☆150Updated this week
• NVIDIA / nvidia-terraform-modules
  Infrastructure as code for GPU accelerated managed Kubernetes clusters.
  ☆49Updated last month
• langchain-ai / langchain-nvidia
  ☆112Updated this week
• ray-project / llmperf
  LLMPerf is a library for validating and benchmarking LLMs
  ☆703Updated last month
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆79Updated this week
• opea-project / GenAIEval
  Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety…
  ☆25Updated this week
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆58Updated 3 weeks ago
• triton-inference-server / vllm_backend
  ☆215Updated this week
• AI-Hypercomputer / JetStream
  JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
  ☆266Updated this week
• opea-project / GenAIComps
  GenAI components at micro-service level; GenAI service composer to create mega-service
  ☆87Updated this week
• opea-project / docs
  This repo contains documents of the OPEA project
  ☆28Updated this week
• anyscale / llm-router
  Tutorial for building LLM router
  ☆170Updated 5 months ago
• langfuse / langfuse-k8s
  Community-maintained Kubernetes config and Helm chart for Langfuse
  ☆67Updated this week
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated last year
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆183Updated last month
• deepset-ai / rag-with-nvidia-nims
  🚀 Use NVIDIA NIMs with Haystack pipelines
  ☆30Updated 4 months ago
• triton-inference-server / triton_cli
  Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…
  ☆52Updated this week
• NVIDIA / workbench-example-mistral-finetune
  An NVIDIA AI Workbench example project for fine-tuning a Mistral 7B model
  ☆50Updated 7 months ago
• aws-samples / awsome-inference
  ☆36Updated last week
• NVIDIA / metropolis-nim-workflows
  Collection of reference workflows for building intelligent agents with NIMs
  ☆136Updated this week
• langchain-ai / helm
  Repository hosting Langchain helm charts.
  ☆42Updated this week
• cohere-ai / cohere-aws
  ☆60Updated 3 weeks ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆108Updated 2 months ago
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆217Updated this week
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆86Updated this week
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆29Updated this week
• substratusai / vllm-docker
  ☆49Updated 2 weeks ago
• ray-project / kuberay-helm
  Helm charts for the KubeRay project
  ☆36Updated 3 months ago