Alternatives and similar repositories for nim-anywhere:

Users that are interested in nim-anywhere are comparing it to the libraries listed below

• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆151Updated last week
• NVIDIA / workbench-example-hybrid-rag
  An NVIDIA AI Workbench example project for Retrieval Augmented Generation (RAG)
  ☆289Updated last month
• run-ai / runai-model-streamer
  ☆150Updated this week
• NVIDIA / workbench-example-mistral-finetune
  An NVIDIA AI Workbench example project for fine-tuning a Mistral 7B model
  ☆50Updated 7 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆79Updated this week
• langchain-ai / langchain-nvidia
  ☆112Updated this week
• NVIDIA / metropolis-nim-workflows
  Collection of reference workflows for building intelligent agents with NIMs
  ☆136Updated this week
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆99Updated 6 months ago
• opea-project / GenAIComps
  GenAI components at micro-service level; GenAI service composer to create mega-service
  ☆87Updated this week
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆183Updated last month
• NVIDIA / trt-llm-as-openai-windows
  This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows inste…
  ☆117Updated 10 months ago
• run-llama / awesome-rag
  ☆69Updated 9 months ago
• huggingface / Google-Cloud-Containers
  Hugging Face Deep Learning Containers (DLCs) for Google Cloud
  ☆136Updated this week
• triton-inference-server / triton_cli
  Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…
  ☆52Updated this week
• NVIDIA / RTX-AI-Toolkit
  The NVIDIA RTX™ AI Toolkit is a suite of tools and SDKs for Windows developers to customize, optimize, and deploy AI models across RTX PC…
  ☆126Updated last month
• lamini-ai / lamini-examples
  ☆154Updated last month
• NVIDIA / cloud-native-stack
  Run cloud native workloads on NVIDIA GPUs
  ☆150Updated last month
• triton-inference-server / vllm_backend
  ☆215Updated this week
• anyscale / llm-router
  Tutorial for building LLM router
  ☆170Updated 5 months ago
• meta-llama / llama-stack-client-python
  Python SDK for Llama Stack
  ☆106Updated this week
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆280Updated last month
• substratusai / vllm-docker
  ☆49Updated 2 weeks ago
• groq / groqflow
  GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing tho…
  ☆106Updated last month
• deepset-ai / rag-with-nvidia-nims
  🚀 Use NVIDIA NIMs with Haystack pipelines
  ☆30Updated 4 months ago
• opea-project / GenAIEval
  Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety…
  ☆25Updated this week
• AI-Hypercomputer / JetStream
  JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
  ☆266Updated this week
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated last year
• NVIDIA / workbench-example-agentic-rag
  An NVIDIA AI Workbench example project for an Agentic Retrieval Augmented Generation (RAG)
  ☆41Updated 2 months ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆58Updated 3 weeks ago