Alternatives and similar repositories for Awesome-LLMOps:

Users that are interested in Awesome-LLMOps are comparing it to the libraries listed below

• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆69Updated this week
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆86Updated this week
• tensorchord / llmspec
  OpenAI compatible API for open source LLMs
  ☆15Updated last year
• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated 3 months ago
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆98Updated 4 months ago
• premAI-io / prem-operator
  📡 Deploy AI models and apps to Kubernetes without developing a hernia
  ☆32Updated 8 months ago
• InftyAI / Manta
  💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…
  ☆20Updated 2 months ago
• llmariner / llmariner
  Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.
  ☆48Updated this week
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆62Updated 10 months ago
• gptscript-ai / gptparse
  Document parser for RAG
  ☆20Updated 3 months ago
• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆48Updated last month
• BaizeAI / kcover
  🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
  ☆26Updated last month
• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆18Updated 3 weeks ago
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆135Updated 4 months ago
• robbyt / llm_proxy
  AI aware proxy
  ☆18Updated 5 months ago
• etrobot / nextArtifacts
  A Next.js version of Claude Aritfacts , inspired by llamacoder
  ☆19Updated 4 months ago
• makllama / makllama
  MaK(Mac+Kubernetes)llama - Running and orchestrating large language models (LLMs) on Kubernetes with macOS nodes.
  ☆35Updated 8 months ago
• kerthcet / k8s-specific-knowledge-base
  A QA system based on k8s-specific knowledge build on ChatGLM2-6B, serving by Ray.
  ☆9Updated last year
• lightblue-tech / lb-reranker
  ☆19Updated 3 weeks ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆251Updated last year
• substratusai / vllm-docker
  ☆53Updated last month
• unifyai / aibench-llm-endpoints
  Runner in charge of collecting metrics from LLM inference endpoints for the Unify Hub
  ☆17Updated last year
• nekomeowww / ollama-operator
  Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫
  ☆138Updated 2 weeks ago
• DaoCloud / karmada-operator1
  ☆12Updated last year
• Wannabeasmartguy / RAGENT
  Probably one of the lightest native RAG + Agent apps out there，experience the power of Agent-powered models and Agent-driven knowledge ba…
  ☆22Updated this week
• llmapi-io / llmapi-server
  Self-host llmapi server, make it really easy for accessing LLMs !
  ☆37Updated last year
• run-ai / runai-model-streamer
  ☆159Updated this week
• jjoneson / k8s-langchain
  Kuberentes LangChain Agent - Interact with Kubernetes Clusters using LLMs
  ☆23Updated last year
• flame-sh / flame
  A distributed engine for intelligent workload
  ☆23Updated last week