Alternatives and similar repositories for Awesome-LLMOps:

Users that are interested in Awesome-LLMOps are comparing it to the libraries listed below

• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆69Updated this week
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆98Updated 5 months ago
• tensorchord / llmspec
  OpenAI compatible API for open source LLMs
  ☆15Updated last year
• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated 3 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆87Updated this week
• InftyAI / Manta
  💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…
  ☆20Updated 2 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆62Updated 10 months ago
• premAI-io / prem-operator
  📡 Deploy AI models and apps to Kubernetes without developing a hernia
  ☆32Updated 8 months ago
• BaizeAI / kcover
  🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
  ☆26Updated last month
• llmariner / llmariner
  Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.
  ☆49Updated this week
• kubevela / prism
  API Extensions for core KubeVela.
  ☆11Updated this week
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆136Updated 4 months ago
• langchain-ai / helm
  Repository hosting Langchain helm charts.
  ☆44Updated this week
• substratusai / vllm-docker
  ☆53Updated last month
• NVIDIA / knavigator
  knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
  ☆62Updated 3 weeks ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆251Updated last year
• gptscript-ai / gptparse
  Document parser for RAG
  ☆20Updated 3 months ago
• nekomeowww / ollama-operator
  🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫
  ☆139Updated this week
• kerthcet / k8s-specific-knowledge-base
  A QA system based on k8s-specific knowledge build on ChatGLM2-6B, serving by Ray.
  ☆9Updated last year
• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆48Updated last month
• run-llama / mixtral_ollama
  ☆45Updated last year
• copilot-io / runtime-copilot
  The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…
  ☆12Updated last year
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated last year
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆17Updated this week
• langchain-ai / langchain-redis
  ☆23Updated last week
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 2 months ago
• namuan / llm-playground
  Experiments with open source LLMs
  ☆72Updated this week
• feiskyer / ChatGPT-Reviewer
  Automated pull requests reviewing and issues triaging with ChatGPT.
  ☆70Updated last year