Alternatives and similar repositories for awesome-llm-devops

Users that are interested in awesome-llm-devops are comparing it to the libraries listed below

• prem-research / prem-operator
  📡 Deploy AI models and apps to Kubernetes without developing a hernia
  ☆32Updated last year
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆148Updated 9 months ago
• jjoneson / k8s-langchain
  Kuberentes LangChain Agent - Interact with Kubernetes Clusters using LLMs
  ☆26Updated 2 years ago
• amazon-science / CodeSage
  CodeSage: Code Representation Learning At Scale (ICLR 2024)
  ☆111Updated 9 months ago
• substratusai / helm
  ☆18Updated 11 months ago
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆141Updated this week
• avsthiago / kopylot
  An AI-Powered assistant for Kubernetes developers
  ☆188Updated last year
• mrmaheshrajput / productionizing-llms
  Code Repository for Blog - How to Productionize Large Language Models (LLMs)
  ☆11Updated last year
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated 2 years ago
• codedog-ai / codedog
  Code review assistant powered by LLM
  ☆153Updated 3 weeks ago
• weaviate / weaviate-helm
  Helm charts to deploy Weaviate to k8s
  ☆62Updated this week
• elliotaplant / role-based-rag
  Demo of Role-Based Access Control in LLM Vector Databases
  ☆16Updated last year
• wenqiglantz / DevSecOpsKB-LlamaIndex-LangChain-OpenAI
  DevSecOps knowledge base chatbot built with LlamaIndex, LangChain, and OpenAI
  ☆105Updated last year
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆270Updated last year
• awesome-mlops / awesome-mlops-platforms
  A curated list of awesome open source and commercial MLOps platforms 🚀
  ☆29Updated 3 years ago
• IlyasMoutawwakil / llm-perf-backend
  The backend behind the LLM-Perf Leaderboard
  ☆10Updated last year
• langfuse / langfuse-k8s
  Community-maintained Kubernetes config and Helm chart for Langfuse
  ☆143Updated this week
• rubra-ai / rubra
  Open Weight, tool-calling LLMs
  ☆155Updated 9 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆140Updated this week
• chenhunghan / ialacol
  🪶 Lightweight OpenAI drop-in replacement for Kubernetes
  ☆146Updated last year
• redis-developer / LLM-Document-Chat
  Using LlamaIndex, Redis, and OpenAI to chat with PDF documents. Supplementary material for blog post on Microsoft Developer Blog
  ☆114Updated last year
• KennethanCeyer / awesome-llmops
  Awesome series for LLMOps
  ☆47Updated 4 months ago
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆114Updated last year
• ray-project / kuberay-helm
  Helm charts for the KubeRay project
  ☆50Updated 3 weeks ago
• substratusai / runbooks
  Finetune LLMs on K8s by using Runbooks
  ☆169Updated 11 months ago
• kedargmnv / AICodeReview
  AI Code Review automates GitLab merge request reviews using OpenAI's GPT-4. It analyzes code changes, skips ignored files, and posts feed…
  ☆20Updated 3 months ago
• opstower-ai / llm-opstower
  DevOps AI Assistant CLI. Ask questions about your AWS services, cloudwatch metrics, and billing.
  ☆70Updated last year
• alexei-led / k8s-mcp-server
  K8s-mcp-server is a Model Context Protocol (MCP) server that enables AI assistants like Claude to securely execute Kubernetes commands. I…
  ☆160Updated 3 months ago
• marklysze / LangChain-RAG-Linux
  Examples of RAG using LangChain with local LLMs - Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B
  ☆40Updated last year
• k8sgpt-ai / k8sgpt-operator
  Automatic SRE Superpowers within your Kubernetes cluster
  ☆385Updated last week