Alternatives and similar repositories for awesome-llm-devops

Users that are interested in awesome-llm-devops are comparing it to the libraries listed below

• avsthiago / kopylot
  An AI-Powered assistant for Kubernetes developers
  ☆189Updated last year
• aipengineer / awesome-opensource-ai-engineering
  Explore a curated collection of exceptional open-source libraries for generative AI meticulously reviewed or slated for review by The AI …
  ☆58Updated last year
• prem-research / prem-operator
  📡 Deploy AI models and apps to Kubernetes without developing a hernia
  ☆33Updated last year
• substratusai / helm
  ☆18Updated last year
• mrmaheshrajput / productionizing-llms
  Code Repository for Blog - How to Productionize Large Language Models (LLMs)
  ☆12Updated last year
• samalba / hf-model-ops
  🤗 MLOps with Hugging Face Spaces and Dagger
  ☆46Updated 2 years ago
• substratusai / vllm-docker
  ☆64Updated 6 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆150Updated 2 weeks ago
• kedargmnv / AICodeReview
  AI Code Review automates GitLab merge request reviews using OpenAI's GPT-4. It analyzes code changes, skips ignored files, and posts feed…
  ☆22Updated 4 months ago
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated 2 years ago
• elliotaplant / role-based-rag
  Demo of Role-Based Access Control in LLM Vector Databases
  ☆16Updated last year
• jjoneson / k8s-langchain
  Kuberentes LangChain Agent - Interact with Kubernetes Clusters using LLMs
  ☆26Updated 2 years ago
• rubra-ai / rubra
  Open Weight, tool-calling LLMs
  ☆155Updated 11 months ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆275Updated last year
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆155Updated last week
• fuzzylabs / sre-agent
  A Site Reliability Engineer AI agent that can monitor application and infrastructure logs, diagnose issues, and report on diagnostics.
  ☆88Updated this week
• amazon-science / CodeSage
  CodeSage: Code Representation Learning At Scale (ICLR 2024)
  ☆112Updated 11 months ago
• substratusai / runbooks
  Finetune LLMs on K8s by using Runbooks
  ☆170Updated last year
• ray-project / kuberay-helm
  Helm charts for the KubeRay project
  ☆51Updated 2 months ago
• awesome-mlops / awesome-mlops-platforms
  A curated list of awesome open source and commercial MLOps platforms 🚀
  ☆29Updated 3 years ago
• chenhunghan / ialacol
  🪶 Lightweight OpenAI drop-in replacement for Kubernetes
  ☆146Updated last year
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆114Updated last year
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆149Updated 11 months ago
• aws-samples / evaluating-large-language-models-using-llm-as-a-judge
  ☆19Updated 8 months ago
• llmariner / llmariner
  Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.
  ☆91Updated last week
• langfuse / langfuse-k8s
  Community-maintained Kubernetes config and Helm chart for Langfuse
  ☆160Updated this week
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆72Updated last year
• k8sgpt-ai / k8sgpt-operator
  Automatic SRE Superpowers within your Kubernetes cluster
  ☆390Updated this week
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆108Updated last year
• Ionio-io / LLM-agent-for-code-reviews
  An autonomous agent to automate your code review workflow made using crewAI
  ☆16Updated last year