flavienbwk / awesome-llm-devopsLinks
A list of DevOps features enabled by awesome LLM software.
☆58Updated last week
Alternatives and similar repositories for awesome-llm-devops
Users that are interested in awesome-llm-devops are comparing it to the libraries listed below
Sorting:
- A Site Reliability Engineer AI agent that can monitor application and infrastructure logs, diagnose issues, and report on diagnostics.☆124Updated 3 weeks ago
- An AI-Powered assistant for Kubernetes developers☆192Updated last year
- Code review assistant powered by LLM☆183Updated 2 weeks ago
- This is a landscape of the infrastructure that powers the generative AI ecosystem☆151Updated last year
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆278Updated 2 years ago
- 🎉 An awesome & curated list of best LLMOps tools.☆175Updated 3 weeks ago
- Code Repository for Blog - How to Productionize Large Language Models (LLMs)☆12Updated last year
- Kuberentes LangChain Agent - Interact with Kubernetes Clusters using LLMs☆27Updated 2 years ago
- This repository contains resources, documentation and artifacts describing LLM agents☆15Updated 10 months ago
- Community-maintained Kubernetes config and Helm chart for Langfuse☆197Updated this week
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- ☆18Updated last year
- A set of lessons aimed at anyone learning LLM and generative AI concepts, with sections on operations and security, as well as developme…☆279Updated last year
- Open Weight, tool-calling LLMs☆155Updated last year
- Helm charts to deploy Weaviate to k8s☆66Updated last month
- 🪶 Lightweight OpenAI drop-in replacement for Kubernetes☆146Updated last year
- CodeSage: Code Representation Learning At Scale (ICLR 2024)☆114Updated last year
- DevSecOps knowledge base chatbot built with LlamaIndex, LangChain, and OpenAI☆104Updated last year
- 🤗 MLOps with Hugging Face Spaces and Dagger☆46Updated 2 years ago
- ☆66Updated 8 months ago
- Helm charts for the KubeRay project☆59Updated 3 weeks ago
- MLFlow Deployment Plugin for Ray Serve☆46Updated 3 years ago
- Your 24/7 On-Call AI Agent - Solve Alerts Faster with Automatic Correlations, Investigations, and More☆1,571Updated this week
- Finetune LLMs on K8s by using Runbooks☆170Updated last year
- CNCF Landscape Graph, data model, and applications.☆51Updated this week
- Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing …☆138Updated last year
- Self-host LLMs with vLLM and BentoML☆161Updated 3 weeks ago
- Automatic SRE Superpowers within your Kubernetes cluster☆407Updated this week
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆33Updated last year
- A curated list of awesome open source and commercial MLOps platforms 🚀☆32Updated 3 years ago