flavienbwk / awesome-llm-devops
A list of DevOps features enabled by awesome LLM software.
â49Updated 5 months ago
Alternatives and similar repositories for awesome-llm-devops:
Users that are interested in awesome-llm-devops are comparing it to the libraries listed below
- ðĄ Deploy AI models and apps to Kubernetes without developing a herniaâ32Updated 8 months ago
- An AI-Powered assistant for Kubernetes developersâ175Updated last year
- â18Updated 6 months ago
- ð An awesome & curated list of best LLMOps tools.â40Updated last week
- A curated list of awesome open source and commercial MLOps platforms ðâ23Updated 2 years ago
- Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.â49Updated this week
- Awesome series for LLMOpsâ39Updated 6 months ago
- Kuberentes LangChain Agent - Interact with Kubernetes Clusters using LLMsâ23Updated last year
- Self-host LLMs with vLLM and BentoMLâ87Updated this week
- Helm charts for the KubeRay projectâ38Updated this week
- A diverse, simple, and secure all-in-one LLMOps platformâ98Updated 5 months ago
- Helm charts to deploy Weaviate to k8sâ58Updated this week
- ðŠķ Lightweight OpenAI drop-in replacement for Kubernetesâ143Updated last year
- ðĪ A collection of AWESOME structured summaries of Large Language Models (LLMs)â26Updated last year
- OpenAI compatible API for open source LLMsâ15Updated last year
- Repository hosting Langchain helm charts.â44Updated this week
- Community-maintained Kubernetes config and Helm chart for Langfuseâ76Updated 3 weeks ago
- Chat to deploy and manage applications on any infrastructureâ127Updated last year
- â86Updated 5 months ago
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)â251Updated last year
- The backend behind the LLM-Perf Leaderboardâ10Updated 9 months ago
- This is a landscape of the infrastructure that powers the generative AI ecosystemâ136Updated 4 months ago
- Using LlamaIndex with Ray for productionizing LLM applicationsâ71Updated last year
- GPT-4 Level Conversational QA Trained In a Few Hoursâ58Updated 6 months ago
- a series of tutorials implementing rag service with BentoML and LlamaIndexâ32Updated last month
- Open Weight, tool-calling LLMsâ151Updated 3 months ago
- Automatic SRE Superpowers within your Kubernetes clusterâ343Updated this week
- DevOps AI Assistant benchmarks for AWS, Kubernetes, and moreâ39Updated 6 months ago
- Explore the use of DSPy for extracting features from PDFs ðâ38Updated 11 months ago