flavienbwk / awesome-llm-devopsLinks
A list of DevOps features enabled by awesome LLM software.
☆57Updated 2 months ago
Alternatives and similar repositories for awesome-llm-devops
Users that are interested in awesome-llm-devops are comparing it to the libraries listed below
Sorting:
- An AI-Powered assistant for Kubernetes developers☆194Updated 2 years ago
- ☆18Updated last year
- Code Repository for Blog - How to Productionize Large Language Models (LLMs)☆12Updated last year
- A set of lessons aimed at anyone learning LLM and generative AI concepts, with sections on operations and security, as well as developme…☆280Updated last year
- ☆67Updated 10 months ago
- Code review assistant powered by LLM☆192Updated this week
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆280Updated 2 years ago
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆33Updated last year
- 🤗 MLOps with Hugging Face Spaces and Dagger☆46Updated 2 years ago
- Kuberentes LangChain Agent - Interact with Kubernetes Clusters using LLMs☆27Updated 2 years ago
- Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.☆93Updated 4 months ago
- DevSecOps knowledge base chatbot built with LlamaIndex, LangChain, and OpenAI☆103Updated 2 years ago
- CodeSage: Code Representation Learning At Scale (ICLR 2024)☆116Updated last year
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- This is a landscape of the infrastructure that powers the generative AI ecosystem☆152Updated last year
- A Site Reliability Engineer AI agent that can monitor application and infrastructure logs, diagnose issues, and report on diagnostics.☆145Updated this week
- Finetune LLMs on K8s by using Runbooks☆170Updated last year
- Open Weight, tool-calling LLMs☆156Updated last year
- ☆15Updated 6 months ago
- GenAIOps on Kubernetes: A collection of reference architectures for running GenAI at scale on Kubernetes using OSS tooling☆135Updated last year
- Awesome series for LLMOps☆50Updated 10 months ago
- Community-maintained Kubernetes config and Helm chart for Langfuse☆213Updated this week
- Helm charts to deploy Weaviate to k8s☆65Updated 3 months ago
- Self-host LLMs with vLLM and BentoML☆168Updated 3 weeks ago
- Helloworld for agentic frameworks, minimial but runnable! LangGraph, Agno, AutoGen, Smolagents, OpenAI Agents, etc.☆53Updated 6 months ago
- This repository contains resources, documentation and artifacts describing LLM agents☆15Updated last year
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated 2 years ago
- ☆82Updated 3 months ago
- Helm charts for the KubeRay project☆59Updated 2 months ago
- 🪶 Lightweight OpenAI drop-in replacement for Kubernetes☆147Updated 2 years ago