flavienbwk / awesome-llm-devopsLinks
A list of DevOps features enabled by awesome LLM software.
☆53Updated last year
Alternatives and similar repositories for awesome-llm-devops
Users that are interested in awesome-llm-devops are comparing it to the libraries listed below
Sorting:
- Self-host LLMs with vLLM and BentoML☆152Updated 2 weeks ago
- ☆18Updated last year
- An AI-Powered assistant for Kubernetes developers☆192Updated last year
- A curated list of awesome open source and commercial MLOps platforms 🚀☆29Updated 3 years ago
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆33Updated last year
- Explore a curated collection of exceptional open-source libraries for generative AI meticulously reviewed or slated for review by The AI …☆58Updated last year
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆275Updated last year
- Code Repository for Blog - How to Productionize Large Language Models (LLMs)☆12Updated last year
- Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing …☆138Updated last year
- Kuberentes LangChain Agent - Interact with Kubernetes Clusters using LLMs☆26Updated 2 years ago
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- 🤗 MLOps with Hugging Face Spaces and Dagger☆46Updated 2 years ago
- 🎉 An awesome & curated list of best LLMOps tools.☆165Updated 2 weeks ago
- Lighter, cheaper and faster RAG toolkit (Graph RAG) supported by TargetPilot☆46Updated 4 months ago
- Awesome series for LLMOps☆51Updated 7 months ago
- Open Weight, tool-calling LLMs☆155Updated last year
- This is a landscape of the infrastructure that powers the generative AI ecosystem☆149Updated last year
- Community-maintained Kubernetes config and Helm chart for Langfuse☆171Updated this week
- This repository contains resources, documentation and artifacts describing LLM agents☆15Updated 9 months ago
- ☆64Updated 7 months ago
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- A Site Reliability Engineer AI agent that can monitor application and infrastructure logs, diagnose issues, and report on diagnostics.☆104Updated 3 weeks ago
- CodeSage: Code Representation Learning At Scale (ICLR 2024)☆113Updated last year
- Demo of Role-Based Access Control in LLM Vector Databases☆16Updated last year
- DevSecOps knowledge base chatbot built with LlamaIndex, LangChain, and OpenAI☆104Updated last year
- An open-source cloud-native of large multi-modal models (LMMs) serving framework.☆164Updated 2 years ago
- Helloworld for agentic frameworks, minimial but runnable! LangGraph, Agno, AutoGen, Smolagents, OpenAI Agents, etc.☆48Updated 2 months ago
- Finetune LLMs on K8s by using Runbooks☆170Updated last year
- CNCF Landscape Graph, data model, and applications.☆50Updated this week
- GenAIOps on Kubernetes: A collection of reference architectures for running GenAI at scale on Kubernetes using OSS tooling☆134Updated 11 months ago