flavienbwk / awesome-llm-devopsLinks
A list of DevOps features enabled by awesome LLM software.
☆54Updated 11 months ago
Alternatives and similar repositories for awesome-llm-devops
Users that are interested in awesome-llm-devops are comparing it to the libraries listed below
Sorting:
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- This is a landscape of the infrastructure that powers the generative AI ecosystem☆149Updated 10 months ago
- ☆18Updated last year
- Code Repository for Blog - How to Productionize Large Language Models (LLMs)☆11Updated last year
- Kuberentes LangChain Agent - Interact with Kubernetes Clusters using LLMs☆26Updated 2 years ago
- A curated list of awesome open source and commercial MLOps platforms 🚀☆29Updated 3 years ago
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆33Updated last year
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- 🤗 MLOps with Hugging Face Spaces and Dagger☆46Updated 2 years ago
- An AI-Powered assistant for Kubernetes developers☆189Updated last year
- The backend behind the LLM-Perf Leaderboard☆10Updated last year
- AI Code Review automates GitLab merge request reviews using OpenAI's GPT-4. It analyzes code changes, skips ignored files, and posts feed…☆21Updated 4 months ago
- 🎉 An awesome & curated list of best LLMOps tools.☆151Updated 2 weeks ago
- Explore a curated collection of exceptional open-source libraries for generative AI meticulously reviewed or slated for review by The AI …☆58Updated last year
- Self-host LLMs with vLLM and BentoML☆142Updated this week
- Open Weight, tool-calling LLMs☆155Updated 10 months ago
- 🪶 Lightweight OpenAI drop-in replacement for Kubernetes☆146Updated last year
- Learn to build and customize multi-agent systems using the AutoGen. The course teaches you to implement complex AI applications through a…☆99Updated last year
- Demo of Role-Based Access Control in LLM Vector Databases☆16Updated last year
- Tutorial for LLM developers about engine design, service deployment, evaluation/benchmark, etc. Provide a C/S style optimized LLM inferen…☆19Updated 2 years ago
- Helm charts to deploy Weaviate to k8s☆63Updated 3 weeks ago
- ASTChunk is a Python toolkit for code chunking using Abstract Syntax Trees (ASTs), designed to create structurally sound and meaningful c…☆76Updated 2 months ago
- ☆63Updated 5 months ago
- GenAIOps on Kubernetes: A collection of reference architectures for running GenAI at scale on Kubernetes using OSS tooling☆133Updated 10 months ago
- Community-maintained Kubernetes config and Helm chart for Langfuse☆156Updated this week
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆273Updated last year
- Python client library for improving your LLM app accuracy☆98Updated 6 months ago
- Helm charts for the KubeRay project☆50Updated last month
- ☆14Updated last year
- An open-source cloud-native of large multi-modal models (LMMs) serving framework.☆167Updated 2 years ago