flavienbwk / awesome-llm-devops
A list of DevOps features enabled by awesome LLM software.
☆46Updated 4 months ago
Alternatives and similar repositories for awesome-llm-devops:
Users that are interested in awesome-llm-devops are comparing it to the libraries listed below
- A curated list of awesome open source and commercial MLOps platforms 🚀☆20Updated 2 years ago
- Kuberentes LangChain Agent - Interact with Kubernetes Clusters using LLMs☆23Updated last year
- 🎉 An awesome & curated list of best LLMOps tools.☆35Updated 3 weeks ago
- ☆12Updated 8 months ago
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆32Updated 7 months ago
- a series of tutorials implementing rag service with BentoML and LlamaIndex☆32Updated 2 weeks ago
- Helm charts to deploy Weaviate to k8s☆56Updated last week
- Repository hosting Langchain helm charts.☆42Updated 2 weeks ago
- Helm charts for the KubeRay project☆36Updated 3 months ago
- Solve Geometric & Graph Problems with Large Language Models☆28Updated last year
- CodeSage: Code Representation Learning At Scale (ICLR 2024)☆87Updated 2 months ago
- This is a landscape of the infrastructure that powers the generative AI ecosystem☆134Updated 2 months ago
- The backend behind the LLM-Perf Leaderboard☆10Updated 8 months ago
- Explore a curated collection of exceptional open-source libraries for generative AI meticulously reviewed or slated for review by The AI …☆46Updated 11 months ago
- DevSecOps knowledge base chatbot built with LlamaIndex, LangChain, and OpenAI☆100Updated 11 months ago
- OpenAI compatible API for open source LLMs☆15Updated last year
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated last year
- Demos of some issues with LangChain.☆31Updated last year
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated last year
- Code review assistant powered by LLM☆98Updated 5 months ago
- DevOps AI Assistant CLI. Ask questions about your AWS services, cloudwatch metrics, and billing.☆66Updated 4 months ago
- Awesome series for LLMOps☆38Updated 5 months ago
- Self-host LLMs with vLLM and BentoML☆80Updated this week
- This repo walks you through how to use transfer learning to fine tune a LLM (large language model) using UK Supreme Court case law as the…☆34Updated last year
- LLM Optimize is a proof-of-concept library for doing LLM (large language model) guided blackbox optimization.☆52Updated last year
- ☆26Updated 2 months ago
- Controllable-RAG-Agent using Langgraph☆11Updated 5 months ago
- Streamlit app for recommending eval functions using prompt diffs☆26Updated last year
- Sentence Embedding as a Service☆14Updated last year
- Dynamic Metadata based RAG Framework☆71Updated 5 months ago