substratusai / runbooks
Finetune LLMs on K8s by using Runbooks
☆170Updated 8 months ago
Alternatives and similar repositories for runbooks:
Users that are interested in runbooks are comparing it to the libraries listed below
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- 🪶 Lightweight OpenAI drop-in replacement for Kubernetes☆144Updated last year
- Open Weight, tool-calling LLMs☆151Updated 6 months ago
- Constrain LLM output☆110Updated 9 months ago
- A kubernetes operator you should never run under any circumstances☆125Updated 2 years ago
- Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry☆311Updated last week
- ☆108Updated last year
- Definition for Open Weights LIcensing☆135Updated 6 months ago
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆93Updated 2 months ago
- ♾️ Helix is a private GenAI stack for building AI applications with declarative pipelines, knowledge (RAG), API bindings, and first-class…☆491Updated this week
- Action library for AI Agent☆214Updated last month
- Foyle is a copilot to help developers deploy and operate their applications.☆127Updated last month
- Fine-tuning and serving LLMs on any cloud☆89Updated last year
- AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-te…☆916Updated last week
- Chat strategies for LLMs☆94Updated 8 months ago
- ☆16Updated 11 months ago
- Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.☆68Updated this week
- Agent accuracy measurements for LLMs☆205Updated 10 months ago
- Tutorial for building LLM router☆198Updated 9 months ago
- Helm charts to deploy Weaviate to k8s☆60Updated 2 weeks ago
- Complex LLM Workflows from Simple JSON.☆297Updated last year
- ☆163Updated last year
- This is a landscape of the infrastructure that powers the generative AI ecosystem☆144Updated 6 months ago
- AI-to-AI Testing | Simulation framework for LLM-based applications☆137Updated last year
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆32Updated 11 months ago
- Repository for open inference protocol specification☆54Updated 9 months ago
- Code Indexer Loop is a Python library for indexing and retrieving source code files through an integrated vector database that's continuo…☆175Updated last year
- Community-maintained Kubernetes config and Helm chart for Langfuse☆100Updated 2 weeks ago
- Implement recursion using English as the programming language and an LLM as the runtime.☆232Updated 2 years ago
- Embed machine learning models in your Dockerfile☆88Updated last week