substratusai / runbooksLinks
Finetune LLMs on K8s by using Runbooks
☆170Updated 9 months ago
Alternatives and similar repositories for runbooks
Users that are interested in runbooks are comparing it to the libraries listed below
Sorting:
- Open Weight, tool-calling LLMs☆152Updated 7 months ago
- ☆107Updated last year
- Constrain LLM output☆110Updated 10 months ago
- Cedana: Access and run on compute anywhere in the world, on any provider. Migrate seamlessly between providers, arbitraging price/perform…☆58Updated 3 weeks ago
- Fine-tuning and serving LLMs on any cloud☆89Updated last year
- Foyle is a copilot to help developers deploy and operate their applications.☆129Updated 2 months ago
- ♾️ Helix is a private GenAI stack for building AI applications with declarative pipelines, knowledge (RAG), API bindings, and first-class…☆498Updated this week
- Action library for AI Agent☆214Updated 2 months ago
- ☆164Updated last year
- Run GGML models with Kubernetes.☆172Updated last year
- A simple DAG for executing LLM calls and using tools.☆41Updated last year
- A kubernetes operator you should never run under any circumstances☆125Updated 2 years ago
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆81Updated last year
- [deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications☆158Updated last year
- Definition for Open Weights LIcensing☆133Updated 7 months ago
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- This is a landscape of the infrastructure that powers the generative AI ecosystem☆146Updated 7 months ago
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆99Updated 3 months ago
- Code Indexer Loop is a Python library for indexing and retrieving source code files through an integrated vector database that's continuo…☆175Updated last year
- ☆198Updated last year
- Chart for deploying ChromaDB in Kubernetes☆48Updated last week
- Your buddy in the (L)LM space.☆64Updated 8 months ago
- 🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps☆148Updated 9 months ago
- 🪶 Lightweight OpenAI drop-in replacement for Kubernetes☆145Updated last year
- AI-to-AI Testing | Simulation framework for LLM-based applications☆137Updated last year
- A specification for OpenInference, a semantic mapping of ML inferences☆46Updated last year
- Python client library for improving your LLM app accuracy☆98Updated 3 months ago
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆32Updated last year
- Helm charts to deploy Weaviate to k8s☆60Updated 2 weeks ago
- ⛓️ build cognitive systems, pythonic☆336Updated 6 months ago