prem-research / prem-operatorLinks
š” Deploy AI models and apps to Kubernetes without developing a hernia
ā33Updated last year
Alternatives and similar repositories for prem-operator
Users that are interested in prem-operator are comparing it to the libraries listed below
Sorting:
- Quickly and securely turn any Linux box into a build and deployment assistantā24Updated last year
- Open Weight, tool-calling LLMsā155Updated last year
- Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.ā92Updated 3 months ago
- Knowledge for GPTScriptā29Updated last year
- ā275Updated this week
- Helm charts for llm-dā50Updated 5 months ago
- ā18Updated last year
- Self-host LLMs with vLLM and BentoMLā163Updated last month
- ā12Updated last year
- ā25Updated last year
- šŖ¶ Lightweight OpenAI drop-in replacement for Kubernetesā147Updated last year
- Route LLM requests to the best model for the task at hand.ā161Updated this week
- Agentkube - Run Kubernetes Like Never Beforeā24Updated last month
- Foyle is a copilot to help developers deploy and operate their applications.ā133Updated 9 months ago
- The home of official Obot toolsā32Updated 2 weeks ago
- Finetune LLMs on K8s by using Runbooksā170Updated last year
- Langflow Helm Chartsā97Updated 11 months ago
- ā137Updated 8 months ago
- InferX: Inference as a Service Platformā146Updated this week
- Vanilla-Python ergonomics on top of DSPyā39Updated 7 months ago
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-ā¦ā131Updated 10 months ago
- Streamlit Web UI for AGiXTā28Updated this week
- Tutorial for building LLM routerā241Updated last year
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.ā140Updated 3 weeks ago
- ā101Updated 7 months ago
- Routing on Random Forest (RoRF)ā237Updated last year
- An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud pā¦ā90Updated this week
- IBM development fork of https://github.com/huggingface/text-generation-inferenceā62Updated 3 months ago
- Framework-Agnostic RL Environments for LLM Fine-Tuningā41Updated last month
- A toy AI agent that can write programs, powered by Daggerā37Updated 9 months ago