nekomeowww / ollama-operator
π’ Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! π«
β185Updated this week
Alternatives and similar repositories for ollama-operator:
Users that are interested in ollama-operator are comparing it to the libraries listed below
- π An awesome & curated list of best LLMOps tools.β87Updated this week
- βΈοΈ Easy, advanced inference platform for large language models on Kubernetes. π Star to support our work!β127Updated this week
- Your AI Kubernetes Expertβ178Updated 2 years ago
- π§― Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.β29Updated 4 months ago
- Prow is a Kubernetes based CI/CD system developed to serve the Kubernetes community. This repository contains Prow source code and Hugo sβ¦β187Updated this week
- JobSet: a k8s native API for distributed ML training and HPC workloadsβ219Updated last week
- caniuse.com, but for kubernetesβ25Updated 4 months ago
- Helm chart for Ollama on Kubernetesβ422Updated 2 weeks ago
- MCP server connecting to Kubernetesβ256Updated last week
- CAPK is a provider for Cluster API (CAPI) that allows users to deploy fake, Kubemark-backed machines to their clusters.β72Updated 3 weeks ago
- Dragonfly Helm Chartsβ36Updated this week
- π§ Extensive LLM endpoints, expended capabilities through your favorite protocols, πΈοΈ GraphQL, βοΈ gRPC, βΎοΈ WebSocket. Extended SOTA suppβ¦β15Updated last week
- OpenCIDN (Open Container Image Deliver Network)β13Updated last week
- Kubernetes API Translatorβ75Updated this week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replicationβ411Updated this week
- Model Context Protocol (MCP) server for Kubernetes and OpenShiftβ122Updated this week
- β79Updated this week
- Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI seβ¦β227Updated this week
- Gateway API Inference Extensionβ243Updated this week
- π« A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIβ¦β21Updated 4 months ago
- β107Updated last month
- K8s device plugin for GPU sharingβ100Updated last year
- πͺΆ Lightweight OpenAI drop-in replacement for Kubernetesβ144Updated last year
- Example DRA driver that developers can fork and modify to get them started writing their own.β69Updated last month
- Manage kubernetes node-level kernel tuning ( using sysctl ).β28Updated last month
- This repository hosts the Multi-Cluster Service APIs. Providers can import packages in this repo to ensure their multi-cluster service coβ¦β233Updated 2 months ago
- Lightweight KubeVela that runs as Daemon in single node with high availability.β71Updated 2 months ago
- Tools to help with self signed cert generation for Kubernetes test environmentβ144Updated last year
- Cluster API Provider for KubeVirtβ133Updated last month
- Integration between Knative and service-apis (ingress v2) for Knative Ingress migration.β38Updated this week