An Open Standard for Packaging, Distributing and Running LLMs in Cloud-Native Environments
☆228Aug 14, 2026Updated 2 weeks ago
Alternatives and similar repositories for model-spec
Users that are interested in model-spec are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec☆80Updated this week
- Kubernetes CSI Driver for serving OCI model artifacts☆30May 25, 2026Updated 3 months ago
- Dragonfly client written in Rust☆71Updated this week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆801Updated this week
- Following the same workflows as Kubernetes. Widely used in InftyAI community.☆12Aug 17, 2026Updated last week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Nydus - a reliable, high-performance on-demand load filesytem framework for container image and data distribution.☆1,646Updated this week
- A containerd snapshotter with data deduplication and lazy loading in P2P fashion☆260Updated this week
- JobSet: a k8s native API for distributed ML training and HPC workloads☆342Updated this week
- WG Serving☆38Mar 24, 2026Updated 5 months ago
- Delivers efficient, stable, and secure data distribution and acceleration powered by P2P technology, with an optional content‑addressable…☆3,313Updated this week
- Gateway API Inference Extension☆755Updated this week
- A workload for deploying LLM inference services on Kubernetes☆288Updated this week
- ☆21Oct 2, 2025Updated 10 months ago
- Kubernetes AI Toolchain Operator☆1,004Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Minimal container registry☆50Jul 22, 2026Updated last month
- Node Resource Interface☆403Updated this week
- An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifac…☆1,409Updated this week
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆497Updated this week
- GenAI inference performance benchmarking tool☆234Updated this week
- Client library with golang for accessing Harbor API.☆51Oct 13, 2025Updated 10 months ago
- Vue's plugin to easily integrate pagination.☆10Oct 30, 2018Updated 7 years ago
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆1,478Updated this week
- 中国开发者活动日程（关注点：开源、开发者、云原生）☆29Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Kubernetes-native Job Queueing☆2,916Updated this week
- Kubernetes controllers for fast model actuation using vLLM sleep/wake and launcher-based model swapping☆18Updated this week
- Model Express is a Rust-based component meant to be placed next to existing model inference systems to speed up their startup times and i…☆137Updated this week
- Achieve state of the art inference performance with modern accelerators on Kubernetes☆4,318Updated this week
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆27Dec 6, 2024Updated last year
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆27Apr 24, 2025Updated last year
- agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes and reinfor…☆3,677Updated this week
- Injector trait as a webhook to inject data into Workload.☆15Apr 14, 2021Updated 5 years ago
- caniuse.com, but for kubernetes☆27Dec 25, 2024Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Provides a general service to support image acceleration based on kinds of accelerator like Nydus and eStargz etc.☆98Jul 13, 2026Updated last month
- Canonical location of the Dragonfly API definition☆15Updated this week
- ☆312Updated this week
- Dragonfly related community material☆13Updated this week
- Lightweight, Modular, Kubernetes-native AI serving platform for scalable model serving.☆437Updated this week
- csibuilder - SDK for building CSI Driver☆36Nov 22, 2023Updated 2 years ago
- ☆125Nov 1, 2022Updated 3 years ago