Repository for open inference protocol specification
☆79May 12, 2025Updated last year
Alternatives and similar repositories for open-inference-protocol
Users that are interested in open-inference-protocol are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods☆24Apr 14, 2026Updated 6 months ago
- KServe V2 Protocol Rest API Implementation Proxy☆14Mar 19, 2026Updated 7 months ago
- User documentation for KServe.☆113Updated this week
- Added functionality to the cml python package☆14Aug 28, 2026Updated 2 months ago
- Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes☆6,195Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…☆73Updated this week
- Knative Serving extension to roll out the revision progressively☆11Sep 2, 2025Updated last year
- TrustyAI Explainability Toolkit☆66Oct 22, 2026Updated 2 weeks ago
- Giter8 template for a simple project that uses sbt-crossproject.☆11Jul 16, 2018Updated 8 years ago
- CSV to Avro☆10Jun 29, 2021Updated 5 years ago
- Terraform module for creating EKS clusters optimized for ClickHouse® with EBS and autoscaling ☁️☆27Jul 30, 2026Updated 3 months ago
- Manages Unified Access to Generative AI Services built on Envoy Gateway☆2,363Updated this week
- Commands for cleaning up your system and freeing up disk space.☆11Jul 9, 2026Updated 3 months ago
- KServe community docs for contributions and process☆18Oct 21, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 🚀 Guardrails orchestration server for application of various detections on text generation input and output.☆35Updated this week
- Example mlserver and seldon deployment for a cassava leaf classifier☆11May 17, 2023Updated 3 years ago
- Fast property caching☆38Updated this week
- An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more☆903Updated this week
- A set of threading macro's for our favorite operating system☆15Mar 29, 2022Updated 4 years ago
- ☆16Aug 27, 2026Updated 2 months ago
- ☆13Jul 11, 2025Updated last year
- Sentence Embedding as a Service☆15Jun 30, 2025Updated last year
- Let LLMs manage your Java application via JMX/Jolokia 🌶️☆18Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)☆232Sep 18, 2026Updated last month
- Practice every song you know☆21Jun 7, 2024Updated 2 years ago
- TrustyAI's Kubernetes operator☆15Updated this week
- ☕⛵WIP PySpark dependency management☆22Jul 8, 2018Updated 8 years ago
- Charmed Kubeflow examples☆46Oct 23, 2024Updated 2 years ago
- Simple Github Action that prints the go version.☆15Sep 24, 2022Updated 4 years ago
- Controller for ModelMesh☆246Apr 14, 2026Updated 6 months ago
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆163Updated this week
- Morpheus: Domain Specific Run Time Optimization for Software Data Planes -- Presented at ASPLOS22☆36Apr 11, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Exploring fastai and timm integration for model finetune☆23Sep 9, 2022Updated 4 years ago
- Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.☆684Updated this week
- Spec for R coffee-script☆17Nov 26, 2013Updated 12 years ago
- Adds a table of contents to Gatsby Markdown files using mdast-util-toc☆11Feb 13, 2019Updated 7 years ago
- ☆25Aug 26, 2024Updated 2 years ago
- Authorization is one of the foundational needs when building your applications and services. Learn how, with the help of Cedar and Amazon…☆12Apr 14, 2026Updated 6 months ago
- A lightweight BuildKit metrics agent☆14Oct 11, 2026Updated 3 weeks ago