Repository for open inference protocol specification
☆77May 12, 2025Updated last year
Alternatives and similar repositories for open-inference-protocol
Users that are interested in open-inference-protocol are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ModelMesh Performance Scripts, Dashboard and Pipelines☆13Apr 14, 2026Updated 4 months ago
- KServe V2 Protocol Rest API Implementation Proxy☆14Mar 19, 2026Updated 5 months ago
- User documentation for KServe.☆113Aug 31, 2026Updated last week
- Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes☆5,860Updated this week
- Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…☆73Aug 31, 2026Updated last week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- TrustyAI Explainability Toolkit☆63Aug 4, 2026Updated last month
- Falco plugins SDK for Go☆26Aug 24, 2026Updated 2 weeks ago
- An Open Standard for Packaging, Distributing and Running LLMs in Cloud-Native Environments☆228Aug 31, 2026Updated last week
- Giter8 template for a simple project that uses sbt-crossproject.☆11Jul 16, 2018Updated 8 years ago
- Lint Crystal using the Crystal Compiler.☆11Mar 12, 2018Updated 8 years ago
- Use the power of Ruby to convert, edit and save synthdefs for SuperCollider☆10Mar 4, 2018Updated 8 years ago
- tool for art challenges check☆15Oct 10, 2021Updated 4 years ago
- Terraform module for creating EKS clusters optimized for ClickHouse® with EBS and autoscaling ☁️☆27Jul 30, 2026Updated last month
- A silly microservices app for testing interoperability☆17Feb 19, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Manages Unified Access to Generative AI Services built on Envoy Gateway☆2,000Updated this week
- ☆12Sep 25, 2019Updated 6 years ago
- 🚀 Guardrails orchestration server for application of various detections on text generation input and output.☆35Jul 6, 2026Updated 2 months ago
- MLOps Cookiecutter Template: A Base Project Structure for Secure Production ML Engineering☆41Nov 13, 2024Updated last year
- A sandbox repository for the Trusty AI team☆11Nov 16, 2022Updated 3 years ago
- Example mlserver and seldon deployment for a cassava leaf classifier☆11May 17, 2023Updated 3 years ago
- Sentence Embedding as a Service☆15Jun 30, 2025Updated last year
- Presto Accumulo Integration☆24Aug 7, 2023Updated 3 years ago
- A distributed generic query layer for Apache Kafka Interactive Queries☆26Nov 8, 2017Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An SBT Plugin that acts as a light wrapper around Buf.☆10Oct 29, 2024Updated last year
- A Transactional Metadata Store Backed by Apache Kafka☆25Sep 22, 2025Updated 11 months ago
- Practice every song you know☆21Jun 7, 2024Updated 2 years ago
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆161Updated this week
- Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.☆682Updated this week
- ☆12May 13, 2025Updated last year
- Controller for ModelMesh☆245Apr 14, 2026Updated 4 months ago
- Morpheus: Domain Specific Run Time Optimization for Software Data Planes -- Presented at ASPLOS22☆36Apr 11, 2024Updated 2 years ago
- OpenVINO backend for Triton.☆39Aug 21, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- FlorDB 🌻☆160Aug 25, 2026Updated last week
- ☕⛵WIP PySpark dependency management☆22Jul 8, 2018Updated 8 years ago
- Simple Github Action that prints the go version.☆15Sep 24, 2022Updated 3 years ago
- Python module for running GPTScript☆14Apr 13, 2026Updated 4 months ago
- Proxy for VM console connection.☆14Updated this week
- OpenAI compatible API for TensorRT LLM triton backend☆221Aug 1, 2024Updated 2 years ago
- An api server that exports a subset of rrdtool commands over http.☆15Jun 9, 2022Updated 4 years ago