Repository for open inference protocol specification
☆78May 12, 2025Updated last year
Alternatives and similar repositories for open-inference-protocol
Users that are interested in open-inference-protocol are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods☆24Apr 14, 2026Updated 6 months ago
- ModelMesh Performance Scripts, Dashboard and Pipelines☆13Apr 14, 2026Updated 6 months ago
- User documentation for KServe.☆113Updated this week
- Added functionality to the cml python package☆14Aug 28, 2026Updated last month
- Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes☆6,117Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The DL Streamer Pipeline Zoo is a catalog of optimized media and media analytics pipelines. It includes tools for downloading pipelines a…☆16Aug 20, 2024Updated 2 years ago
- An Open Standard for Packaging, Distributing and Running LLMs in Cloud-Native Environments☆236Updated this week
- ChatGPT solutions for the MLE interview☆14Dec 9, 2022Updated 3 years ago
- Fast property caching☆38Oct 8, 2026Updated last week
- A silly microservices app for testing interoperability☆17Feb 19, 2026Updated 7 months ago
- ☆12Sep 25, 2019Updated 7 years ago
- It's a cooler way to store simple linear models.☆26Jul 15, 2024Updated 2 years ago
- 🚀 Guardrails orchestration server for application of various detections on text generation input and output.☆35Updated this week
- Let LLMs manage your Java application via JMX/Jolokia 🌶️☆17Oct 2, 2026Updated 2 weeks ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- MLOps Cookiecutter Template: A Base Project Structure for Secure Production ML Engineering☆42Nov 13, 2024Updated last year
- Sentence Embedding as a Service☆15Jun 30, 2025Updated last year
- A distributed generic query layer for Apache Kafka Interactive Queries☆26Nov 8, 2017Updated 8 years ago
- An SBT Plugin that acts as a light wrapper around Buf.☆10Oct 29, 2024Updated last year
- A Transactional Metadata Store Backed by Apache Kafka☆25Sep 22, 2025Updated last year
- Practice every song you know☆21Jun 7, 2024Updated 2 years ago
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆159Oct 5, 2026Updated last week
- Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.☆682Updated this week
- Application transformation tool☆52Jun 14, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Controller for ModelMesh☆245Apr 14, 2026Updated 6 months ago
- Morpheus: Domain Specific Run Time Optimization for Software Data Planes -- Presented at ASPLOS22☆36Apr 11, 2024Updated 2 years ago
- OpenVINO backend for Triton.☆39Oct 8, 2026Updated last week
- ☆25Aug 26, 2024Updated 2 years ago
- ☕⛵WIP PySpark dependency management☆22Jul 8, 2018Updated 8 years ago
- The stories of where Open Source projects got their names from.☆11Sep 20, 2026Updated 3 weeks ago
- Python module for running GPTScript☆14Apr 13, 2026Updated 6 months ago
- OpenAI compatible API for TensorRT LLM triton backend☆221Aug 1, 2024Updated 2 years ago
- An api server that exports a subset of rrdtool commands over http.☆15Jun 9, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)☆230Sep 18, 2026Updated last month
- ☆19Jan 4, 2020Updated 6 years ago
- @crossplane Providers as a Function (PaaF)☆10Nov 8, 2020Updated 5 years ago
- Gateway API Inference Extension☆788Updated this week
- ☆11Nov 5, 2021Updated 4 years ago
- My experiments improving Scala's Future for Scala 2.12 and beyond☆34Mar 26, 2018Updated 8 years ago
- Graph and alert on '.rrd' data using grafana, RRDTool and RRDSrv.☆17Sep 27, 2023Updated 3 years ago