Repository for open inference protocol specification
☆78May 12, 2025Updated last year
Alternatives and similar repositories for open-inference-protocol
Users that are interested in open-inference-protocol are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ModelMesh Performance Scripts, Dashboard and Pipelines☆13Apr 14, 2026Updated 5 months ago
- User documentation for KServe.☆113Updated this week
- Added functionality to the cml python package☆14Aug 28, 2026Updated 3 weeks ago
- Integrating SSE with NVIDIA Triton Inference Server using a Python backend and Zephyr model. There is very less documentation how to use …☆10May 29, 2024Updated 2 years ago
- Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes☆6,001Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…☆73Sep 16, 2026Updated last week
- TrustyAI Explainability Toolkit☆63Updated this week
- Falco plugins SDK for Go☆26Aug 24, 2026Updated last month
- An Open Standard for Packaging, Distributing and Running LLMs in Cloud-Native Environments☆231Updated this week
- tool for art challenges check☆15Oct 10, 2021Updated 4 years ago
- Terraform module for creating EKS clusters optimized for ClickHouse® with EBS and autoscaling ☁️☆27Jul 30, 2026Updated last month
- Secure REST service to index, search, retrieve and aggregate content from heterogeneous sources.☆20Oct 3, 2024Updated last year
- ☆12Sep 25, 2019Updated 7 years ago
- 🚀 Guardrails orchestration server for application of various detections on text generation input and output.☆35Sep 18, 2026Updated last week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Let LLMs manage your Java application via JMX/Jolokia 🌶️☆17Sep 8, 2026Updated 2 weeks ago
- MLOps Cookiecutter Template: A Base Project Structure for Secure Production ML Engineering☆41Nov 13, 2024Updated last year
- Web Audio API for Nim Javascript☆15Feb 25, 2023Updated 3 years ago
- Example mlserver and seldon deployment for a cassava leaf classifier☆11May 17, 2023Updated 3 years ago
- ☆16Aug 27, 2026Updated last month
- Sentence Embedding as a Service☆15Jun 30, 2025Updated last year
- Presto Accumulo Integration☆24Aug 7, 2023Updated 3 years ago
- A distributed generic query layer for Apache Kafka Interactive Queries☆26Nov 8, 2017Updated 8 years ago
- An SBT Plugin that acts as a light wrapper around Buf.☆10Oct 29, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆161Sep 17, 2026Updated last week
- Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.☆682Sep 11, 2026Updated 2 weeks ago
- Controller for ModelMesh☆245Apr 14, 2026Updated 5 months ago
- ☆19Nov 12, 2024Updated last year
- ☆25Aug 26, 2024Updated 2 years ago
- Flow with FlorDB 🌻☆161Updated this week
- ☕⛵WIP PySpark dependency management☆22Jul 8, 2018Updated 8 years ago
- Python(+bash) reconstruction of 1961 electronic poem "TAPE MARK 1" by Nanni Balestrini☆15Jan 27, 2021Updated 5 years ago
- The stories of where Open Source projects got their names from.☆11Sep 20, 2026Updated last week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Spec for R coffee-script☆17Nov 26, 2013Updated 12 years ago
- Python module for running GPTScript☆14Apr 13, 2026Updated 5 months ago
- A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)☆230Sep 18, 2026Updated last week
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆850Aug 13, 2025Updated last year
- GNU Scientific Library bindings for Crystal☆22Dec 7, 2022Updated 3 years ago
- ☆19Jan 4, 2020Updated 6 years ago
- Gateway API Inference Extension☆771Updated this week