Repository for open inference protocol specification
☆76May 12, 2025Updated last year
Alternatives and similar repositories for open-inference-protocol
Users that are interested in open-inference-protocol are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods☆24Apr 14, 2026Updated 3 months ago
- ModelMesh Performance Scripts, Dashboard and Pipelines☆13Apr 14, 2026Updated 3 months ago
- User documentation for KServe.☆113Updated this week
- Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes☆5,740Updated this week
- Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…☆73Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Data Observability for Data Engineering, published by Packt Publishing☆11Jan 24, 2025Updated last year
- TrustyAI Explainability Toolkit☆63Jun 19, 2026Updated last month
- Falco plugins SDK for Go☆26Updated this week
- Giter8 template for a simple project that uses sbt-crossproject.☆11Jul 16, 2018Updated 8 years ago
- eBPF playground☆22Mar 11, 2024Updated 2 years ago
- Fast property caching☆37Updated this week
- Use the power of Ruby to convert, edit and save synthdefs for SuperCollider☆10Mar 4, 2018Updated 8 years ago
- Manages Unified Access to Generative AI Services built on Envoy Gateway☆1,873Updated this week
- 🚀 Guardrails orchestration server for application of various detections on text generation input and output.☆35Jul 6, 2026Updated 3 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- MLOps Cookiecutter Template: A Base Project Structure for Secure Production ML Engineering☆41Nov 13, 2024Updated last year
- A sandbox repository for the Trusty AI team☆11Nov 16, 2022Updated 3 years ago
- Web Audio API for Nim Javascript☆15Feb 25, 2023Updated 3 years ago
- Sentence Embedding as a Service☆15Jun 30, 2025Updated last year
- Mastering Prometheus, published by Packt☆28Nov 20, 2024Updated last year
- A Transactional Metadata Store Backed by Apache Kafka☆25Sep 22, 2025Updated 10 months ago
- Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.☆678Updated this week
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆159Updated this week
- Controller for ModelMesh☆245Apr 14, 2026Updated 3 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- OpenVINO backend for Triton.☆38Updated this week
- ☆25Aug 26, 2024Updated last year
- Simple Github Action that prints the go version.☆15Sep 24, 2022Updated 3 years ago
- Python(+bash) reconstruction of 1961 electronic poem "TAPE MARK 1" by Nanni Balestrini☆15Jan 27, 2021Updated 5 years ago
- The stories of where Open Source projects got their names from.☆11Jan 9, 2026Updated 6 months ago
- Python module for running GPTScript☆14Apr 13, 2026Updated 3 months ago
- OpenAI compatible API for TensorRT LLM triton backend☆221Aug 1, 2024Updated last year
- A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)☆228Jun 20, 2026Updated last month
- ☆19Jan 4, 2020Updated 6 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- @crossplane Providers as a Function (PaaF)☆10Nov 8, 2020Updated 5 years ago
- Graph and alert on '.rrd' data using grafana, RRDTool and RRDSrv.☆17Sep 27, 2023Updated 2 years ago
- ☆16Updated this week
- Documentation and resources for deploying JupyterHub on Hadoop☆19Jul 16, 2019Updated 7 years ago
- Open benchmark on observability tasks built on Harbor☆64Updated this week
- Kubernetes AI Toolchain Operator☆989Updated this week
- Distributed Model Serving Framework☆190Apr 14, 2026Updated 3 months ago