Repository for open inference protocol specification
☆77May 12, 2025Updated last year
Alternatives and similar repositories for open-inference-protocol
Users that are interested in open-inference-protocol are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods☆24Apr 14, 2026Updated 4 months ago
- ModelMesh Performance Scripts, Dashboard and Pipelines☆13Apr 14, 2026Updated 4 months ago
- KServe V2 Protocol Rest API Implementation Proxy☆14Mar 19, 2026Updated 4 months ago
- User documentation for KServe.☆113Updated this week
- Added functionality to the cml python package☆14Apr 1, 2026Updated 4 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes☆5,799Updated this week
- Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…☆73Updated this week
- TrustyAI Explainability Toolkit☆63Aug 4, 2026Updated last week
- Fast property caching☆38Updated this week
- CSV to Avro☆10Jun 29, 2021Updated 5 years ago
- Manages Unified Access to Generative AI Services built on Envoy Gateway☆1,932Updated this week
- 🚀 Guardrails orchestration server for application of various detections on text generation input and output.☆35Jul 6, 2026Updated last month
- Commands for cleaning up your system and freeing up disk space.☆11Jul 9, 2026Updated last month
- Let LLMs manage your Java application via JMX/Jolokia 🌶️☆16Aug 5, 2026Updated last week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A sandbox repository for the Trusty AI team☆11Nov 16, 2022Updated 3 years ago
- ☆16Jul 30, 2026Updated 2 weeks ago
- Sentence Embedding as a Service☆15Jun 30, 2025Updated last year
- Presto Accumulo Integration☆24Aug 7, 2023Updated 3 years ago
- Practice every song you know☆21Jun 7, 2024Updated 2 years ago
- Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.☆681Updated this week
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆160Updated this week
- ☆12May 13, 2025Updated last year
- Controller for ModelMesh☆245Apr 14, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Adds a table of contents to Gatsby Markdown files using mdast-util-toc☆11Feb 13, 2019Updated 7 years ago
- ☆25Aug 26, 2024Updated last year
- ☕⛵WIP PySpark dependency management☆22Jul 8, 2018Updated 8 years ago
- Python module for running GPTScript☆14Apr 13, 2026Updated 4 months ago
- Proxy for VM console connection.☆14Aug 10, 2026Updated last week
- OpenAI compatible API for TensorRT LLM triton backend☆221Aug 1, 2024Updated 2 years ago
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆847Aug 13, 2025Updated last year
- A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)☆228Jun 20, 2026Updated last month
- GNU Scientific Library bindings for Crystal☆22Dec 7, 2022Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆19Jan 4, 2020Updated 6 years ago
- Implementation of algorithms from the book "Computational Geometry, Algorithms and Applications"☆17Mar 31, 2013Updated 13 years ago
- Gateway API Inference Extension☆740Updated this week
- @crossplane Providers as a Function (PaaF)☆10Nov 8, 2020Updated 5 years ago
- ☆16Updated this week
- Nim bindings for the p5.js library☆17Nov 29, 2022Updated 3 years ago
- Documentation and resources for deploying JupyterHub on Hadoop☆19Jul 16, 2019Updated 7 years ago