ONNX Runtime Server: The ONNX Runtime Server is a server that provides TCP and HTTP/HTTPS REST APIs for ONNX inference.
☆199Oct 27, 2026Updated last week
Alternatives and similar repositories for onnxruntime-server
Users that are interested in onnxruntime-server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- pg_onnx: ONNX Runtime integrated with PostgreSQL. Perform ML inference with data in your database.☆63Oct 27, 2026Updated last week
- a repo to study TensorRT Plugin☆11Apr 30, 2025Updated last year
- a ai infra framework for edge device base on nndeploy☆17Nov 27, 2025Updated 11 months ago
- Dart plugin wrapping the Sherpa-ONNX runtime. Contains example for speech recognition with Flutter☆22Jan 3, 2025Updated last year
- Provide accurate offline voice-to-text services for VR,AR and Android platforms, such as oculus quest1/2/pro or pico3/4☆26May 21, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An ASR toolkit with the freedom of topology☆10Dec 18, 2023Updated 2 years ago
- ⚡️Qwen-Image 4.8x🎉 speedup with Hybrid Acceleration for low VRAM GPUs☆17Oct 24, 2025Updated last year
- llm deploy project based onnx.☆49Oct 9, 2024Updated 2 years ago
- ☆11Jun 18, 2025Updated last year
- Decoders from Kaldi using OpenFst☆36Oct 21, 2026Updated 2 weeks ago
- Uses the excellent silero VAD with onnxruntime C api for fast detection of audio segments with speech☆17Sep 20, 2024Updated 2 years ago
- ggml学习笔记，ggml是一个机器学习的推理框架☆18Mar 24, 2024Updated 2 years ago
- RKNN模型推理部署模板☆24Aug 11, 2023Updated 3 years ago
- ONNX Serving is a project written with C++ to serve onnx-mlir compiled models with GRPC and other protocols.Benefiting from C++ implement…☆25Sep 17, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ptdeco is a library for model optimization by matrix decomposition built on top of PyTorch☆10May 7, 2025Updated last year
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- RKNN-YOLOV5-BatchInference-MultiThreadingYOLOV5多张图片多线程C++推理☆24Nov 6, 2023Updated 3 years ago
- Graph-based C++ runtime for building and executing AI, ML, and computer vision pipelines across devices.☆15Jun 29, 2026Updated 4 months ago
- Large Language Model Onnx Inference Framework☆35Nov 25, 2025Updated 11 months ago
- ☆34Jul 23, 2024Updated 2 years ago
- Inference of YOLOv7 model applied on Qualcomm SNPE for pedestrian detection with embedded system.☆14Sep 23, 2024Updated 2 years ago
- ☆25Nov 6, 2025Updated last year
- This is the code implementation of "MicroViT: A Vision Transformer with Low Complexity Self Attention for Edge Device"☆15Sep 22, 2026Updated last month
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆482Updated this week
- 使用ONNXRuntime部署Informative-Drawings生成素描画，包含C++和Python两个版本的程序☆14Sep 7, 2023Updated 3 years ago
- ☆28Apr 24, 2026Updated 6 months ago
- Implementation of yolo v10 in c++ std 17 over opencv and onnxruntime☆94Sep 28, 2024Updated 2 years ago
- c++实现的clip推理，模型有一点点改动，但是不大，改动和导出模型的代码可以在readme里找到，模型文件都在Releases里，包括AX650的模型。新增支持ChineseCLIP☆31Jun 19, 2025Updated last year
- 使用OpenCV+onnxruntime部署中文clip做以文搜图，给出一句话来描述想要的图片，就能从图库中搜出来符合要求的图片。包含C++和Python两个版本的程序☆93Jan 15, 2024Updated 2 years ago
- Automatically generate a world map showing where contributions to your repository are coming from.☆13Apr 11, 2024Updated 2 years ago
- ONNX-compatible DocShadow: High-Resolution Document Shadow Removal. Supports TensorRT 🚀☆27Sep 13, 2023Updated 3 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Jun 3, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Serving Inside Pytorch☆171Jun 23, 2026Updated 4 months ago
- Colab notebooks for Next-gen Kaldi☆31Oct 12, 2025Updated last year
- A very simple tool to rewrite parameters such as attributes and constants for OPs in ONNX models. Simple Attribute and Constant Modifier …☆15Feb 6, 2026Updated 9 months ago
- Provides an ensemble model to deploy a YoloV8 ONNX model to Triton☆42Oct 19, 2023Updated 3 years ago
- ☆34Feb 3, 2025Updated last year
- onnxruntime pre-compiled libs☆205Oct 26, 2026Updated last week
- Rust discovery and camera streaming using ONVIF☆12Sep 11, 2023Updated 3 years ago