High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
☆3,723Sep 24, 2026Updated last month
Alternatives and similar repositories for FastDeploy
Users that are interested in FastDeploy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion.☆4,444Sep 5, 2026Updated last month
- PaddleSlim is an open-source library for deep model compression and architecture search.☆1,611Jan 4, 2026Updated 9 months ago
- ONNX Model Exporter for PaddlePaddle☆947Mar 18, 2026Updated 7 months ago
- Object Detection toolkit based on PaddlePaddle. It supports object detection, instance segmentation, multiple object tracking and real-ti…☆14,450May 28, 2026Updated 5 months ago
- 🚀🚀🚀 YOLO series of PaddlePaddle implementation, PP-YOLOE+, RT-DETR, YOLOv5, YOLOv6, YOLOv7, YOLOv8, YOLOv10, YOLO11, YOLOX, YOLOv5u, Y…☆667Jan 14, 2026Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Implementation of popular deep learning networks with TensorRT network definition API☆7,837Aug 18, 2026Updated 2 months ago
- OpenMMLab Model Deployment Framework☆3,153Sep 30, 2024Updated 2 years ago
- All-in-One Development Tool based on PaddlePaddle☆6,284Oct 20, 2026Updated last week
- A 3D computer vision development toolkit based on PaddlePaddle. It supports point-cloud object detection, segmentation, and monocular 3D …☆642Apr 22, 2025Updated last year
- ncnn is a high-performance neural network inference framework optimized for the mobile platform☆24,007Updated this week
- Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentat…☆9,417Feb 5, 2026Updated 8 months ago
- CV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.☆2,730Oct 20, 2026Updated last week
- PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎）☆7,289Apr 27, 2026Updated 6 months ago
- C++ library based on tensorrt integration☆2,899May 24, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）☆925Oct 9, 2026Updated 3 weeks ago
- NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…☆13,422Oct 9, 2026Updated 3 weeks ago
- 一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework☆1,892Aug 15, 2026Updated 2 months ago
- PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）☆24,134Updated this week
- Easy-to-use and powerful LLM and SLM library with awesome model zoo.☆12,982May 23, 2026Updated 5 months ago
- A treasure chest for visual classification and recognition powered by PaddlePaddle☆5,854Oct 22, 2026Updated last week
- ☆269Nov 20, 2025Updated 11 months ago
- Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pret…☆721Mar 6, 2026Updated 7 months ago
- PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.☆1,822Mar 28, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆2,858Oct 20, 2026Updated last week
- PaddleFormers is an easy-to-use library of pre-trained large language model zoo based on PaddlePaddle.☆12,969Oct 21, 2026Updated last week
- 飞桨智能标注，让标注快人一步☆297Nov 25, 2024Updated last year
- Deep learning model converter for PaddlePaddle. (『飞桨』深度学习模型转换工具)☆772Oct 22, 2025Updated last year
- MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.☆16,306Updated this week
- LMDeploy is a toolkit for compressing, deploying, and serving LLMs.☆8,124Updated this week
- YOLOv8 using TensorRT accelerate !☆1,812Aug 14, 2026Updated 2 months ago
- YOLOv6: a single-stage object detection framework dedicated to industrial applications.☆5,895Aug 7, 2024Updated 2 years ago
- Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/…☆91,857Sep 16, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is …☆4,663May 9, 2025Updated last year
- ONNX-TensorRT: TensorRT backend for ONNX☆3,243Oct 9, 2026Updated 3 weeks ago
- A primitive library for neural network☆1,369Nov 24, 2024Updated last year
- NanoDet-Plus⚡Super fast and lightweight anchor-free object detection model. 🔥Only 980 KB(int8) / 1.8MB (fp16) and run 97FPS on cellphone…☆6,279Aug 8, 2024Updated 2 years ago
- 🔥🔥🔥TensorRT for YOLO26 (det/pose/seg/depth/obb/cls), YOLOv11,YOLOv10 YOLOv9,YOLOv8, ... 🚀🚀🚀 CUDA IS ALL YOU NEED. 🍎🍎🍎☆1,464Updated this week
- tensorrt for yolo series (YOLOv11,YOLOv10,YOLOv9,YOLOv8,YOLOv7,YOLOv6,YOLOX,YOLOv5), nms plugin support☆1,159Oct 15, 2025Updated last year
- YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documenta…☆10,677Jun 8, 2025Updated last year