PaddlePaddle / FastDeployLinks
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
☆3,594Updated this week
Alternatives and similar repositories for FastDeploy
Users that are interested in FastDeploy are comparing it to the libraries listed below
Sorting:
- 🛠A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉☆4,320Updated last week
- PaddleSlim is an open-source library for deep model compression and architecture search.☆1,611Updated last month
- ONNX Model Exporter for PaddlePaddle☆879Updated 5 months ago
- OpenMMLab Model Deployment Framework☆3,086Updated last year
- Deep learning model converter for PaddlePaddle. (『飞桨』深度学习模型转换工具)☆765Updated last month
- An all-in-one toolkit for computer vision☆1,934Updated 7 months ago
- 🚀🚀🚀 YOLO series of PaddlePaddle implementation, PP-YOLOE+, RT-DETR, YOLOv5, YOLOv6, YOLOv7, YOLOv8, YOLOv10, YOLO11, YOLOX, YOLOv5u, Y…☆651Updated 6 months ago
- C++ library based on tensorrt integration☆2,839Updated 2 years ago
- YOLOv6: a single-stage object detection framework dedicated to industrial applications.☆5,869Updated last year
- CV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.☆2,622Updated last month
- TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is …☆4,601Updated 7 months ago
- Object Detection toolkit based on PaddlePaddle. It supports object detection, instance segmentation, multiple object tracking and real-ti…☆13,984Updated 2 months ago
- lib, demo, model, data☆779Updated 3 months ago
- The minimal opencv for Android, iOS, ARM Linux, Windows, Linux, MacOS, HarmonyOS, WebAssembly, watchOS, tvOS, visionOS☆3,135Updated this week
- 🍅 Deploy ncnn on mobile phones. Support Android and iOS. 移动端ncnn部署,支持Android与iOS。☆1,571Updated 3 years ago
- NanoDet-Plus⚡Super fast and lightweight anchor-free object detection model. 🔥Only 980 KB(int8) / 1.8MB (fp16) and run 97FPS on cellphone…☆6,129Updated last year
- OpenMMLab YOLO series toolbox and benchmark. Implemented RTMDet, RTMDet-Rotated,YOLOv5, YOLOv6, YOLOv7, YOLOv8,YOLOX, PPYOLOE, etc.☆3,362Updated last year
- 🔥🔥🔥🔥 (Earlier YOLOv7 not official one) YOLO with Transformers and Instance Segmentation, with TensorRT acceleration! 🔥🔥🔥☆3,124Updated 2 years ago
- Implementation of popular deep learning networks with TensorRT network definition API☆7,602Updated this week
- Simple samples for TensorRT programming☆1,650Updated this week
- PyTorch Neural Network eXchange☆657Updated this week
- 一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework☆1,646Updated this week
- A flexible, high-performance carrier for machine learning models(『飞桨』服务化部署框架)☆919Updated 2 weeks ago
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,586Updated last month
- PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.☆1,774Updated last year
- All-in-One Development Tool based on PaddlePaddle☆5,938Updated this week
- ☆933Updated 2 years ago
- ONNX-TensorRT: TensorRT backend for ONNX☆3,175Updated last month
- Simplify your onnx model☆4,248Updated 3 months ago
- YOLOv8 using TensorRT accelerate !☆1,719Updated 7 months ago