Phoenix8215 / A-White-Paper-on-Neural-Network-DeploymentLinks
模型部署白皮书(CUDA|ONNX|TensorRT|C++)🚀🚀🚀
☆224Updated last year
Alternatives and similar repositories for A-White-Paper-on-Neural-Network-Deployment
Users that are interested in A-White-Paper-on-Neural-Network-Deployment are comparing it to the libraries listed below
Sorting:
- Ai edge toolbox,专门面向边端设备尤其是嵌入式RTOS平台,AI模型部署工具链,包括模型推理引擎和模型压缩工具☆161Updated last year
- A repo that uses TensorRT to deploy wll-trained models.Support RTDETR,YOLO-NAS,YOLOV5,YOLOV6,YOLOV7,YOLOV8,YOLOX.☆108Updated 2 years ago
- Higher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+…☆153Updated 4 months ago
- Deep Learning Deployment Framework: Supports tf/torch/trt/trtllm/vllm and other NN frameworks. Support dynamic batching, and streaming mo…☆167Updated 4 months ago
- An ultra fast tiny model for lane detection, using onnx_parser, TensorRTAPI, torch2trt to accelerate. our model support for int8, dynamic…☆120Updated 4 years ago
- A large number of cuda/tensorrt cases . 大量案例来学习cuda/tensorrt☆150Updated 3 years ago
- Build CUDA Neural Network From Scratch☆21Updated last year
- This repository give a guidline to learn CUDA and TensorRT from the beginning.☆275Updated 7 months ago
- ☆296Updated 3 years ago
- SegmentAnything-OnnxRunner is an example using Meta AI Research's SAM onnx model in C++.The encoder and decoder of SAM are decoupled in t…☆97Updated last year
- 高性能计算课程&CUDA编程实例&深度学习推理框架☆55Updated 2 years ago
- ☆296Updated 11 months ago
- YOLOv5 pruning on COCO Dataset☆83Updated 2 years ago
- 介绍更加详细的剪枝蒸馏方法☆53Updated 5 months ago
- 该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。☆69Updated last year
- 目标检测,采用yolov8作为基准模型,数据集采用VisDrone2019,带有自己的改进策略☆100Updated last year
- This is a Chinese translation of the CUDA programming guide☆1,686Updated 10 months ago
- learning-cuda-trt☆118Updated 2 years ago
- 基于《cuda编程-基础与实践》(樊哲勇 著)的cuda学习之路。☆357Updated last year
- TensorRT 2022 亚军方案,tensorrt加速mobilevit模型☆68Updated 3 years ago
- 🚀 Do not need libtorch, pure C++ TensorRT deploys SOLOv2 etc, which can be quickly ported to NX/TX2.☆42Updated 3 years ago
- 校招、秋招、春招、实习好项目,带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。☆424Updated 2 months ago
- A light llama-like llm inference framework based on the triton kernel.☆152Updated last month
- algorithm-cpp projects☆79Updated 2 years ago
- b站上的课程☆75Updated 2 years ago
- PyTorch Quantization Aware Training(QAT,量化感知训练)☆36Updated last year
- ☆148Updated last year
- EasyNN是一个面向教学而开发的神经网络推理框架,旨在让大家0基础也能自主完成推理框架编写!☆32Updated last year
- An onnx-based quantitation tool.☆71Updated last year
- 自动驾驶笔记,以解析各模块知识点、整合行业优秀解决方案进行阐述,以帮助自己及有需要的读者;包含深度学习、deeplearning、无人驾驶、BEV、Transformer、ADAS、CVPR、特斯拉AI DAY、大模型、chatgpt等内容.☆730Updated last year