Phoenix8215 / A-White-Paper-on-Neural-Network-DeploymentLinks
模型部署白皮书(CUDA|ONNX|TensorRT|C++)🚀🚀🚀
☆207Updated 8 months ago
Alternatives and similar repositories for A-White-Paper-on-Neural-Network-Deployment
Users that are interested in A-White-Paper-on-Neural-Network-Deployment are comparing it to the libraries listed below
Sorting:
- A repo that uses TensorRT to deploy wll-trained models.Support RTDETR,YOLO-NAS,YOLOV5,YOLOV6,YOLOV7,YOLOV8,YOLOX.☆107Updated last year
- A large number of cuda/tensorrt cases . 大量案例来学习cuda/tensorrt☆134Updated 2 years ago
- ☆276Updated 7 months ago
- This repository give a guidline to learn CUDA and TensorRT from the beginning.☆243Updated 3 months ago
- learning-cuda-trt☆114Updated 2 years ago
- ☆282Updated 3 years ago
- CUDA 算子手撕与面试指南☆400Updated 4 months ago
- 校招、秋招、春招、实习好项目,带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。☆361Updated 2 months ago
- learning how CUDA works☆264Updated 3 months ago
- 基于《cuda编程-基础与实践》(樊哲勇 著)的cuda学习之路。☆316Updated last year
- TensorRT 2022 亚军方案,tensorrt加速mobilevit模型☆67Updated 2 years ago
- 该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。☆68Updated last year
- Deep Learning Deployment Framework: Supports tf/torch/trt/trtllm/vllm and other NN frameworks. Support dynamic batching, and streaming mo…☆164Updated 3 weeks ago
- algorithm-cpp projects☆80Updated 2 years ago
- Higher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+…☆136Updated 3 weeks ago
- ☆138Updated last year
- 《CUDA编程基础与实践》一书的代码☆122Updated 3 years ago
- A CUDA tutorial to make people learn CUDA program from 0☆233Updated 10 months ago
- A light llama-like llm inference framework based on the triton kernel.☆122Updated this week
- Ai edge toolbox,专门面向边端设备尤其是嵌入式RTOS平台,AI模型部署工具链,包括模型推理引擎和模型压缩工具☆154Updated last year
- b站上的课程☆75Updated last year
- 高性能计算课程&CUDA编程实例&深度学习推理框架☆50Updated last year
- EasyNN是一个面向教学而开发的神经网络推理框架,旨在让大家0基础也能自主完成推理框架编写!☆28Updated 9 months ago
- Base on tensorrt version 8.2.4, compare inference speed for different tensorrt api.☆45Updated 2 weeks ago
- Easy-to-use, high-performance, multi-platform inference deployment framework☆879Updated this week
- 🚀 Do not need libtorch, pure C++ TensorRT deploys SOLOv2 etc, which can be quickly ported to NX/TX2.☆42Updated 2 years ago
- ☆78Updated 2 years ago
- TensorRT 7 C++ (almost) minimal examples☆81Updated last year
- An onnx-based quantitation tool.☆71Updated last year
- Using pattern matcher in onnx model to match and replace subgraphs.☆79Updated last year