LitLeo / TensorRT_Tutorial
☆1,009Updated 10 months ago
Alternatives and similar repositories for TensorRT_Tutorial:
Users that are interested in TensorRT_Tutorial are comparing it to the libraries listed below
- Simple samples for TensorRT programming☆1,567Updated last month
- ☆258Updated 2 years ago
- PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.☆1,615Updated 10 months ago
- ppl.cv is a high-performance image processing library of openPPL supporting various platforms.☆496Updated 3 months ago
- Deploy your model with TensorRT quickly.☆763Updated last year
- 服务侧深度学习部署案例☆451Updated 4 years ago
- nndeploy is an end-to-end model deployment framework. Based on multi-terminal inference and directed acyclic graph model deployment, it i…☆682Updated this week
- Model Quantization Benchmark☆784Updated last week
- TensorRT Plugin Autogen Tool☆369Updated last year
- row-major matmul optimization☆602Updated last year
- Several simple examples for popular neural network toolkits calling custom CUDA operators.☆1,393Updated 3 years ago
- how to optimize some algorithm in cuda.☆1,854Updated last week
- A primitive library for neural network☆1,308Updated 2 months ago
- Bolt is a deep learning library with high performance and heterogeneous flexibility.☆936Updated 6 months ago
- TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据☆528Updated 3 years ago
- Parallel programming tutorials☆615Updated 3 years ago
- ☆2,287Updated last year
- MegCC是一个运行时超轻量,高效,移植简单的深度学习模型编译器☆476Updated 3 months ago
- A tutorial about how to build a TensorRT Engine from a PyTorch Model with the help of ONNX☆244Updated 4 years ago
- EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…☆393Updated 2 years ago
- micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantiz…☆2,230Updated 3 years ago
- This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…☆896Updated last year
- A library for high performance deep learning inference on NVIDIA GPUs.☆552Updated 3 years ago
- A simple network quantization demo using pytorch from scratch.☆519Updated last year
- A simple tool that can generate TensorRT plugin code quickly.☆225Updated last year
- Sample codes for my CUDA programming book☆1,627Updated last year
- ONNX-TensorRT: TensorRT backend for ONNX☆3,006Updated this week
- compiler learning resources collect.☆2,259Updated 8 months ago
- A parser, editor and profiler tool for ONNX models.☆414Updated 3 weeks ago
- BEVFormer inference on TensorRT, including INT8 Quantization and Custom TensorRT Plugins (float/half/half2/int8).☆455Updated last year