LitLeo / TensorRT_Tutorial

Related projects: ⓘ

• NVIDIA / trt-samples-for-hackathon-cn
  Simple samples for TensorRT programming
  ☆1,477Updated 2 weeks ago
• OpenPPL / ppq
  PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.
  ☆1,511Updated 5 months ago
• OpenPPL / ppl.cv
  ppl.cv is a high-performance image processing library of openPPL supporting various platforms.
  ☆488Updated 3 months ago
• HeKun-NVIDIA / TensorRT-Developer_Guide_in_Chinese
  ☆212Updated 2 years ago
• layerism / TensorRT-Inference-Server-Tutorial
  服务侧深度学习部署案例
  ☆453Updated 4 years ago
• zerollzeng / tiny-tensorrt
  Deploy your model with TensorRT quickly.
  ☆756Updated 9 months ago
• ModelTC / MQBench
  Model Quantization Benchmark
  ☆752Updated 3 months ago
• godweiyang / NN-CUDA-Example
  Several simple examples for popular neural network toolkits calling custom CUDA operators.
  ☆1,305Updated 3 years ago
• nndeploy / nndeploy
  nndeploy是一款模型端到端部署框架。以多端推理以及基于有向无环图模型部署为基础，致力为用户提供跨平台、简单易用、高性能的模型部署体验。
  ☆600Updated this week
• Tencent / TPAT
  TensorRT Plugin Autogen Tool
  ☆365Updated last year
• BBuf / how-to-optim-algorithm-in-cuda
  how to optimize some algorithm in cuda.
  ☆1,443Updated this week
• tpoisonooo / how-to-optimize-gemm
  row-major matmul optimization
  ☆584Updated last year
• OpenPPL / ppl.nn
  A primitive library for neural network
  ☆1,268Updated last month
• 666DZY666 / micronet
  micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantiz…
  ☆2,212Updated 2 years ago
• Jermmy / pytorch-quantization-demo
  A simple network quantization demo using pytorch from scratch.
  ☆497Updated last year
• Syencil / tensorRT
  TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据
  ☆521Updated 3 years ago
• deepglint / EasyQuant
  EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…
  ☆389Updated last year
• huawei-noah / bolt
  Bolt is a deep learning library with high performance and heterogeneous flexibility.
  ☆909Updated last month
• MegEngine / MegCC
  MegCC是一个运行时超轻量，高效，移植简单的深度学习模型编译器
  ☆466Updated last month
• Tencent / Forward
  A library for high performance deep learning inference on NVIDIA GPUs.
  ☆549Updated 2 years ago
• RizhaoCai / PyTorch_ONNX_TensorRT
  A tutorial about how to build a TensorRT Engine from a PyTorch Model with the help of ONNX
  ☆242Updated 3 years ago
• huiscliu / Tutorials
  Parallel programming tutorials
  ☆599Updated 3 years ago
• AllentDan / LibtorchTutorials
  This is a code repository for pytorch c++ (or libtorch) tutorial.
  ☆725Updated 2 years ago
• inisis / brocolli
  Everything in Torch Fx
  ☆335Updated 3 months ago
• ThanatosShinji / onnx-tool
  A parser, editor and profiler tool for ONNX models.
  ☆379Updated 3 weeks ago
• brucefan1983 / CUDA-Programming
  Sample codes for my CUDA programming book
  ☆1,524Updated last year
• dlunion / tensorRTIntegrate
  TensorRT ONNX Plugin、Inference、Compile
  ☆463Updated 3 years ago
• LitLeo / OpenCUDA
  ☆254Updated 6 years ago
• DefTruth / CUDA-Learn-Notes
  🎉CUDA/C++ 笔记 / 技术博客: fp32、fp16/bf16、fp8/int8、flash_attn、sgemm、sgemv、warp/block reduce、dot prod、elementwise、softmax、layernorm、rmsnorm、his…
  ☆1,140Updated this week