lix19937 / tensorrt-insight
Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda
☆12Updated last week
Related projects ⓘ
Alternatives and complementary repositories for tensorrt-insight
- Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration☆38Updated 5 months ago
- CUDA 8-bit Tensor Core Matrix Multiplication based on m16n16k16 WMMA API☆26Updated last year
- Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…☆33Updated 2 years ago
- ☆22Updated 7 months ago
- An expression template based linear algebra library running completely on the GPU using CUDA☆22Updated 3 years ago
- Swin Transformer C++ Implementation☆54Updated 3 years ago
- Common libraries for PPL projects☆29Updated last month
- inference on tvm runtime using c++ with gpu enabled☆10Updated 6 years ago
- Autonomous driving middleware publish subscribe system☆28Updated 3 months ago
- C++数据流并行处理框架☆23Updated 3 years ago
- Tencent NCNN with added CUDA support☆67Updated 3 years ago
- ☆10Updated 3 years ago
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.☆50Updated 2 months ago
- ☆17Updated 4 years ago
- PyTorch -> ONNX -> TVM for autotuning☆23Updated 4 years ago
- A simple neural network inference framework☆24Updated last year
- CUDA 6大并行计算模式 代码与笔记☆58Updated 4 years ago
- mperf是一个面向移动/嵌入式平台的算子性能调优工具箱☆171Updated last year
- OpenVINO™ optimization for PointPillars*☆31Updated 6 months ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆85Updated 8 months ago
- 分层解耦的深度学习推理引擎☆60Updated 3 months ago
- study of cutlass☆19Updated last week
- how to design cpu gemm on x86 with avx256, that can beat openblas.☆66Updated 5 years ago
- edge/mobile transformer based Vision DNN inference benchmark☆14Updated this week
- Tencent Distribution of TVM☆15Updated last year
- 使用 cutlass 实现 flash-attention 精简版,具有教学意义☆32Updated 3 months ago
- ROS cross-compilation with DriveWorks☆29Updated 3 years ago
- ☆17Updated 7 months ago
- symmetric int8 gemm☆66Updated 4 years ago