Alternatives and similar repositories for A-White-Paper-on-Neural-Network-Deployment

Users that are interested in A-White-Paper-on-Neural-Network-Deployment are comparing it to the libraries listed below

• Li-Hongda / TensorRT_Inference_Demo
  A repo that uses TensorRT to deploy wll-trained models.Support RTDETR,YOLO-NAS,YOLOV5,YOLOV6,YOLOV7,YOLOV8,YOLOX.
  ☆108Updated 2 years ago
• midea-ai / Aidget
  Ai edge toolbox，专门面向边端设备尤其是嵌入式RTOS平台，AI模型部署工具链，包括模型推理引擎和模型压缩工具
  ☆164Updated last year
• NetEase-Media / grps_trtllm
  Higher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+…
  ☆156Updated 5 months ago
• NetEase-Media / grps
  Deep Learning Deployment Framework: Supports tf/torch/trt/trtllm/vllm and other NN frameworks. Support dynamic batching, and streaming mo…
  ☆166Updated 5 months ago
• jinmin527 / learning-cuda-trt
  A large number of cuda/tensorrt cases . 大量案例来学习cuda/tensorrt
  ☆157Updated 3 years ago
• HeKun-NVIDIA / TensorRT-Developer_Guide_in_Chinese
  ☆301Updated 3 years ago
• uyzhang / yolov5_prune
  YOLOv5 pruning on COCO Dataset
  ☆84Updated 2 years ago
• OroChippw / SegmentAnything-OnnxRunner
  SegmentAnything-OnnxRunner is an example using Meta AI Research's SAM onnx model in C++.The encoder and decoder of SAM are decoupled in t…
  ☆98Updated last year
• garlic-byte / yolov11_prune_distillation_v2
  介绍更加详细的剪枝蒸馏方法
  ☆60Updated 6 months ago
• shouxieai / learning-cuda-trt
  learning-cuda-trt
  ☆118Updated 2 years ago
• shouxieai / tensorRT_quantization
  该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。
  ☆70Updated 2 years ago
• Phoenix8215 / BuildCudaNeuralNetworkFromScratch
  Build CUDA Neural Network From Scratch
  ☆21Updated last year
• kalfazed / tensorrt_starter
  This repository give a guidline to learn CUDA and TensorRT from the beginning.
  ☆283Updated 8 months ago
• chaizwj / yolov8-tricks
  目标检测，采用yolov8作为基准模型，数据集采用VisDrone2019，带有自己的改进策略
  ☆104Updated last year
• HeKun-NVIDIA / CUDA-Programming-Guide-in-Chinese
  This is a Chinese translation of the CUDA programming guide
  ☆1,719Updated 11 months ago
• QINZHAOYU / CudaSteps
  基于《cuda编程-基础与实践》（樊哲勇 著）的cuda学习之路。
  ☆363Updated last year
• YZY-stack / Ultra_Fast_Lane_Detection_TensorRT
  An ultra fast tiny model for lane detection, using onnx_parser, TensorRTAPI, torch2trt to accelerate. our model support for int8, dynamic…
  ☆120Updated 4 years ago
• Broad-sky / common-image-segmentation-algorithm
  🚀 Do not need libtorch, pure C++ TensorRT deploys SOLOv2 etc, which can be quickly ported to NX/TX2.
  ☆42Updated 3 years ago
• caixiongjiang / HPC
  高性能计算课程&CUDA编程实例&深度学习推理框架
  ☆59Updated 2 years ago
• chenlamei / MobileVit_TensorRT
  TensorRT 2022 亚军方案，tensorrt加速mobilevit模型
  ☆68Updated 3 years ago
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆160Updated last month
• thb1314 / mmyolo_tensorrt
  ☆150Updated last year
• shouxieai / algorithm-cpp
  algorithm-cpp projects
  ☆80Updated 3 years ago
• ZLkanyo009 / MQBench_Quantize
  QAT(quantize aware training) for classification with MQBench
  ☆28Updated 3 years ago
• HuPengsheet / EasyNN
  EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！
  ☆33Updated last year
• zjhellofss / kuiperdatawhale
  ☆301Updated last year
• buxihuo / OW-YOLO
  Detect known and unknown objects in the open world（具有区分已知与未知能力的全新检测器））
  ☆85Updated 2 years ago
• sesmfs / onnx_quant_tool
  An onnx-based quantitation tool.
  ☆71Updated last year
• yang-0201 / MAF-YOLO
  Multi-Branch Auxiliary Fusion YOLO with Re-parameterization Heterogeneous Convolutional for accurate object detection.
  ☆104Updated 11 months ago
• shouxieai / A-series-of-CV
  ☆57Updated 2 years ago