Alternatives and similar repositories for A-White-Paper-on-Neural-Network-Deployment

Users that are interested in A-White-Paper-on-Neural-Network-Deployment are comparing it to the libraries listed below

• kalfazed / tensorrt_starter
  This repository give a guidline to learn CUDA and TensorRT from the beginning.
  ☆247Updated 4 months ago
• zjhellofss / kuiperdatawhale
  ☆278Updated 8 months ago
• shouxieai / learning-cuda-trt
  learning-cuda-trt
  ☆114Updated 2 years ago
• Li-Hongda / TensorRT_Inference_Demo
  A repo that uses TensorRT to deploy wll-trained models.Support RTDETR,YOLO-NAS,YOLOV5,YOLOV6,YOLOV7,YOLOV8,YOLOX.
  ☆107Updated last year
• jinmin527 / learning-cuda-trt
  A large number of cuda/tensorrt cases . 大量案例来学习cuda/tensorrt
  ☆135Updated 2 years ago
• zjhellofss / KuiperLLama
  校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。
  ☆369Updated this week
• HeKun-NVIDIA / TensorRT-Developer_Guide_in_Chinese
  ☆283Updated 3 years ago
• Tongkaio / CUDA_Kernel_Samples
  CUDA 算子手撕与面试指南
  ☆441Updated 5 months ago
• chenlamei / MobileVit_TensorRT
  TensorRT 2022 亚军方案，tensorrt加速mobilevit模型
  ☆67Updated 3 years ago
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆128Updated last week
• zjhellofss / KuiperCourse
  b站上的课程
  ☆76Updated last year
• NetEase-Media / grps_trtllm
  Higher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+…
  ☆141Updated last month
• caixiongjiang / HPC
  高性能计算课程&CUDA编程实例&深度学习推理框架
  ☆49Updated last year
• shouxieai / tensorRT_quantization
  该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。
  ☆69Updated last year
• NetEase-Media / grps
  Deep Learning Deployment Framework: Supports tf/torch/trt/trtllm/vllm and other NN frameworks. Support dynamic batching, and streaming mo…
  ☆164Updated last month
• HuPengsheet / use-ncnn
  NCNN的代码学习，各种小Demo。
  ☆112Updated last year
• HuPengsheet / EasyNN
  EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！
  ☆31Updated 10 months ago
• RussWong / CUDATutorial
  A CUDA tutorial to make people learn CUDA program from 0
  ☆234Updated 11 months ago
• BBuf / how-to-learn-deep-learning-framework
  how to learn PyTorch and OneFlow
  ☆435Updated last year
• thb1314 / mmyolo_tensorrt
  ☆139Updated last year
• shouxieai / algorithm-cpp
  algorithm-cpp projects
  ☆80Updated 2 years ago
• nndeploy / nndeploy
  Easy-to-use, high-performance, multi-platform inference deployment framework
  ☆1,021Updated this week
• midea-ai / Aidget
  Ai edge toolbox，专门面向边端设备尤其是嵌入式RTOS平台，AI模型部署工具链，包括模型推理引擎和模型压缩工具
  ☆156Updated last year
• ifromeast / cuda_learning
  learning how CUDA works
  ☆271Updated 3 months ago
• agrechnev / trt-cpp-min
  TensorRT 7 C++ (almost) minimal examples
  ☆81Updated last year
• yhwang-hub / dl_model_deploy
  ☆78Updated 2 years ago
• QINZHAOYU / CudaSteps
  基于《cuda编程-基础与实践》（樊哲勇 著）的cuda学习之路。
  ☆324Updated last year
• MAhaitao999 / CUDA_Programming
  《CUDA编程基础与实践》一书的代码
  ☆123Updated 3 years ago
• Eddie-Wang1120 / Professional-CUDA-C-Programming-Code-and-Notes
  CUDA C 编程权威指南代码实现 包含了书上第二章到第八章的大部分代码实现和作者笔记，全由作者本人手动实现，难免有错误的地方，请大家谨慎参考，非常欢迎对错误的指正。 如果有帮助的话请Star一下，对作者帮助很大，谢谢！
  ☆345Updated 2 years ago
• emptysoal / tensorrt-experiment
  Base on tensorrt version 8.2.4, compare inference speed for different tensorrt api.
  ☆48Updated this week