Alternatives and similar repositories for A-White-Paper-on-Neural-Network-Deployment:

Users that are interested in A-White-Paper-on-Neural-Network-Deployment are comparing it to the libraries listed below

• NetEase-Media / grps_trtllm
  【高性能OpenAI LLM服务】通过GPRS+TensorRT-LLM+Tokenizers.cpp实现纯C++版高性能OpenAI LLM服务，支持chat和function call模式，支持ai agent，支持分布式多卡推理，支持多模态，支持gradio聊天界面。
  ☆93Updated this week
• Li-Hongda / TensorRT_Inference_Demo
  A repo that uses TensorRT to deploy wll-trained models.Support RTDETR,YOLO-NAS,YOLOV5,YOLOV6,YOLOV7,YOLOV8,YOLOX.
  ☆104Updated last year
• zjhellofss / kuiperdatawhale
  ☆240Updated 4 months ago
• NetEase-Media / grps
  【深度学习模型部署框架】支持tf/torch/trt/trtllm/vllm以及更多nn框架，支持dynamic batching、streaming模式，支持python/c++双语言，可限制，可拓展，高性能。帮助用户快速地将模型部署到线上，并通过http/rpc接口方式…
  ☆154Updated last month
• zjhellofss / KuiperLLama
  校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。
  ☆285Updated last month
• jinmin527 / learning-cuda-trt
  A large number of cuda/tensorrt cases . 大量案例来学习cuda/tensorrt
  ☆122Updated 2 years ago
• ifromeast / cuda_learning
  learning how CUDA works
  ☆197Updated 6 months ago
• kalfazed / tensorrt_starter
  This repository give a guidline to learn CUDA and TensorRT from the beginning.
  ☆183Updated 7 months ago
• midea-ai / Aidget
  Ai edge toolbox，专门面向边端设备尤其是嵌入式RTOS平台，AI模型部署工具链，包括模型推理引擎和模型压缩工具
  ☆149Updated last year
• chenlamei / MobileVit_TensorRT
  TensorRT 2022 亚军方案，tensorrt加速mobilevit模型
  ☆61Updated 2 years ago
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆83Updated this week
• MAhaitao999 / CUDA_Programming
  《CUDA编程基础与实践》一书的代码
  ☆106Updated 2 years ago
• Phoenix8215 / BuildCudaNeuralNetworkFromScratch
  Build CUDA Neural Network From Scratch
  ☆16Updated 5 months ago
• HeKun-NVIDIA / TensorRT-Developer_Guide_in_Chinese
  ☆260Updated 2 years ago
• RussWong / CUDATutorial
  A CUDA tutorial to make people learn CUDA program from 0
  ☆205Updated 7 months ago
• YZY-stack / Ultra_Fast_Lane_Detection_TensorRT
  An ultra fast tiny model for lane detection, using onnx_parser, TensorRTAPI, torch2trt to accelerate. our model support for int8, dynamic…
  ☆120Updated 3 years ago
• Broad-sky / common-image-segmentation-algorithm
  🚀 Do not need libtorch, pure C++ TensorRT deploys SOLOv2 etc, which can be quickly ported to NX/TX2.
  ☆42Updated 2 years ago
• zjhellofss / KuiperCourse
  b站上的课程
  ☆71Updated last year
• uyzhang / yolov5_prune
  YOLOv5 pruning on COCO Dataset
  ☆82Updated last year
• ZLkanyo009 / MQBench_Quantize
  QAT(quantize aware training) for classification with MQBench
  ☆28Updated 3 years ago
• RussWong / LLM-engineering
  ☆15Updated 8 months ago
• caixiongjiang / HPC
  高性能计算课程&CUDA编程实例&深度学习推理框架
  ☆36Updated last year
• shouxieai / learning-cuda-trt
  learning-cuda-trt
  ☆108Updated last year
• nndeploy / nndeploy
  nndeploy is an end-to-end model inference and deployment framework. It aims to provide users with a powerful, easy-to-use, high-performan…
  ☆692Updated this week
• thb1314 / mmyolo_tensorrt
  ☆130Updated last year
• bytedance / ABQ-LLM
  An acceleration library that supports arbitrary bit-width combinatorial quantization operations
  ☆214Updated 4 months ago
• Tongkaio / CUDA_Kernel_Samples
  CUDA 算子手撕与面试指南
  ☆147Updated last month
• QINZHAOYU / CudaSteps
  基于《cuda编程-基础与实践》（樊哲勇 著）的cuda学习之路。
  ☆273Updated last year
• shouxieai / algorithm-cpp
  algorithm-cpp projects
  ☆79Updated 2 years ago
• shouxieai / tensorRT_quantization
  该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。
  ☆64Updated last year