zpye / SimpleInfer
A simple neural network inference framework
☆24Updated last year
Alternatives and similar repositories for SimpleInfer:
Users that are interested in SimpleInfer are comparing it to the libraries listed below
- A one-page-only CGraph-API-liked DAG project.☆17Updated 2 months ago
- CUDA 6大并行计算模式 代码与笔记☆60Updated 4 years ago
- ☆20Updated 4 years ago
- 分层解耦的深度学习推理引擎☆72Updated 2 months ago
- ☆10Updated 9 months ago
- b站上的课程☆74Updated last year
- 大规模并行处理器编程实战 第二版答案☆32Updated 2 years ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆49Updated 5 months ago
- 🐱 ncnn int8 模型量化评估☆14Updated 2 years ago
- TensorRT encapsulation, learn, rewrite, practice.☆28Updated 2 years ago
- ☆36Updated 6 months ago
- EasyNN是一个面向教学而开发的神经网络推理框架,旨在让大家0基础也能自主完成推理框架编写!☆27Updated 7 months ago
- ☆17Updated last year
- ☆11Updated last month
- study of cutlass☆21Updated 5 months ago
- High Performan Ai Model Web Server. Mainly support computer vision model. Quickly establish your own ai-model server. https://github.com/…☆42Updated last week
- CPU Memory Compiler and Parallel programing☆26Updated 5 months ago
- ☆39Updated 3 years ago
- ☆25Updated 3 years ago
- ☆18Updated last year
- This is a repository to practice multi-thread programming in C++☆22Updated last year
- Common libraries for PPL projects☆29Updated last month
- Quantize yolov5 using pytorch_quantization.🚀🚀🚀☆13Updated last year
- autoTVM神经网络推理代码优化搜索演示,基于tvm编译开源模型centerface,并使用autoTVM搜索最优推理代码, 最终部署编译为c++代码,演示平台是cuda,可以是其他平台,例如树莓派,安卓手机,苹果手机.Thi is a demonstration of …☆27Updated 3 years ago
- Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration☆57Updated 10 months ago
- 解读cudnn文档,掌握其用法☆18Updated 11 months ago
- c++实现的clip推理,模型有一点点改动,但是不大,改动和导出模型的代码可以在readme里找到,模型文件都在Releases里,包括AX650的模型。新增支持ChineseCLIP☆29Updated 3 months ago
- OneFlow->ONNX☆43Updated 2 years ago
- 将MNN拆解的简易前向推理框架(for study!)☆22Updated 4 years ago
- pdf☆89Updated 6 years ago