SongQiPing / KuiperInfer_rsLinks
使用 Rust 语言重新实现 https://github.com/zjhellofss/KuiperInfer 和 https://github.com/zjhellofss/kuiperdatawhale 中的深度学习推理框架。
☆14Updated last year
Alternatives and similar repositories for KuiperInfer_rs
Users that are interested in KuiperInfer_rs are comparing it to the libraries listed below
Sorting:
- 自制基于C++的深度学习前向推理框架☆16Updated 2 years ago
- bilibili视频【CUDA 12.x 并行编程入门(C++版)】配套代码☆29Updated 9 months ago
- ggml学习笔记，ggml是一个机器学习的推理框架☆15Updated last year
- A one-page-only CGraph-API-liked DAG project.☆19Updated 3 months ago
- AIInfra 和 AISystem开源课程项目☆11Updated last week
- ☆24Updated 2 weeks ago
- 分层解耦的深度学习推理引擎☆73Updated 3 months ago
- Awesome code, projects, books, etc. related to CUDA☆17Updated last month
- paper-read-notes☆12Updated 8 months ago
- EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理 框架编写！☆29Updated 9 months ago
- b站上的课程☆75Updated last year
- 用C++实现一个简单的Transformer模型。 Attention Is All You Need。☆48Updated 4 years ago
- SGEMM optimization with cuda step by step☆19Updated last year
- easy cuda code☆75Updated 5 months ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆57Updated 7 months ago
- ☆106Updated last week
- 这个项目介绍了简单的CUDA入门，涉及到CUDA执行模型、线程层次、CUDA内存模型、核函数的编写方式以及PyTorch使用CUDA扩展的两种方式。通过该项目可以基本入门基于PyTorch的CUDA扩展的开发方式。☆87Updated 3 years ago
- A simple neural network inference framework☆25Updated last year
- A light llama-like llm inference framework based on the triton kernel.☆125Updated last week
- 一个轻量化的大模型推理框架☆18Updated last week
- Simple and efficient memory pool is implemented with C++11.☆8Updated 3 years ago
- Free resource for the book AI Compiler Development Guide☆44Updated 2 years ago
- ☆11Updated 3 months ago
- ☆16Updated last year
- 大规模并行处理器编程实战 第二版答案☆32Updated 3 years ago
- learn TensorRT from scratch🥰☆15Updated 8 months ago
- A practical way of learning Swizzle☆20Updated 4 months ago
- CPU Memory Compiler and Parallel programing☆26Updated 6 months ago
- Some common CUDA kernel implementations (Not the fastest).☆18Updated last month
- ☆31Updated 9 months ago