freelw / cpp-transformerLinks
A C++ implementation of Transformer without special library dependencies, supporting CPU, CUDA, and Apple Metal, including training and inference.
☆93Updated last week
Alternatives and similar repositories for cpp-transformer
Users that are interested in cpp-transformer are comparing it to the libraries listed below
Sorting:
- 分层解耦的深度学习推理引擎☆74Updated 5 months ago
- A light llama-like llm inference framework based on the triton kernel.☆138Updated this week
- b站上的课程☆75Updated last year
- 使用 CUDA C++ 实现的 llama 模型推理框架☆58Updated 8 months ago
- 用C++实现一个简单的Transformer模型。 Attention Is All You Need。☆48Updated 4 years ago
- ☆281Updated 9 months ago
- 《C++模板元编程实战:一个深度学习框架的初步实现》☆184Updated 6 years ago
- llama 2 Inference☆41Updated last year
- 大规模并行处理器编程实战 第二版答案☆33Updated 3 years ago
- ☆27Updated last year
- 校招、秋招、春招、实习好项目,带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。☆388Updated 3 weeks ago
- EasyNN是一个面向教学而开发的神经网络推理框架,旨在让大家0基础也能自主完成推理框架编写!☆31Updated 10 months ago
- CUDA 6大并行计算模式 代 码与笔记☆60Updated 4 years ago
- CPU Memory Compiler and Parallel programing☆26Updated 8 months ago
- A simple neural network inference framework☆25Updated last year
- ☆279Updated 4 years ago
- easy cuda code☆78Updated 7 months ago
- 《Asynchronous Programming with C++ - 1st Edition》的非专业个人翻译☆34Updated 6 months ago
- Created a simple neural network using C++17 standard and the Eigen library that supports both forward and backward propagation.☆9Updated 11 months ago
- Tutorials for writing high-performance GPU operators in AI frameworks.☆129Updated last year
- CUDA C 编程权威指南代码实现 包含了书上第二章到第八章的大部分代码实现和作者笔记,全由作者本人手动实现,难免有错误的地方,请大家谨慎参考,非常欢迎对错误的指正。 如果有帮助的话请Star一下,对作者帮助很大,谢谢!☆349Updated 2 years ago
- ☆31Updated 2 months ago
- CUDA 算子手撕与面试指南☆477Updated 6 months ago
- 高性能计算课程&CUDA编程实例&深度学习推理框架☆51Updated last year
- ☆137Updated last year
- llm deploy project based onnx.☆42Updated 9 months ago
- 彻底弄懂BP反向传播,15行代码,C++实现也简单,MNIST分类98.29%精度☆36Updated 3 years ago
- Parallel Prefix Sum (Scan) with CUDA☆24Updated last year
- Implement custom operators in PyTorch with cuda/c++☆65Updated 2 years ago
- ☆32Updated 10 months ago