freelw / cpp-transformerLinks
A C++ implementation of Transformer without special library dependencies, supporting CPU, CUDA, and Apple Metal, including training and inference.
☆107Updated 2 months ago
Alternatives and similar repositories for cpp-transformer
Users that are interested in cpp-transformer are comparing it to the libraries listed below
Sorting:
- ☆297Updated last year
- A light llama-like llm inference framework based on the triton kernel.☆157Updated 2 weeks ago
- 校招、秋招、春招、实习好项目,带你从零动手实现支持LLama2/3和Qwen2.5的大模型 推理框架。☆426Updated 3 months ago
- b站上的课程☆75Updated 2 years ago
- llama 2 Inference☆42Updated last year
- 用C++实现一个简单的Transformer模型。 Attention Is All You Need。☆50Updated 4 years ago
- 分层解耦的深度学习推理引擎☆75Updated 7 months ago
- easy cuda code☆83Updated 9 months ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆62Updated 11 months ago
- 高性能计算课程&CUDA编程实例&深度学习推理框架☆59Updated 2 years ago
- 自制基于C++的深度学习前向推理框架☆19Updated 2 years ago
- ☆27Updated last year
- A CUDA tutorial to make people learn CUDA program from 0☆252Updated last year
- CUDA C 编程权威指南代码实现 包含了书上第二章到第八章的大部分代码实现和作者笔记,全由作者本人手动实现,难免有错误的地方,请大家谨慎参考,非常欢迎对错误的指正。 如果有帮助的话请Star一下,对作者帮助很大,谢谢!☆362Updated 2 years ago
- CUDA 6大并行计算模式 代码与笔记☆61Updated 5 years ago
- A one-page-only CGraph-API-liked DAG project.☆25Updated 7 months ago
- 《CUDA编程基础与实践》一书的代码☆138Updated 3 years ago
- GPU高性能编程CUDA实战随书代码☆40Updated 3 years ago
- 基于《cuda编程-基础与实践》(樊哲勇 著)的cuda学习之路。☆362Updated last year
- A simple neural network inference framework☆25Updated 2 years ago
- 《C++模板元编程实战:一个深度学习框架的初步实现》☆185Updated 6 years ago
- ☆282Updated 4 years ago
- 注释的nano_vllm仓库,并且完成了MiniCPM4的适配以及注册新模型的功能☆77Updated 2 months ago
- ☆139Updated last year
- 彻底弄懂BP反向传播,15行代码,C++实现也简单,MNIST分类98.29%精度☆37Updated 3 years ago
- 大规模并行处理器编程实战 第二版答案☆33Updated 3 years ago
- Parallel Prefix Sum (Scan) with CUDA☆25Updated last year
- ☆36Updated 4 months ago
- some hpc project for learning☆24Updated last year
- CPU Memory Compiler and Parallel programing☆26Updated 10 months ago