freelw / cpp-transformerLinks
A C++ implementation of Transformer without special library dependencies, supporting CPU, CUDA, and Apple Metal, including training and inference.
☆128Updated 6 months ago
Alternatives and similar repositories for cpp-transformer
Users that are interested in cpp-transformer are comparing it to the libraries listed below
Sorting:
- ☆313Updated last year
- b站上的课程☆82Updated 2 years ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆64Updated last year
- 校招、秋招、春招、实习好项目,带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。☆491Updated 3 months ago
- 分层解耦的深度学习推理引擎☆79Updated 11 months ago
- 注释的nano_vllm仓库,并且完成了MiniCPM4的适配以及注册新模型的功能☆155Updated 5 months ago
- A light llama-like llm inference framework based on the triton kernel.☆171Updated last month
- 《CUDA编程基础与实践》 一书的代码☆154Updated 3 years ago
- 用C++实现一个简单的Transformer模型。 Attention Is All You Need。☆53Updated 4 years ago
- A CUDA tutorial to make people learn CUDA program from 0☆266Updated last year
- llama 2 Inference☆43Updated 2 years ago
- 🌈 Solutions of LeetGPU☆70Updated last week
- A tutorial for CUDA&PyTorch☆227Updated last week
- CUDA C 编程权威指南代码实现 包含了书上第二章到第八章的大部分代码实现和作者笔记,全由作者本人手动实现,难免有错误的地方,请大家谨慎参考,非常欢迎对错误的指正。 如果有帮助的话请Star一下,对作者帮助很大,谢谢!☆376Updated 3 years ago
- easy cuda code☆95Updated last year
- EasyNN是一个面向教学而开发的神经网络推理框架,旨在让大家0基础也能自主完成推理框架编写!☆37Updated last year
- ☆290Updated 5 years ago
- 高性能计算课程&CUDA编程实 例&深度学习推理框架☆66Updated 2 years ago
- 基于《cuda编程-基础与实践》(樊哲勇 著)的cuda学习之路。☆400Updated 2 years ago
- ☆28Updated last year
- CUDA 算子手撕与面试指南☆822Updated 5 months ago
- 先进编译实验室的个人主页☆195Updated 3 months ago
- CUDA 6大并行计算模式 代码与笔记☆61Updated 5 years ago
- 《C++模板元编程实战:一个深度学习框架的初步实现》☆182Updated 6 years ago
- bilibili视频【CUDA 12.x 并行编程入门(C++版)】配套代码☆33Updated last year
- Tiny C++ LLM inference implementation from scratch☆102Updated last week
- Tutorials for writing high-performance GPU operators in AI frameworks.☆136Updated 2 years ago
- ☆26Updated 5 months ago
- A one-page-only CGraph-API-liked DAG project.☆26Updated 11 months ago
- Implement custom operators in PyTorch with cuda/c++☆76Updated 3 years ago