keith2018 / TinyTorch
A tiny deep learning training framework implemented from scratch in C++ that follows PyTorch's API.
☆48Updated 3 weeks ago
Alternatives and similar repositories for TinyTorch:
Users that are interested in TinyTorch are comparing it to the libraries listed below
- x86-64 SIMD矢量优化系列教程☆119Updated 3 weeks ago
- Triton Documentation in Chinese Simplified / Triton 中文文档☆66Updated last week
- Large-scale Auto-Distributed Training/Inference Unified Framework | Memory-Compute-Control Decoupled Architecture | Multi-language SDK & …☆41Updated this week
- μ-Cuda, COVER THE LAST MILE OF CUDA. With features: intellisense-friendly, structured launch, automatic cuda graph generation and updatin…☆173Updated 3 weeks ago
- Tutorials for writing high-performance GPU operators in AI frameworks.☆130Updated last year
- ☆70Updated 2 years ago
- Codes & examples for "CUDA - From Correctness to Performance"☆96Updated 6 months ago
- Code release for book "Efficient Training in PyTorch"☆60Updated 2 weeks ago
- GPU高性能编程CUDA实战随书代码☆36Updated 2 years ago
- Implement Flash Attention using Cute.☆76Updated 4 months ago
- Tiny C++11 GPT-2 inference implementation from scratch☆58Updated 2 weeks ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆50Updated 5 months ago
- 分层解耦的深度学习推理引擎☆72Updated 2 months ago
- Examples and exercises from the book Programming Massively Parallel Processors - A Hands-on Approach. David B. Kirk and Wen-mei W. Hwu (T…☆67Updated 4 years ago
- Examples of CUDA implementations by Cutlass CuTe☆159Updated 2 months ago
- 📚FFPA(Split-D): Yet another Faster Flash Attention with O(1) GPU SRAM complexity large headdim, 1.8x~3x↑🎉 faster than SDPA EA.☆169Updated 2 weeks ago
- ☆20Updated 4 years ago
- CPU Memory Compiler and Parallel programing☆26Updated 5 months ago
- A light llama-like llm inference framework based on the triton kernel.☆108Updated last week
- This is a cross-chip platform collection of operators and a unified neural network library.☆17Updated last year
- 大规模并行处理器编程实战 第二版答案☆32Updated 2 years ago
- Implement custom operators in PyTorch with cuda/c++☆58Updated 2 years ago
- CUDA 6大并行计算模式 代码与笔记☆60Updated 4 years ago
- easy cuda code☆70Updated 4 months ago
- Parallel Prefix Sum (Scan) with CUDA☆19Updated 10 months ago
- 小彭老师推出 SyCL 2020 课程(施工中,日后会在直播中放出)☆15Updated last year
- ☆122Updated last year
- 先进编译实验室的个人主页☆75Updated this week
- 鉴定网络热门并行编程框架 - 性能测评(附小彭老师锐评)已评测:Taichi、SyCL、C++、OpenMP、TBB、Mojo☆36Updated last year
- ☆21Updated last month