keith2018 / TinyTorchLinks
A tiny deep learning training framework implemented from scratch in C++ that follows PyTorch's API.
☆53Updated last week
Alternatives and similar repositories for TinyTorch
Users that are interested in TinyTorch are comparing it to the libraries listed below
Sorting:
- Implement custom operators in PyTorch with cuda/c++☆62Updated 2 years ago
- Codes & examples for "CUDA - From Correctness to Performance"☆98Updated 7 months ago
- ☆70Updated 2 years ago
- Code release for book "Efficient Training in PyTorch"☆66Updated last month
- Tiny C++11 GPT-2 inference implementation from scratch☆63Updated 2 weeks ago
- Implement Flash Attention using Cute.☆85Updated 5 months ago
- x86-64 SIMD矢量优化系列教程☆121Updated 2 months ago
- 大规模并行处理器编程实战 第二版答案☆32Updated 3 years ago
- 分层解耦的深度学习推理引擎☆73Updated 3 months ago
- b站上的课程☆75Updated last year
- ☆275Updated 4 years ago
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆79Updated 3 weeks ago
- A tutorial for CUDA&PyTorch☆142Updated 4 months ago
- This is a cross-chip platform collection of operators and a unified neural network library.☆17Updated last year
- Triton Documentation in Chinese Simplified / Triton 中文文档☆71Updated last month
- ☆134Updated last year
- 使用 CUDA C++ 实现的 llama 模型推理框架☆57Updated 7 months ago
- Implementation of FlashAttention in PyTorch☆150Updated 4 months ago
- tutorial for writing custom pytorch cpp+cuda kernel, applied on volume rendering (NeRF)☆27Updated last year
- Tutorials for writing high-performance GPU operators in AI frameworks.☆130Updated last year
- Examples and exercises from the book Programming Massively Parallel Processors - A Hands-on Approach. David B. Kirk and Wen-mei W. Hwu (T…☆67Updated 4 years ago
- 📚FFPA(Split-D): Extend FlashAttention with Split-D for large headdim, O(1) GPU SRAM complexity, 1.8x~3x↑🎉 faster than SDPA EA.☆184Updated 3 weeks ago
- A PyTorch-like deep learning framework. Just for fun.☆154Updated last year
- Large-scale Auto-Distributed Training/Inference Unified Framework | Memory-Compute-Control Decoupled Architecture | Multi-language SDK & …☆50Updated this week
- Standalone Flash Attention v2 kernel without libtorch dependency☆110Updated 8 months ago
- ☆27Updated last year
- A light llama-like llm inference framework based on the triton kernel.☆122Updated this week
- ☆21Updated 4 years ago
- ☆85Updated 2 months ago
- Course materials for MIT6.5940: TinyML and Efficient Deep Learning Computing☆46Updated 4 months ago