A minimal, educational implementation of Flash Attention v2 in CUDA
☆14Feb 25, 2026Updated 8 months ago
Alternatives and similar repositories for mini-flash-attention
Users that are interested in mini-flash-attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- CuteDSL Swizzle Visualize Tool☆14Feb 22, 2026Updated 8 months ago
- Personal quant trading open-source strategy and notes☆16Jun 1, 2025Updated last year
- High-performance GPU kernels for Ads and Recsys model training, independently implemented and optimized for real-world workloads and mode…☆57Updated this week
- 基于Rust的大模型推理框架☆14Oct 21, 2026Updated last week
- This is a cross-chip platform collection of operators and a unified neural network library.☆17Nov 3, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This project aims to provide a high effective KV cache manage framework for llm inference and improve memory utilization and inference sp…☆75Apr 24, 2026Updated 6 months ago
- Cute layout visualization☆45Jan 18, 2026Updated 9 months ago
- ☆23Aug 20, 2025Updated last year
- A curated list of awesome neural radiance fields papers☆13Mar 11, 2021Updated 5 years ago
- ☆17May 14, 2026Updated 5 months ago
- CuTeDSL tutorials, tools, autotuner, profiler, etc.☆47Jun 27, 2026Updated 4 months ago
- A Haskell implementation of Dijkstra's algorithm☆17Aug 10, 2014Updated 12 years ago
- [SIGGRAPH 2024] Temporally Stable Metropolis Light Transport Denoising using Recurrent Transformer Blocks☆20Jul 31, 2024Updated 2 years ago
- [原理解析] 大模型基本功（手撕Transformer模型、手撕PPO、GRPO、DPO训练器）☆33Jul 8, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆28Mar 23, 2026Updated 7 months ago
- Speed-of-Light SW efficiency by using ultra low-latency primitives for comms collectives☆13Apr 8, 2026Updated 6 months ago
- The Source Code for AlphaCrafter☆22Jul 29, 2026Updated 3 months ago
- Speed up image preprocess with cuda when handle image or tensorrt inference☆86Nov 5, 2025Updated 11 months ago
- Native Blackwell (sm_100) tcgen05 training backward for the gated-linear-recurrence family (GDN/KDA/GLA/SSD/LA), plus a contract-grade ve…☆15Oct 18, 2026Updated last week
- RocksDB/LevelDB inspired key-value database in Go☆10Nov 3, 2020Updated 5 years ago
- The game of Notakto, made in Haskell with Apecs and Raylib☆28Sep 12, 2025Updated last year
- Rust implementation of Google protocol buffers☆12Oct 20, 2025Updated last year
- GEMM☆10Aug 26, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆16Sep 25, 2021Updated 5 years ago
- ☆21Nov 14, 2022Updated 3 years ago
- Tools for physical measurement of video frame presentation timing☆17Feb 4, 2024Updated 2 years ago
- A Chinese-focused PyTorch framework for exploring Attention Residuals in Qwen3-style causal LMs, with baseline, Block AttnRes, Full AttnR…☆21May 3, 2026Updated 5 months ago
- 硕士学位论文入门到毕业☆15Aug 13, 2023Updated 3 years ago
- Matt Pocock Skills 中英双语学习图谱与对照阅读站☆19Jul 10, 2026Updated 3 months ago
- Tutorial for rCore OS step by step (3rd edition)☆10Apr 24, 2021Updated 5 years ago
- Kernels by MakoraGenerate☆15May 26, 2026Updated 5 months ago
- ☆11May 16, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Modified Nodal Analysis by using MATLAB☆20Jun 28, 2021Updated 5 years ago
- A compact, readable PyTorch reference implementation of the DeepSeek-V4 architecture (Flash and Pro), in the spirit of nanoGPT. ~4,300 LO…☆20Aug 14, 2026Updated 2 months ago
- Optimize SGEMM step by step☆10Sep 4, 2024Updated 2 years ago
- 各种因子和量化技术的实现与研究，例如Alpha191☆15Feb 21, 2024Updated 2 years ago
- 开箱即用的轻量级推理引擎，全面超越nano-vllm；支持Qwen3系列模型 ；流式调用与openai兼容接口/ A lightweight LLM inference engine built from scratch☆18Sep 10, 2026Updated last month
- Multi-heap-sort for many small arrays, quicksort with 3 pivots for one big array, CUDA acceleration, CUDA memory compression.☆13Sep 29, 2024Updated 2 years ago
- Python implementation of Visual Hull☆24Nov 25, 2020Updated 5 years ago