A minimal, educational implementation of Flash Attention v2 in CUDA
☆14Feb 25, 2026Updated 8 months ago
Alternatives and similar repositories for mini-flash-attention
Users that are interested in mini-flash-attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 目标是在自制虚拟 GPU 上运行 Qwen2-0.5B INT8 推理。核心痛点是从零实现一个类 CUDA 的执行环境——包括 RISC-V SIMT 解释器、PCI 驱动、用户态运行时库和算子库,全部从无到有手写。☆19May 31, 2026Updated 5 months ago
- CUDA Opt Agent is an LLM-driven toolkit for automated CUDA kernel optimization. It generates baselines from text, specs, or existing .cu …☆14Sep 6, 2026Updated 2 months ago
- Flash attention implementation Minimal CUDA implementation of Flash Attention with tiled computation and online softmax. Educational imp…☆21Dec 27, 2025Updated 10 months ago
- Personal quant trading open-source strategy and notes☆16Jun 1, 2025Updated last year
- ☆21Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- CuteDSL Swizzle Visualize Tool☆14Feb 22, 2026Updated 8 months ago
- High-performance GPU kernels for Ads and Recsys model training, independently implemented and optimized for real-world workloads and mode…☆58Updated this week
- This is a cross-chip platform collection of operators and a unified neural network library.☆17Nov 3, 2023Updated 3 years ago
- ☆23Aug 20, 2025Updated last year
- Cute layout visualization☆45Jan 18, 2026Updated 10 months ago
- This project aims to provide a high effective KV cache manage framework for llm inference and improve memory utilization and inference sp…☆75Apr 24, 2026Updated 6 months ago
- A curated list of awesome neural radiance fields papers☆13Mar 11, 2021Updated 5 years ago
- Passive Reduced-Order RC Interconnect Macromodeling Algorithm☆11Jul 5, 2021Updated 5 years ago
- Claude code workspace for developing ROCm☆19Mar 13, 2026Updated 8 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- 基于Rust的大模型推理框架☆14Updated this week
- CuTeDSL tutorials, tools, autotuner, profiler, etc.☆47Jun 27, 2026Updated 4 months ago
- An open lab for DeepInfer systems research, correctness validation, and end-to-end optimization☆32Oct 28, 2026Updated 3 weeks ago
- Tests with PlusCal / TLA+☆27Jan 12, 2017Updated 9 years ago
- A Haskell implementation of Dijkstra's algorithm☆17Aug 10, 2014Updated 12 years ago
- ☆11Mar 6, 2024Updated 2 years ago
- [Hackintosh] Configuration for Lenovo Thinkpad P1 Gen1 MobileWorkStation .☆16Nov 15, 2021Updated 5 years ago
- [SIGGRAPH 2024] Temporally Stable Metropolis Light Transport Denoising using Recurrent Transformer Blocks☆20Jul 31, 2024Updated 2 years ago
- A beautiful & silky vim configuration☆23Jan 9, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆29Mar 23, 2026Updated 7 months ago
- Speed-of-Light SW efficiency by using ultra low-latency primitives for comms collectives☆13Apr 8, 2026Updated 7 months ago
- [原理解析] 大模型基本功(手撕Transformer模型、手撕PPO、GRPO、DPO训练器)☆33Jul 8, 2025Updated last year
- ☆12May 8, 2026Updated 6 months ago
- RocksDB/LevelDB inspired key-value database in Go☆10Nov 3, 2020Updated 6 years ago
- 笔记整理 Skill:一个用于 Claude Code 的课程资料、PDF、PPT、题库整理成 Markdown/Obsidian 复习笔记的 Claude Skill。☆18Jun 30, 2026Updated 4 months ago
- The game of Notakto, made in Haskell with Apecs and Raylib☆28Sep 12, 2025Updated last year
- Speed up image preprocess with cuda when handle image or tensorrt inference☆86Nov 5, 2025Updated last year
- Rust implementation of Google protocol buffers☆12Oct 20, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- GEMM☆10Aug 26, 2023Updated 3 years ago
- Luxoft Automotive HMI Safe Renderer☆29Aug 25, 2020Updated 6 years ago
- Tools for physical measurement of video frame presentation timing☆16Feb 4, 2024Updated 2 years ago
- 天涯神贴 tianyashentie.vercel.app☆19Aug 4, 2026Updated 3 months ago
- Two case studies: megakernels roughly on par with CUDA Graphs + PDL. Code and baselines for further research.☆12Nov 6, 2026Updated last week
- ☆17May 14, 2026Updated 6 months ago
- ☆12Jul 23, 2026Updated 3 months ago
Are these results useful?