PyTorch implementation of the Flash Spectral Transform Unit.
☆23Sep 19, 2024Updated 2 years ago
Alternatives and similar repositories for flash-stu
Users that are interested in flash-stu are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- ☆36Apr 12, 2024Updated 2 years ago
- Official repository Flash Local Linear Attention☆40May 28, 2026Updated 3 months ago
- ☆12Mar 7, 2022Updated 4 years ago
- Mamba support for transformer lens☆20Sep 17, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for the paper "Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns"☆19Mar 15, 2024Updated 2 years ago
- FLA but cuTile☆27Apr 17, 2026Updated 5 months ago
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- ⚡️Qwen-Image 4.8x🎉 speedup with Hybrid Acceleration for low VRAM GPUs☆17Oct 24, 2025Updated 10 months ago
- ☆120Feb 25, 2025Updated last year
- ☆13Jan 7, 2025Updated last year
- 方便扩展的Cuda算子理解和优化框架，仅用在学习使用☆18Jun 13, 2024Updated 2 years ago
- FlashRNN - Fast RNN Kernels with I/O Awareness☆188Updated this week
- Automatic differentiation for Triton Kernels☆29Aug 12, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆13Jun 18, 2024Updated 2 years ago
- Curse-of-memory phenomenon of RNNs in sequence modelling☆19May 8, 2025Updated last year
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated last week
- 全卷积网络进行语音降噪☆18Dec 8, 2021Updated 4 years ago
- ☆37Aug 7, 2025Updated last year
- Official Repository of Paper "Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs"☆15Sep 25, 2025Updated 11 months ago
- Notes for CIS 700 (Fall '19) at Syracuse U.☆13Nov 6, 2019Updated 6 years ago
- ☆34Oct 4, 2024Updated last year
- Experiments Notebook of "Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism"☆17Apr 30, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- It's a baby compiler. (Lean btw.)☆16May 19, 2025Updated last year
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆135Jun 24, 2025Updated last year
- Accelerated First Order Parallel Associative Scan☆199Jan 7, 2026Updated 8 months ago
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)☆25Jun 6, 2024Updated 2 years ago
- study of cutlass☆22Nov 10, 2024Updated last year
- Triton kernels for dynamic causal short convolutions.☆30Jun 4, 2026Updated 3 months ago
- ☆20Dec 24, 2024Updated last year
- ☆30Oct 3, 2022Updated 3 years ago
- Xmixers: A collection of SOTA efficient token/channel mixers☆29Sep 4, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A GPU FP32 computation method with Tensor Cores.☆27Dec 8, 2025Updated 9 months ago
- Triton kernels and PyTorch ops for Block Attention Residuals (AttnRes)☆89May 29, 2026Updated 3 months ago
- Official code for UnICORNN (ICML 2021)☆28Oct 1, 2021Updated 4 years ago
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆15Feb 13, 2023Updated 3 years ago
- Official repository for Parallax (Parameterized Local Linear Attention)☆69Jul 30, 2026Updated last month
- Experiments on Multi-Head Latent Attention☆101Aug 19, 2024Updated 2 years ago
- The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.☆92Jul 17, 2025Updated last year