Alternatives and similar repositories for flash-attn-101

Users that are interested in flash-attn-101 are comparing it to the libraries listed below

• HanGuo97 / log-linear-attention
  ☆269Updated 7 months ago
• tokenbender / mHC-manifold-constrained-hyper-connections
  implementations and experimentation on mHC by deepseek - https://arxiv.org/abs/2512.24880
  ☆278Updated 3 weeks ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆112Updated last year
• fal-ai-community / nano-mdm
  Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
  ☆56Updated 10 months ago
• kpup1710 / CAMEx
  [ICLR 2025] CAMEx: Curvature-Aware Merging of Experts
  ☆22Updated 11 months ago
• huggingface / kernels
  Load compute kernels from the Hub
  ☆389Updated this week
• lucidrains / maskbit-pytorch
  Implementation of the proposed MaskBit from Bytedance AI
  ☆83Updated last year
• bluorion-com / ZClip
  Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".
  ☆144Updated 2 months ago
• andravin / spio
  Experimental CUDA kernel framework unifying typed dimensions, NVRTC JIT specialization, and ML‑guided tuning.
  ☆46Updated last week
• lucidrains / multimodal-dit-pytorch
  Implementation of a multimodal diffusion transformer in Pytorch
  ☆107Updated last year
• fla-org / flash-bidirectional-linear-attention
  Triton implement of bi-directional (non-causal) linear attention
  ☆64Updated 11 months ago
• horseee / dKV-Cache
  [NeurIPS'25] dKV-Cache: The Cache for Diffusion Language Models
  ☆129Updated 8 months ago
• cloneofsimo / scaling-guide
  WIP
  ☆93Updated last year
• sandyresearch / chipmunk
  🎬 3.7× faster video generation E2E 🖼️ 1.6× faster image generation E2E ⚡ ColumnSparseAttn 9.3× vs FlashAttn‑3 💨 ColumnSparseGEMM 2.5× …
  ☆101Updated 4 months ago
• Optimization-AI / FastCLIP
  Distributed Optimization Infra for learning CLIP models
  ☆27Updated last year
• mgmalek / efficient_cross_entropy
  ☆124Updated last year
• philippe-eecs / vitok
  ☆34Updated 8 months ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆88Updated last year
• indri-voice / vit.triton
  VIT inference in triton because, why not?
  ☆35Updated last year
• nil0x9 / flash-muon
  Flash-Muon: An Efficient Implementation of Muon Optimizer
  ☆229Updated 7 months ago
• TianjinYellow / SPAM-Optimizer
  ☆36Updated 10 months ago
• baochi0212 / LaVy
  Pioneering in Vietnamese Multimodal Large Language Model
  ☆51Updated last year
• devvrit / matformer
  MatFormer repo
  ☆70Updated last year
• lucidrains / taylor-series-linear-attention
  Explorations into the recently proposed Taylor Series Linear Attention
  ☆100Updated last year
• lucidrains / hyper-connections
  Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public
  ☆163Updated 2 weeks ago
• IST-DASLab / MicroAdam
  This repository contains code for the MicroAdam paper.
  ☆22Updated last year
• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆126Updated last year
• wmn-231314 / diffusion-data-constraint
  Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…
  ☆119Updated 3 weeks ago
• google-research / silc
  [ECCV 2024] Official Release of SILC: Improving vision language pretraining with self-distillation
  ☆47Updated last year
• IST-DASLab / QuEST
  Work in progress.
  ☆79Updated 2 months ago