A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/Pallas/JAX).
☆34Mar 4, 2025Updated last year
Alternatives and similar repositories for jax-flash-attn2
Users that are interested in jax-flash-attn2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- (EasyDel Former) is a utility library designed to simplify and enhance the development in JAX☆33Oct 28, 2026Updated last week
- Agents for intelligence and coordination☆33Updated this week
- easydel jax kernels writen in triton for gpus and pallas for tpus☆31Oct 25, 2026Updated last week
- OST Collection: An AI-powered suite of models that predict the next word matches with remarkable accuracy (Text Generative Models). OST C…☆16Nov 16, 2023Updated 2 years ago
- SpecTrax is a JAX-native library for neural networks and graph learning, built for performance, composability and modularity.☆44Oct 26, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- jax/flax training infrastructure☆16Updated this week
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆19Jul 24, 2025Updated last year
- If it quacks like a tensor...☆59Nov 13, 2024Updated last year
- Latent Large Language Models☆19Aug 24, 2024Updated 2 years ago
- Minimal but scalable implementation of large language models in JAX☆34Nov 28, 2025Updated 11 months ago
- Effective transpose on Hopper GPU☆29Sep 6, 2025Updated last year
- Parallel Associative Scan for Language Models☆18Jan 8, 2024Updated 2 years ago
- A FlashAttention implementation for JAX with support for efficient document mask computation and context parallelism.☆177Nov 11, 2025Updated 11 months ago
- code for Towards Data Science article on prompt-loss-weight☆11Jun 4, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Inference code for LLaMA models in JAX☆120May 21, 2024Updated 2 years ago
- Pytorch/XLA SPMD Test code in Google TPU☆23Apr 3, 2024Updated 2 years ago
- Annotated implementations of equivariant (graph) neural networks in Jax: EGNN, SEGNN, NequIP.☆44Mar 1, 2025Updated last year
- ☆13Apr 15, 2024Updated 2 years ago
- DS 595: AI Methods for Science - Course materials, slides, and resources☆12Apr 29, 2026Updated 6 months ago
- Code and data to explore neural scaling laws of xLSTM and Transformer models.☆24Updated this week
- See details in https://github.com/pytorch/xla/blob/r1.12/torch_xla/distributed/fsdp/README.md☆25Dec 22, 2022Updated 3 years ago
- Measurements and emulation of Lagrangian bias models for clustering and lensing cross-correlations.☆10Jun 11, 2024Updated 2 years ago
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A program to automate the algorithm described in William Wallace Cook's Plotto, The Masterbook of All Plots.☆13Sep 18, 2016Updated 10 years ago
- 4-bit Shampoo for Memory-Efficient Network Training (NeurIPS 2024)☆13Feb 13, 2025Updated last year
- Example code snipped to visualize a neural network fitting a surface to random points in space☆12Dec 26, 2021Updated 4 years ago
- Utilities for testing code equivalence☆11Jun 25, 2024Updated 2 years ago
- CIFAR10 ResNets implemented in JAX+Flax☆12Apr 6, 2022Updated 4 years ago
- ☆48Nov 1, 2025Updated last year
- A fully trainable state space model (SSM)☆16Mar 18, 2025Updated last year
- ☆19Apr 17, 2026Updated 6 months ago
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆14Aug 8, 2023Updated 3 years ago
- Code accompanying the paper "Disparate Impact in Differential Privacy from Gradient Misalignment".☆11Apr 4, 2023Updated 3 years ago
- Euclid Visible Instrument Python package. Includes a simulator and various analysis codes.☆11Mar 25, 2015Updated 11 years ago
- ꩜ Lift Julia array operations to MLIR dialects and run using IREE.☆41Jan 11, 2025Updated last year
- ☆18Jun 16, 2026Updated 4 months ago
- https://github.com/gpu-mode/reference-kernels☆27Jul 4, 2026Updated 4 months ago
- ☆19Feb 14, 2025Updated last year