Implementation of Flash Attention in Jax
☆230Mar 1, 2024Updated 2 years ago
Alternatives and similar repositories for flash-attention-jax
Users that are interested in flash-attention-jax are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆221Aug 24, 2026Updated 2 months ago
- LoRA for arbitrary JAX models and functions☆143Feb 26, 2024Updated 2 years ago
- jax-triton contains integrations between JAX and OpenAI Triton☆473Oct 20, 2026Updated last week
- Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…☆560Oct 15, 2026Updated 2 weeks ago
- JMP is a Mixed Precision library for JAX.☆214Oct 5, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆718Jan 26, 2026Updated 9 months ago
- ☆372Apr 12, 2024Updated 2 years ago
- JAX implementation of the Llama 2 model☆217Feb 2, 2024Updated 2 years ago
- Train very large language models in Jax.☆209Oct 21, 2023Updated 3 years ago
- ☆66Aug 2, 2022Updated 4 years ago
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆189Jun 24, 2022Updated 4 years ago
- JAX bindings for Flash Attention v2☆110Feb 28, 2026Updated 8 months ago
- A simple, performant, and scalable Jax LLM!☆2,453Updated this week
- JAX-Toolbox☆432Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A simple library for scaling up JAX programs☆149Nov 4, 2025Updated 11 months ago
- Inference code for LLaMA models in JAX☆120May 21, 2024Updated 2 years ago
- Orbax provides common checkpointing and persistence utilities for JAX users☆537Updated this week
- A FlashAttention implementation for JAX with support for efficient document mask computation and context parallelism.☆177Nov 11, 2025Updated 11 months ago
- ☆363Oct 20, 2026Updated last week
- ☆36Nov 22, 2024Updated last year
- Accelerate, Optimize performance with streamlined training and serving options with JAX.☆376Updated this week
- Elegant easy-to-use neural networks + scientific computing in JAX. https://docs.kidger.site/equinox/☆2,994Updated this week
- Library for reading and processing ML training data.☆799Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Minimal yet performant LLM examples in pure JAX☆286Aug 23, 2026Updated 2 months ago
- Implementation of a Transformer, but completely in Triton☆279Apr 5, 2022Updated 4 years ago
- JAX Synergistic Memory Inspector☆187Jul 16, 2024Updated 2 years ago
- Minimal library to train LLMs on TPU in JAX with pjit().☆300Jun 2, 2026Updated 4 months ago
- Source-to-Source Debuggable Derivatives in Pure Python☆15Jan 23, 2024Updated 2 years ago
- Task-based datasets, preprocessing, and evaluation for sequence models.☆596Oct 7, 2026Updated 3 weeks ago
- ☆958Oct 7, 2026Updated 3 weeks ago
- Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes☆241May 12, 2023Updated 3 years ago
- CLU lets you write beautiful training loops in JAX.☆371Oct 7, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Optax is a gradient processing and optimization library for JAX.☆2,359Updated this week
- Exploration into the Firefly algorithm in Pytorch☆41Feb 14, 2025Updated last year
- Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch☆548May 16, 2025Updated last year
- A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.☆138Oct 6, 2026Updated 3 weeks ago
- Flax is a neural network library for JAX that is designed for flexibility.☆7,359Updated this week
- Implementing the Denoising Diffusion Probabilistic Model in Flax☆162Nov 1, 2022Updated 3 years ago
- Everything you want to know about Google Cloud TPU☆572Jul 16, 2024Updated 2 years ago