Implementation of Flash Attention in Jax
☆229Mar 1, 2024Updated 2 years ago
Alternatives and similar repositories for flash-attention-jax
Users that are interested in flash-attention-jax are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆221Aug 24, 2026Updated 2 months ago
- jax-triton contains integrations between JAX and OpenAI Triton☆478Updated this week
- LoRA for arbitrary JAX models and functions☆143Feb 26, 2024Updated 2 years ago
- JMP is a Mixed Precision library for JAX.☆214Oct 5, 2026Updated last month
- Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…☆561Oct 26, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- JAX implementation of the Llama 2 model☆218Feb 2, 2024Updated 2 years ago
- ☆372Apr 12, 2024Updated 2 years ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆720Jan 26, 2026Updated 9 months ago
- Train very large language models in Jax.☆209Oct 21, 2023Updated 3 years ago
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆189Jun 24, 2022Updated 4 years ago
- ☆66Aug 2, 2022Updated 4 years ago
- JAX bindings for Flash Attention v2☆110Feb 28, 2026Updated 8 months ago
- A simple, performant, and scalable Jax LLM!☆2,465Updated this week
- Inference code for LLaMA models in JAX☆120May 21, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A FlashAttention implementation for JAX with support for efficient document mask computation and context parallelism.☆177Nov 11, 2025Updated last year
- JAX-Toolbox☆438Updated this week
- A simple library for scaling up JAX programs☆149Nov 4, 2025Updated last year
- Orbax provides common checkpointing and persistence utilities for JAX users☆540Updated this week
- ☆364Nov 6, 2026Updated last week
- ☆36Nov 22, 2024Updated last year
- Implementation of a Transformer, but completely in Triton☆278Apr 5, 2022Updated 4 years ago
- Library for reading and processing ML training data.☆808Updated this week
- Minimal yet performant LLM examples in pure JAX☆288Aug 23, 2026Updated 2 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- JAX Synergistic Memory Inspector☆187Jul 16, 2024Updated 2 years ago
- JAX implementation of the Mistral 7b v0.2 model☆35Jul 3, 2024Updated 2 years ago
- Accelerate, Optimize performance with streamlined training and serving options with JAX.☆378Updated this week
- Elegant easy-to-use neural networks + scientific computing in JAX. https://docs.kidger.site/equinox/☆3,000Oct 25, 2026Updated 3 weeks ago
- Minimal library to train LLMs on TPU in JAX with pjit().☆301Jun 2, 2026Updated 5 months ago
- Everything you want to know about Google Cloud TPU☆573Jul 16, 2024Updated 2 years ago
- ☆957Oct 7, 2026Updated last month
- Source-to-Source Debuggable Derivatives in Pure Python☆15Jan 23, 2024Updated 2 years ago
- Task-based datasets, preprocessing, and evaluation for sequence models.☆596Nov 9, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes☆241May 12, 2023Updated 3 years ago
- Exploration into the Firefly algorithm in Pytorch☆41Feb 14, 2025Updated last year
- CLU lets you write beautiful training loops in JAX.☆371Oct 26, 2026Updated 3 weeks ago
- Optax is a gradient processing and optimization library for JAX.☆2,367Updated this week
- A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.☆138Nov 7, 2026Updated last week
- Machine Learning eXperiment Utilities☆48Jul 29, 2025Updated last year
- Implementation of Memory-Compressed Attention, from the paper "Generating Wikipedia By Summarizing Long Sequences"☆71Apr 10, 2023Updated 3 years ago
Are these results useful?