nebius / kvaxLinks
A FlashAttention implementation for JAX with support for efficient document mask computation and context parallelism.
☆155Updated last month
Alternatives and similar repositories for kvax
Users that are interested in kvax are comparing it to the libraries listed below
Sorting:
- Minimal yet performant LLM examples in pure JAX☆225Updated this week
- seqax = sequence modeling + JAX☆169Updated 5 months ago
- torchax is a PyTorch frontend for JAX. It gives JAX the ability to author JAX programs using familiar PyTorch syntax. It also provides JA…☆159Updated 2 weeks ago
- A simple library for scaling up JAX programs☆144Updated 2 months ago
- Write a fast kernel and run it on Discord. See how you compare against the best!☆66Updated 2 weeks ago
- ☆287Updated last year
- JAX-Toolbox☆373Updated this week
- FlashRNN - Fast RNN Kernels with I/O Awareness☆174Updated 2 months ago
- Dion optimizer algorithm☆413Updated this week
- a Jax quantization library☆80Updated last week
- jax-triton contains integrations between JAX and OpenAI Triton☆436Updated 3 weeks ago
- MoE training for Me and You and maybe other people