kyutai-labs / jax-flash-attn3Links
JAX bindings for the flash-attention3 kernels
☆15Updated 3 weeks ago
Alternatives and similar repositories for jax-flash-attn3
Users that are interested in jax-flash-attn3 are comparing it to the libraries listed below
Sorting:
- FlexAttention w/ FlashAttention3 Support☆27Updated last year
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆19Updated this week
- 🔭 interactively explore `onnx` networks in your CLI.☆26Updated last year
- ☆32Updated last year
- Make triton easier☆48Updated last year
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated this week
- DPO, but faster 🚀☆45Updated 10 months ago
- TensorRT LLM Benchmark Configuration☆13Updated last year
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …☆14Updated last year
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆33Updated last year
- Train, tune, and infer Bamba model☆134Updated 4 months ago
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆73Updated last year
- A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.☆122Updated last month
- Implementation of Hyena Hierarchy in JAX☆10Updated 2 years ago
- ☆57Updated last year
- Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP☆61Updated 5 months ago
- https://x.com/BlinkDL_AI/status/1884768989743882276☆28Updated 5 months ago
- Rust crate for some audio utilities☆25Updated 7 months ago
- APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…☆25Updated last week
- ☆101Updated 5 months ago
- JAX Scalify: end-to-end scaled arithmetics☆16Updated 11 months ago
- vLLM adapter for a TGIS-compatible gRPC server.☆41Updated this week
- implement llava using candle☆15Updated last year
- ☆78Updated 11 months ago
- ☆15Updated last year
- ☆12Updated 8 months ago
- Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.☆72Updated this week
- Training hybrid models for dummies.☆27Updated last week
- Model compression for ONNX☆97Updated 11 months ago
- Repository for CPU Kernel Generation for LLM Inference☆26Updated 2 years ago