kyutai-labs / jax-flash-attn3
JAX bindings for the flash-attention3 kernels
☆11Updated 9 months ago
Alternatives and similar repositories for jax-flash-attn3
Users that are interested in jax-flash-attn3 are comparing it to the libraries listed below
Sorting:
- ☆14Updated 5 months ago
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆18Updated last week
- Read and write tensorboard data using Rust☆21Updated last year
- A small python library to run iterators in a separate process☆10Updated last year
- TensorRT LLM Benchmark Configuration☆13Updated 9 months ago
- 🔭 interactively explore `onnx` networks in your CLI.☆24Updated 11 months ago
- ☆19Updated 7 months ago
- Rust crate for some audio utilities☆23Updated 2 months ago
- No-GIL Python environment featuring NVIDIA Deep Learning libraries.☆60Updated last month
- FlexAttention w/ FlashAttention3 Support☆26Updated 7 months ago
- ☆12Updated last year
- ☆14Updated last month
- ☆30Updated 11 months ago
- ☆13Updated last year
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆15Updated this week
- GPTQ inference TVM kernel☆38Updated last year
- Awesome code, projects, books, etc. related to CUDA☆16Updated last month
- IntLLaMA: A fast and light quantization solution for LLaMA☆18Updated last year
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆41Updated 2 weeks ago
- Benchmark tests supporting the TiledCUDA library.☆16Updated 5 months ago
- ☆16Updated 3 weeks ago
- Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.☆10Updated 11 months ago
- Here we collect trick questions and failed tasks for open source LLMs to improve them.☆32Updated 2 years ago
- implement llava using candle☆14Updated 11 months ago
- A CUDA kernel for NHWC GroupNorm for PyTorch☆18Updated 6 months ago
- APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…☆23Updated this week
- Exploration into the Firefly algorithm in Pytorch☆39Updated 3 months ago
- Loop Nest - Linear algebra compiler and code generator.☆22Updated 2 years ago
- Graph model execution API for Candle☆14Updated 5 months ago
- ☆21Updated last year