A basic pure pytorch implementation of flash attention
☆16Oct 28, 2024Updated last year
Alternatives and similar repositories for flash_attention
Users that are interested in flash_attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Proof-of-concept of global switching between numpy/jax/pytorch in a library.☆18Jun 18, 2024Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆16Jun 16, 2024Updated last year
- Here you find the Spectral Operator Learning Under construcTION☆20May 8, 2024Updated last year
- Official Documentation for DSPy Library☆23Apr 24, 2026Updated last week
- notebooks to finetune `bert-small-amharic`, `bert-mini-amharic`, and `xlm-roberta-base` models using an Amharic text classification datas…☆11May 10, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- new optimizer☆20Aug 4, 2024Updated last year
- ☆17Oct 22, 2024Updated last year
- Code for Mesh Transformer describes in the EAGLE dataset☆42Feb 21, 2025Updated last year
- [arXiv 2026] Official PyTorch Repository for "Coarse-Guided Visual Generation via Weighted h-Transform Sampling"☆41Mar 16, 2026Updated last month
- Experimental GPU language with meta-programming☆31Sep 6, 2024Updated last year
- Source code for paper "Learning the Solution Operator of Boundary Value Problems using Graph Neural Networks"☆20Jul 25, 2024Updated last year
- A repository with some Deep Reinforcement Learning baselines written in julia using Flux.☆12Mar 28, 2023Updated 3 years ago
- Nomalizing flows for orbita-free DFT☆11Sep 20, 2024Updated last year
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Jun 21, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆26Jan 26, 2026Updated 3 months ago
- ☆34May 14, 2025Updated 11 months ago
- ☆10Nov 15, 2023Updated 2 years ago
- [ICLR 2025] Neural Operator-Assisted Computational Fluid Dynamics in PyTorch☆81Nov 21, 2025Updated 5 months ago
- Deep Learning for Computer Vision☆61Jun 19, 2024Updated last year
- ☆13May 7, 2023Updated 2 years ago
- Pyramid Mask Text Detector designed by SenseTime Video Intelligence Research team.☆14Aug 1, 2019Updated 6 years ago
- ☆13Dec 19, 2023Updated 2 years ago
- FlexiTokens☆21Dec 27, 2025Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Extensive time series analysis of chinese PM2.5 content, using models from ARMA and VAR to LSTMs and dynamic time warping clustering☆12Aug 17, 2019Updated 6 years ago
- Optimized primitives for collective multi-GPU communication☆10May 8, 2024Updated last year
- ☆14Aug 22, 2024Updated last year
- Official implementation of the paper "Pretraining Language Models to Ponder in Continuous Space"☆26Jul 21, 2025Updated 9 months ago
- Using FlexAttention to compute attention with different masking patterns☆47Sep 22, 2024Updated last year
- {DeepL, Google, WMT-Best, davinci-003, turbo, gpt-4} × {En-De, En-Cs, En-Ru, En-Zh, De-Fr, En-Ja, Uk-En, Uk-Cs, En-Hr, En-Ha, En-Is}☆14Jun 18, 2023Updated 2 years ago
- ☆15Oct 24, 2023Updated 2 years ago
- Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.☆13Jul 15, 2024Updated last year
- Jax implementation of "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆15May 10, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A tutorial on doing RL research in Julia using both Jupyter notebooks and normal project structures.☆10Jun 23, 2021Updated 4 years ago
- CUDA implementation of Wavelet KAN.☆17Jun 8, 2024Updated last year
- Experiment utility code, specifically designed for use with Compute Canada.☆11Jan 27, 2025Updated last year
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"☆609Oct 7, 2025Updated 6 months ago
- Goal-oriented error estimation and mesh adaptation for finite element problems solved using Firedrake☆12Dec 5, 2023Updated 2 years ago
- [NeurIPS 2024 Spotlight] Towards Universal Mesh Movement Networks☆19Jul 16, 2025Updated 9 months ago
- GGML bindings that aim to be idiomatic Rust rather than directly corresponding to the C/C++ interface☆20Sep 25, 2023Updated 2 years ago