A basic pure pytorch implementation of flash attention
☆16Oct 28, 2024Updated last year
Alternatives and similar repositories for flash_attention
Users that are interested in flash_attention are comparing it to the libraries listed below
Sorting:
- Proof-of-concept of global switching between numpy/jax/pytorch in a library.☆18Jun 18, 2024Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆16Jun 16, 2024Updated last year
- ☆29Jul 8, 2024Updated last year
- new optimizer☆20Aug 4, 2024Updated last year
- ☆17Oct 22, 2024Updated last year
- Experimental GPU language with meta-programming☆27Sep 6, 2024Updated last year
- [arXiv 2026] Official PyTorch Repository for "Coarse-Guided Visual Generation via Weighted h-Transform Sampling"☆38Updated this week
- Code for D-DiT☆61Apr 1, 2025Updated 11 months ago
- Source code for paper "Learning the Solution Operator of Boundary Value Problems using Graph Neural Networks"☆20Jul 25, 2024Updated last year
- FlexiTokens☆18Dec 27, 2025Updated 2 months ago
- A repository with some Deep Reinforcement Learning baselines written in julia using Flux.☆12Mar 28, 2023Updated 2 years ago
- ☆34May 14, 2025Updated 10 months ago
- ☆10Nov 15, 2023Updated 2 years ago
- Official implementation of the paper "Pretraining Language Models to Ponder in Continuous Space"☆25Jul 21, 2025Updated 8 months ago
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Jan 15, 2024Updated 2 years ago
- ☆13May 7, 2023Updated 2 years ago
- ☆13Dec 19, 2023Updated 2 years ago
- Extensive time series analysis of chinese PM2.5 content, using models from ARMA and VAR to LSTMs and dynamic time warping clustering☆11Aug 17, 2019Updated 6 years ago
- Optimized primitives for collective multi-GPU communication☆10May 8, 2024Updated last year
- Using FlexAttention to compute attention with different masking patterns☆47Sep 22, 2024Updated last year
- ☆15Oct 24, 2023Updated 2 years ago
- Webcam demo for SKTBrain/DiscoGAN☆13Sep 11, 2019Updated 6 years ago
- Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.☆13Jul 15, 2024Updated last year
- Jax implementation of "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆15May 10, 2024Updated last year
- A tutorial on doing RL research in Julia using both Jupyter notebooks and normal project structures.☆10Jun 23, 2021Updated 4 years ago
- Continual Learning Toolkit for Reinforcement Learning☆21Jan 28, 2018Updated 8 years ago
- CUDA implementation of Wavelet KAN.☆16Jun 8, 2024Updated last year
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"☆603Oct 7, 2025Updated 5 months ago
- [ICLR26 Oral] RealPDEBench: A Benchmark for Complex Physical Systems with Paired Real-World and Simulated Data☆59Mar 8, 2026Updated 2 weeks ago
- ☆51Jan 28, 2024Updated 2 years ago
- GGML bindings that aim to be idiomatic Rust rather than directly corresponding to the C/C++ interface☆19Sep 25, 2023Updated 2 years ago
- The dataset CoLan-150K and the concept decomposition in the paper Concept Lancet (CVPR 2025)☆20Jan 18, 2026Updated 2 months ago
- Avisynth DeFlicker plugin can remove old film intensity flicker by temporal mean luma smoothing.☆15May 23, 2019Updated 6 years ago
- Analyzing LLM Alignment via Token distribution shift☆17Jan 26, 2024Updated 2 years ago
- sync google contacts with information from the dominos data breach <3☆11May 24, 2021Updated 4 years ago
- ☆23May 22, 2024Updated last year
- Object recognition with Pepper using a deep learning model☆10Sep 16, 2021Updated 4 years ago
- Official implementation for "Nested Attention: Semantic-aware Attention Values for Concept Personalization" [SIGGRAPH 2025]☆27Aug 4, 2025Updated 7 months ago
- ☆10Oct 17, 2021Updated 4 years ago