kklemon / FlashPerceiver
Fast and memory efficient PyTorch implementation of the Perceiver with FlashAttention.
☆26Updated 6 months ago
Alternatives and similar repositories for FlashPerceiver:
Users that are interested in FlashPerceiver are comparing it to the libraries listed below
- ☆34Updated 4 months ago
- ☆64Updated 10 months ago
- σ-GPT: A New Approach to Autoregressive Models☆63Updated 8 months ago
- Code accompanying the paper "Generalized Interpolating Discrete Diffusion"☆77Updated last week
- Exploration into the Firefly algorithm in Pytorch☆38Updated 2 months ago
- Implementation of the proposed Spline-Based Transformer from Disney Research☆88Updated 5 months ago
- Code for the paper "Function-Space Learning Rates"☆19Updated 2 weeks ago
- [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"☆97Updated 3 weeks ago
- ☆53Updated last year
- ☆26Updated last year
- Focused on fast experimentation and simplicity☆71Updated 4 months ago
- Implementations of attention with the softpick function, naive and FlashAttention-2☆28Updated this week
- Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch☆24Updated 3 months ago
- Efficient World Models with Context-Aware Tokenization. ICML 2024☆98Updated 7 months ago
- Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.☆68Updated 2 weeks ago
- https://x.com/BlinkDL_AI/status/1884768989743882276☆27Updated this week
- ☆80Updated last year
- Official PyTorch Implementation of the Longhorn Deep State Space Model☆50Updated 5 months ago
- Implementation of Denoising Diffusion Probabilistic Models (DDPM) in JAX and Flax.☆20Updated last year
- ☆26Updated 11 months ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆30Updated this week
- ☆33Updated 7 months ago
- ☆30Updated 5 months ago
- ☆54Updated last month
- Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto☆55Updated 11 months ago
- ☆32Updated 11 months ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆27Updated 7 months ago
- ☆21Updated 7 months ago
- Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]☆19Updated last month
- ☆22Updated 6 months ago