lucidrains / VN-transformer
A Transformer made of Rotation-equivariant Attention using Vector Neurons
☆83Updated last year
Related projects ⓘ
Alternatives and complementary repositories for VN-transformer
- A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch☆77Updated 9 months ago
- [ICLR'24] GTA: A Geometry-Aware Attention Mechanism for Multi-view Transformers☆120Updated 5 months ago
- Transformer implementation for "Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion"☆55Updated last month
- Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk☆46Updated last year
- ☆43Updated 6 months ago
- Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto☆53Updated 6 months ago
- ☆46Updated 5 months ago
- ☆33Updated 10 months ago
- code for "Riemannian Flow Matching on General Geometries".☆177Updated 8 months ago
- [CVPR'21] SetVAE: Learning Hierarchical Composition for Generative Modeling of Set-Structured Data, in PyTorch☆71Updated 2 years ago
- Annotated Flow Matching paper☆135Updated 2 months ago
- ☆10Updated 4 months ago
- Official Implementation for "Consistency Flow Matching: Defining Straight Flows with Velocity Consistency"☆151Updated 4 months ago
- Implementation of a multimodal diffusion transformer in Pytorch☆97Updated 4 months ago
- Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"☆57Updated last year
- [ICLR'23 Spotlight] gDDIM: analyze and accelerate general diffusion models, isotropic and non-isotropic☆48Updated last year
- VQVAE for video prediction☆26Updated 2 years ago
- Implementation of Recurrent Interface Network (RIN), for highly efficient generation of images and video without cascading networks, in P…☆194Updated 9 months ago
- Implementation of rectified flow and some of its followup research / improvements in Pytorch☆191Updated 2 weeks ago
- ☆195Updated last month
- Official PyTorch implementation of the paper: Flow Matching in Latent Space☆208Updated 3 weeks ago
- Neural Optimal Transport with Lagrangian Costs☆49Updated 4 months ago
- Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI☆84Updated 2 years ago
- Educational implementation of the Discrete Flow Matching paper☆55Updated 2 months ago
- [Neurips 2021]Diffusion Normalizing Flow (DiffFlow)☆117Updated last year
- [NeurIPS 2021] Code for Learning Signal-Agnostic Manifolds of Neural Fields☆66Updated last year
- Implementation of Discrete Key / Value Bottleneck, in Pytorch☆87Updated last year
- Implementation of the proposed Spline-Based Transformer from Disney Research☆76Updated last week
- [ICML 2023] Reflected Diffusion Models (https://arxiv.org/abs/2304.04740)☆157Updated last year
- Clarity: A Minimalist Website Template for AI Research☆58Updated 3 weeks ago