Stanford-AIMI / LieRELinks
[ICML-2025] We introduce Lie group Relative position Encodings (LieRE) that goes beyond RoPE in supporting n-dimensional inputs.
☆13Updated 4 months ago
Alternatives and similar repositories for LieRE
Users that are interested in LieRE are comparing it to the libraries listed below
Sorting:
- More dimensions = More fun☆26Updated last year
- Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…☆20Updated 2 weeks ago
- Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"☆55Updated last year
- HGRN2: Gated Linear RNNs with State Expansion☆56Updated last year
- Implementation of the general framework for AMIE, from the paper "Towards Conversational Diagnostic AI", out of Google Deepmind☆72Updated last year
- The official repository for HyperZ⋅Z⋅W Operator Connects Slow-Fast Networks for Full Context Interaction.☆42Updated 8 months ago
- Explorations into improving ViTArc with Slot Attention☆43Updated last year
- Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk☆47Updated 2 years ago
- Visualizing representations with diffusion based conditional generative model.☆103Updated 2 years ago
- The Gaussian Histogram Loss (HL-Gauss) proposed by Imani et al. with a few convenient wrappers for regression, in Pytorch☆68Updated 3 weeks ago
- ☆40Updated last year
- Code for Principal Masked Autoencoders☆30Updated 8 months ago
- ☆19Updated 11 months ago
- Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"☆166Updated 10 months ago
- Self contained pytorch implementation of a sinkhorn based router, for mixture of experts or otherwise☆39Updated last year
- Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch☆103Updated 2 years ago
- [NeurIPS 2024, spotlight] Multivariate Learned Adaptive Noise for Diffusion Models☆30Updated last year
- ☆141Updated 2 months ago
- X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains☆49Updated 7 months ago
- Deep Networks Grok All the Time and Here is Why☆38Updated last year
- Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch☆25Updated 10 months ago
- Official code for "TOAST: Transfer Learning via Attention Steering"☆188Updated 2 years ago
- Unofficial implementation of paper : Exploring the Space of Key-Value-Query Models with Intention☆12Updated 2 years ago
- Official PyTorch Implementation of "The Hidden Attention of Mamba Models"☆231Updated last month
- [ICCV25] Official Implementation of LeGrad☆83Updated last year
- recipe for training fully-featured self supervised image jepa models☆12Updated 6 months ago
- A repository to house some personal attempts to beat some state-of-the-art for medical datasets☆100Updated 2 years ago
- PyTorch implementation of "From Sparse to Soft Mixtures of Experts"☆67Updated 2 years ago
- Implementation of a multimodal diffusion transformer in Pytorch☆107Updated last year
- Code and weights for the paper "Cluster and Predict Latents Patches for Improved Masked Image Modeling"☆124Updated 8 months ago