Stanford-AIMI / LieRELinks
[ICML-2025] We introduce Lie group Relative position Encodings (LieRE) that goes beyond RoPE in supporting n-dimensional inputs.
☆14Updated 5 months ago
Alternatives and similar repositories for LieRE
Users that are interested in LieRE are comparing it to the libraries listed below
Sorting:
- More dimensions = More fun☆26Updated last year
- Linear Attention for Efficient Bidirectional Sequence Modeling☆15Updated 8 months ago
- HGRN2: Gated Linear RNNs with State Expansion☆56Updated last year
- Implementation of the general framework for AMIE, from the paper "Towards Conversational Diagnostic AI", out of Google Deepmind☆72Updated last year
- ☆40Updated last year
- Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"☆55Updated last year
- Official PyTorch Implementation of "The Hidden Attention of Mamba Models"☆231Updated 3 months ago
- Explorations into improving ViTArc with Slot Attention☆43Updated last year
- Implementation of ViTaR: ViTAR: Vision Transformer with Any Resolution in PyTorch☆38Updated last year
- Visualizing representations with diffusion based conditional generative model.☆105Updated 2 years ago
- Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025☆31Updated 8 months ago
- Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…☆21Updated last week
- Implementation of the paper: "BRAVE : Broadening the visual encoding of vision-language models"☆25Updated 2 weeks ago
- Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"☆170Updated last year
- Symile is a flexible, architecture-agnostic contrastive loss that enables training modality-specific representations for any number of mo…☆46Updated 10 months ago
- [ICML-2025] We introduce Lie group Relative position Encodings (LieRE) that goes beyond RoPE in supporting n-dimensional inputs.☆28Updated 5 months ago
- Code for Principal Masked Autoencoders☆30Updated 10 months ago
- Deep Networks Grok All the Time and Here is Why☆38Updated last year
- X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains☆50Updated 8 months ago
- ☆19Updated last year
- This repository includes the official implementation our paper "Scaling White-Box Transformers for Vision"☆48Updated last year
- PyTorch implementation of "From Sparse to Soft Mixtures of Experts"☆68Updated 2 years ago
- Official Implementation of DiffCLIP: Differential Attention Meets CLIP☆51Updated 10 months ago
- ☆34Updated 8 months ago
- Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…☆119Updated 3 weeks ago
- Official code implementation for the paper "Do Vision & Language Decoders use Images and Text equally? How Self-consistent are their Expl…☆12Updated 9 months ago
- Official code for "TOAST: Transfer Learning via Attention Steering"☆188Updated 2 years ago
- Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"☆57Updated last year
- ☆50Updated last year
- [AAAI 2025] Does VLM Classification Benefit from LLM Description Semantics?☆25Updated 5 months ago