microsoft / ReinMaxLinks
Beyond Straight-Through
☆97Updated 2 years ago
Alternatives and similar repositories for ReinMax
Users that are interested in ReinMax are comparing it to the libraries listed below
Sorting:
- [NeurIPS 2022] Your Transformer May Not be as Powerful as You Expect (official implementation)☆33Updated last year
- ☆51Updated 11 months ago
- [ICML 2023] Reflected Diffusion Models (https://arxiv.org/abs/2304.04740)☆157Updated last year
- ☆97Updated 2 years ago
- Implementation of Discrete Key / Value Bottleneck, in Pytorch☆88Updated last year
- [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"☆104Updated 3 weeks ago
- Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch☆100Updated 2 years ago
- A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.☆67Updated 10 months ago
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆124Updated last year
- NF-Layers for constructing neural functionals.☆85Updated last year
- ☆129Updated last year
- Randomized Positional Encodings Boost Length Generalization of Transformers☆82Updated last year
- Official code for "Accelerating Feedforward Computation via Parallel Nonlinear Equation Solving", ICML 2021☆27Updated 3 years ago
- Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]☆66Updated 8 months ago
- [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…☆64Updated last year
- The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …☆16Updated last year
- Accelerated First Order Parallel Associative Scan☆181Updated 9 months ago
- Transformers with doubly stochastic attention☆45Updated 2 years ago
- ☆85Updated last year
- ☆51Updated 2 years ago
- Sparse Backpropagation for Mixture-of-Expert Training☆29Updated 11 months ago
- Explorations into the recently proposed Taylor Series Linear Attention☆99Updated 9 months ago
- Sequence Modeling with Structured State Spaces☆64Updated 2 years ago
- ICML 2022: Learning Iterative Reasoning through Energy Minimization☆46Updated 2 years ago
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆44Updated 2 years ago
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)☆24Updated 11 months ago
- Repository of the paper "Accelerating Transformer Inference for Translation via Parallel Decoding"☆116Updated last year
- ☆32Updated last year
- [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"☆60Updated 3 months ago
- [ICLR 2023] Official implementation of Transnormer in our ICLR 2023 paper - Toeplitz Neural Network for Sequence Modeling☆79Updated last year