Lemon-cmd / energy-transformer-torch
Official Implementation of Energy Transformer in PyTorch for Mask Image Reconstruction
☆25Updated last year
Alternatives and similar repositories for energy-transformer-torch
Users that are interested in energy-transformer-torch are comparing it to the libraries listed below
Sorting:
- Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)☆76Updated last year
- Parallelizing non-linear sequential models over the sequence length☆51Updated 4 months ago
- This repository contains the official code for Energy Transformer---an efficient Energy-based Transformer variant for graph classificatio…☆24Updated last year
- [EMNLP 24] Source code for paper 'AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tu…☆10Updated 5 months ago
- Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)☆53Updated 6 months ago
- A State-Space Model with Rational Transfer Function Representation.☆78Updated last year
- ☆88Updated 11 months ago
- PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.☆81Updated last year
- Code to simulate energy-based analog systems and equilibrium propagation☆27Updated last month
- ☆13Updated 4 months ago
- ☆26Updated last year
- Paper list for Modern Hopfield Networks☆12Updated last month
- Benchmarking RL for POMDPs in Pure JAX [Code for "Structured State Space Models for In-Context Reinforcement Learning" (NeurIPS 2023)]☆100Updated last year
- Implementation of the "Online learning of long-range dependencies" paper, NeurIPS 2023☆19Updated 6 months ago
- Predictive Coding JAX-based library☆57Updated 3 weeks ago
- ☆16Updated 8 months ago
- MoMo: Momentum Models for Adaptive Learning Rates☆18Updated 11 months ago
- Self-Expanding Neural Networks☆39Updated last year
- ☆291Updated 4 months ago
- Implementations of various linear RNN layers using pytorch and triton☆51Updated last year
- Implementation/simulation of the predictive forward-forward credit assignment algorithm for training neurobiologically-plausible recurren…☆57Updated 2 years ago
- Unofficial implementation of Linear Recurrent Units, by Deepmind, in Pytorch☆69Updated 3 weeks ago
- ☆54Updated this week
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆83Updated last year
- ☆25Updated 2 years ago
- Official implementation of Stochastic Taylor Derivative Estimator (STDE) NeurIPS2024☆105Updated 5 months ago
- Oscillatory State-Space Models☆78Updated 2 months ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆58Updated 2 months ago
- Pytorch implementation of Hebbian learning algorithms to train deep convolutional neural networks.☆27Updated 10 months ago
- Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆53Updated last month