peerdavid / layerwise-batch-entropyLinks
Layerwise Batch Entropy Regularization
☆23Updated 2 years ago
Alternatives and similar repositories for layerwise-batch-entropy
Users that are interested in layerwise-batch-entropy are comparing it to the libraries listed below
Sorting:
- ☆74Updated 2 years ago
- Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper☆81Updated 3 years ago
- ☆33Updated 2 years ago
- Code repository of the paper "CKConv: Continuous Kernel Convolution For Sequential Data" published at ICLR 2022. https://arxiv.org/abs/21…☆121Updated 2 years ago
- AdaCat☆49Updated 2 years ago
- ☆47Updated 2 years ago
- [ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)☆14Updated 8 months ago
- Code for ICLR 2021 Paper, "Anytime Sampling for Autoregressive Models via Ordered Autoencoding"☆26Updated 2 years ago
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆124Updated last year
- Official code for Long Expressive Memory (ICLR 2022, Spotlight)☆70Updated 3 years ago
- Sequence Modeling with Structured State Spaces☆65Updated 2 years ago
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆51Updated 3 years ago
- code for "Semi-Discrete Normalizing Flows through Differentiable Tessellation"☆26Updated 2 years ago
- ☆19Updated 3 years ago
- ☆163Updated 2 years ago
- MaskedTensors for PyTorch☆38Updated 2 years ago
- Transformers with doubly stochastic attention☆46Updated 2 years ago
- ☆37Updated 3 years ago
- JAX implementation of Learning to learn by gradient descent by gradient descent☆27Updated 9 months ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆79Updated 4 years ago
- A GPT, made only of MLPs, in Jax☆58Updated 4 years ago
- The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…☆67Updated 2 years ago
- Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch☆101Updated 2 years ago
- Latest Weight Averaging (NeurIPS HITY 2022)☆30Updated 2 years ago
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆124Updated 3 years ago
- Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.☆105Updated 4 years ago
- Re-implementation of 'Grokking: Generalization beyond overfitting on small algorithmic datasets'☆38Updated 3 years ago
- Blog post☆17Updated last year
- Usable implementation of Emerging Symbol Binding Network (ESBN), in Pytorch☆25Updated 4 years ago
- The accompanying code for "Simplifying and Understanding State Space Models with Diagonal Linear RNNs" (Ankit Gupta, Harsh Mehta, Jonatha…☆22Updated 2 years ago