peerdavid / layerwise-batch-entropy
Layerwise Batch Entropy Regularization
☆22Updated 2 years ago
Alternatives and similar repositories for layerwise-batch-entropy:
Users that are interested in layerwise-batch-entropy are comparing it to the libraries listed below
- AdaCat☆49Updated 2 years ago
- ☆33Updated 2 years ago
- Code for ICLR 2021 Paper, "Anytime Sampling for Autoregressive Models via Ordered Autoencoding"☆26Updated last year
- Official code for Long Expressive Memory (ICLR 2022, Spotlight)☆69Updated 3 years ago
- [ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)☆14Updated 5 months ago
- Re-implementation of 'Grokking: Generalization beyond overfitting on small algorithmic datasets'☆38Updated 3 years ago
- code for "Semi-Discrete Normalizing Flows through Differentiable Tessellation"☆26Updated 2 years ago
- A collection of optimizers, some arcane others well known, for Flax.☆29Updated 3 years ago
- ☆73Updated 2 years ago
- Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper☆80Updated 3 years ago
- Code base for SRSGD.☆28Updated 5 years ago
- A simple implementation of a deep linear Pytorch module☆19Updated 4 years ago
- Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network☆64Updated 4 years ago
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆50Updated 2 years ago
- ☆37Updated 3 years ago
- High performance pytorch modules☆18Updated 2 years ago
- ☆15Updated 4 years ago
- Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)☆48Updated 2 years ago
- Usable implementation of Emerging Symbol Binding Network (ESBN), in Pytorch☆24Updated 4 years ago
- ☆31Updated 3 years ago
- A GPT, made only of MLPs, in Jax☆57Updated 3 years ago
- ☆29Updated 2 years ago
- GPT, but made only out of MLPs☆88Updated 3 years ago
- Blog post☆17Updated last year
- MTAdam: Automatic Balancing of Multiple Training Loss Terms☆36Updated 4 years ago
- JAX implementation of Learning to learn by gradient descent by gradient descent☆27Updated 6 months ago
- ☆47Updated 2 years ago
- General Invertible Transformations for Flow-based Generative Models☆17Updated 4 years ago
- A scalable implementation of diffusion and flow-matching with XGBoost models, applied to calorimeter data.☆18Updated 5 months ago
- FID computation in Jax/Flax.☆27Updated 9 months ago