RedRyan111 / GLOM
An implementation of 2021 paper by Geoffrey Hinton: "How to represent part-whole hierarchies in a neural network" in Pytorch.
☆58Updated 3 years ago
Alternatives and similar repositories for GLOM:
Users that are interested in GLOM are comparing it to the libraries listed below
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆50Updated 2 years ago
- An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts from neural fields, top-down-bottom-up proc…☆193Updated 3 years ago
- Implementation of Hierarchical Transformer Memory (HTM) for Pytorch☆72Updated 3 years ago
- Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)☆48Updated 2 years ago
- Usable implementation of Emerging Symbol Binding Network (ESBN), in Pytorch☆24Updated 4 years ago
- ☆36Updated 4 years ago
- A GPT, made only of MLPs, in Jax☆57Updated 3 years ago
- Implementation of Kronecker Attention in Pytorch☆18Updated 4 years ago
- Code for the paper PermuteFormer☆42Updated 3 years ago
- An adaptive training algorithm for residual network☆15Updated 4 years ago
- Code to reproduce the results for Compositional Attention☆60Updated 2 years ago
- Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.☆103Updated 3 years ago
- [NeurIPS'20] Code for the Paper Compositional Visual Generation and Inference with Energy Based Models☆44Updated 2 years ago
- ☆47Updated 2 years ago
- A JAX implementation of Broaden Your Views for Self-Supervised Video Learning, or BraVe for short.☆49Updated 9 months ago
- "CoPhy: Counterfactual Learning of Physical Dynamics", F. Baradel, N. Neverova, J. Mille, G. Mori, C. Wolf, ICLR'2020☆33Updated 4 years ago
- Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper☆80Updated 3 years ago
- ☆24Updated 10 months ago
- ☆41Updated 2 years ago
- MTAdam: Automatic Balancing of Multiple Training Loss Terms☆36Updated 4 years ago
- ☆29Updated 3 years ago
- A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…☆44Updated 5 years ago
- Exemplar VAE: Linking Generative Models, Nearest Neighbor Retrieval, and Data Augmentation☆69Updated 4 years ago
- Implementation of some personal helper functions for Einops, my most favorite tensor manipulation library ❤️☆54Updated 2 years ago
- Bongard-LOGO is a Python code repository with the purpose of generating synthetic Bongard problems on a large scale with little human int…☆51Updated 2 years ago
- Official implementation of the paper "Topographic VAEs learn Equivariant Capsules"☆79Updated 3 years ago
- EfficientMORL (ICML'21)☆22Updated 3 years ago
- Implementation of the Remixer Block from the Remixer paper, in Pytorch☆35Updated 3 years ago
- ☆38Updated 3 years ago
- SimCLR pytorch implementation using DistributedDataParallel.☆24Updated 2 years ago