lucidrains / glom-pytorchLinks
An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts from neural fields, top-down-bottom-up processing, and attention (consensus between columns), for emergent part-whole heirarchies from data
☆194Updated 4 years ago
Alternatives and similar repositories for glom-pytorch
Users that are interested in glom-pytorch are comparing it to the libraries listed below
Sorting:
- An implementation of 2021 paper by Geoffrey Hinton: "How to represent part-whole hierarchies in a neural network" in Pytorch.☆58Updated 4 years ago
- Self-supervised learning through the eyes of a child☆142Updated 3 years ago
- Implementation of Feedback Transformer in Pytorch☆107Updated 4 years ago
- Understanding Training Dynamics of Deep ReLU Networks☆293Updated last month
- Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.☆105Updated 4 years ago
- Implementation of Barlow Twins paper☆99Updated 2 years ago
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆127Updated 2 years ago
- Official PyTorch implementation of the paper "Self-Supervised Relational Reasoning for Representation Learning", NeurIPS 2020 Spotlight.☆143Updated last year
- Memory efficient MAML using gradient checkpointing☆84Updated 5 years ago
- Code for the paper: Putting An End to End-to-End: Gradient-Isolated Learning of Representations☆285Updated 2 years ago
- Implementation of Slot Attention from GoogleAI☆440Updated 10 months ago
- A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network☆142Updated 4 years ago
- Official codebase for Pretrained Transformers as Universal Computation Engines.☆248Updated 3 years ago
- Whitening for Self-Supervised Representation Learning | Official repository☆129Updated 2 years ago
- FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.☆208Updated last year
- A collection of code snippets for my PyTorch Lightning projects☆107Updated 4 years ago
- Official implementation of the paper "Topographic VAEs learn Equivariant Capsules"☆80Updated 3 years ago
- Trains Transformer model variants. Data isn't shuffled between batches.☆144Updated 2 years ago
- PyTorch implementation of Sinusodial Representation networks (SIREN)☆264Updated 2 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆124Updated 11 months ago
- CATER: A diagnostic dataset for Compositional Actions and TEmporal Reasoning☆105Updated 4 years ago
- ☆87Updated 3 years ago
- Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper☆81Updated 3 years ago
- Implementation of Pixel-level Contrastive Learning, proposed in the paper "Propagate Yourself", in Pytorch☆259Updated 4 years ago
- Implementation of Hierarchical Transformer Memory (HTM) for Pytorch☆74Updated 3 years ago
- Pre-trained NFNets with 99% of the accuracy of the official paper "High-Performance Large-Scale Image Recognition Without Normalization".☆159Updated 4 years ago
- PyTorch Implementation of Contrastive Predictive Coding for image recognition, based on research papers https://arxiv.org/abs/1807.03748 …☆81Updated 5 years ago
- A library for evaluating representations.☆76Updated 3 years ago
- ☆66Updated 4 years ago
- Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities☆209Updated last year