lucidrains / glom-pytorch
An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts from neural fields, top-down-bottom-up processing, and attention (consensus between columns), for emergent part-whole heirarchies from data
☆193Updated 3 years ago
Alternatives and similar repositories for glom-pytorch:
Users that are interested in glom-pytorch are comparing it to the libraries listed below
- An implementation of 2021 paper by Geoffrey Hinton: "How to represent part-whole hierarchies in a neural network" in Pytorch.☆57Updated 3 years ago
- Self-supervised learning through the eyes of a child☆139Updated 3 years ago
- Implementation of Feedback Transformer in Pytorch☆105Updated 3 years ago
- Implementation of Slot Attention from GoogleAI☆405Updated 4 months ago
- Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.☆101Updated 3 years ago
- Official PyTorch implementation of the paper "Self-Supervised Relational Reasoning for Representation Learning", NeurIPS 2020 Spotlight.☆142Updated 8 months ago
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆125Updated 2 years ago
- Understanding Training Dynamics of Deep ReLU Networks☆284Updated 2 months ago
- Memory efficient MAML using gradient checkpointing☆83Updated 5 years ago
- Official codebase for Pretrained Transformers as Universal Computation Engines.☆245Updated 3 years ago
- A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network☆128Updated 3 years ago
- Benchmark for Lifelong learning research☆118Updated 3 years ago
- Code for the paper "Contrastive Learning Inverts the Data Generating Process".☆89Updated 5 months ago
- Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities☆209Updated 8 months ago
- Official implementation of the paper "Topographic VAEs learn Equivariant Capsules"☆79Updated 2 years ago
- VICRegL official code base☆224Updated last year
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆124Updated 2 years ago
- NeurIPS 2020, Debiased Contrastive Learning☆282Updated last year
- A PyTorch converter for SimCLR checkpoints☆107Updated 3 years ago
- A GPT, made only of MLPs, in Jax☆57Updated 3 years ago
- Meta-Learning with Warped Gradient Descent☆93Updated 3 years ago
- Whitening for Self-Supervised Representation Learning | Official repository☆130Updated last year
- 🧀 Pytorch code for the Fromage optimiser.☆122Updated 6 months ago
- An essential implementation of BYOL in PyTorch + PyTorch Lightning☆51Updated 3 years ago
- FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.☆202Updated last year
- CATER: A diagnostic dataset for Compositional Actions and TEmporal Reasoning☆103Updated 4 years ago
- ☆92Updated 4 years ago
- Project site for "Your Classifier is Secretly an Energy-Based Model and You Should Treat it Like One"☆418Updated 2 years ago
- Implementation of Barlow Twins paper☆99Updated 2 years ago
- ☆47Updated 2 years ago