An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts from neural fields, top-down-bottom-up processing, and attention (consensus between columns), for emergent part-whole heirarchies from data
☆196Mar 27, 2021Updated 4 years ago
Alternatives and similar repositories for glom-pytorch
Users that are interested in glom-pytorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An implementation of 2021 paper by Geoffrey Hinton: "How to represent part-whole hierarchies in a neural network" in Pytorch.☆57Mar 29, 2021Updated 4 years ago
- An open source implementation of CLIP.☆33Nov 7, 2022Updated 3 years ago
- PyTorch implementation of GLOM☆23Apr 1, 2022Updated 3 years ago
- Contrastive Language-Image Pretraining☆144Sep 6, 2022Updated 3 years ago
- ☆21Mar 15, 2023Updated 3 years ago
- ☆27Mar 13, 2021Updated 5 years ago
- Refactoring dalle-pytorch and taming-transformers for TPU VM☆60Aug 30, 2021Updated 4 years ago
- Implementation of Discrete Key / Value Bottleneck, in Pytorch☆88Jul 9, 2023Updated 2 years ago
- Implementation of the GLOM model for text☆11Mar 4, 2021Updated 5 years ago
- Official implementation of the paper Visual Parser: Representing Part-whole Hierarchies with Transformers☆121Aug 12, 2021Updated 4 years ago
- Implementation of the DDPM + IPA (invariant point attention) for protein generation, as outlined in the paper "Protein Structure and Sequ…☆89Jul 25, 2022Updated 3 years ago
- Code for reproducing the experiments on large-scale pre-training and transfer learning for the paper "Effect of large-scale pre-training …☆19May 29, 2022Updated 3 years ago
- Graph neural network message passing reframed as a Transformer with local attention☆70Dec 24, 2022Updated 3 years ago
- ☆22May 3, 2022Updated 3 years ago
- JAX implementation ViT-VQGAN☆82Sep 21, 2022Updated 3 years ago
- Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch☆430Aug 14, 2021Updated 4 years ago
- Implementation of a holodeck, written in Pytorch☆18Nov 1, 2023Updated 2 years ago
- Visual search interface☆11Nov 30, 2021Updated 4 years ago
- Python Research Framework☆107Nov 3, 2022Updated 3 years ago
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆132Aug 6, 2022Updated 3 years ago
- Hopfield Networks is All You Need☆1,907Apr 23, 2023Updated 2 years ago
- ☆30Nov 25, 2021Updated 4 years ago
- ☆20Aug 19, 2021Updated 4 years ago
- A simple wrapper library for binding timm models as detectron2 backbones☆44May 31, 2023Updated 2 years ago
- Implementation of a Transformer, but completely in Triton☆279Apr 5, 2022Updated 3 years ago
- [NeurIPS'20] Code for the Paper Compositional Visual Generation and Inference with Energy Based Models☆47Mar 24, 2023Updated 3 years ago
- Exemplar VAE: Linking Generative Models, Nearest Neighbor Retrieval, and Data Augmentation☆69Dec 9, 2020Updated 5 years ago
- EfficientNet, MobileNetV3, MobileNetV2, MixNet, etc in JAX w/ Flax Linen and Objax☆130Jan 4, 2024Updated 2 years ago
- When Dall E was a baby trained on a bit of data☆27Feb 26, 2021Updated 5 years ago
- MOCA: Self-supervised Representation Learning by Predicting Masked Online Codebook Assignments☆13Jul 8, 2024Updated last year
- Minimum viable code for the Decodable Information Bottleneck paper. Pytorch Implementation.☆11Oct 20, 2020Updated 5 years ago
- Pytorch implementation of Compressive Transformers, from Deepmind☆163Oct 4, 2021Updated 4 years ago
- Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.☆147Jul 26, 2021Updated 4 years ago
- Implementation of popular SOTA self-supervised learning algorithms as Fastai Callbacks.☆327Apr 12, 2023Updated 2 years ago
- Code repository for the ICLR 2022 paper "FlexConv: Continuous Kernel Convolutions With Differentiable Kernel Sizes" https://openreview.ne…☆116Nov 30, 2022Updated 3 years ago
- Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena☆207Aug 26, 2023Updated 2 years ago
- Code accompanying paper "Fine-Grained Visual Entailment" [ECCV 2022].☆11Oct 31, 2022Updated 3 years ago
- ☆12Mar 16, 2022Updated 4 years ago
- Reconstruction ICA☆10Aug 25, 2017Updated 8 years ago