JacksonWuxs / Forward-Forward-NetworkLinks
Implementation of Forward Forward Network proposed by Hinton in NIPS 2022.
☆169Updated 2 years ago
Alternatives and similar repositories for Forward-Forward-Network
Users that are interested in Forward-Forward-Network are comparing it to the libraries listed below
Sorting:
- Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch☆309Updated 4 months ago
- ☆196Updated last year
- ☆65Updated 3 years ago
- Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch☆353Updated last year
- ☆136Updated last year
- ☆106Updated last year
- [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling☆86Updated 2 years ago
- Crawl & Visualize ICLR 2023 Data from OpenReview☆84Updated 2 years ago
- Crawl & visualize ICLR papers and reviews☆110Updated 2 years ago
- ICLR 2023 Paper submission analysis from https://openreview.net/group?id=ICLR.cc/2023/Conference☆105Updated 2 years ago
- ☆33Updated 4 years ago
- Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm☆154Updated last year
- PyTorch implementation of "From Sparse to Soft Mixtures of Experts"☆60Updated last year
- Implementation of Infini-Transformer in Pytorch☆110Updated 7 months ago
- ICLR2023 statistics☆60Updated last year
- PyTorch implementation of LIMoE☆53Updated last year
- Code for "Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models?" [ICML 2023]☆36Updated 11 months ago
- [EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer☆61Updated 2 years ago
- PyTorch repository for ICLR 2022 paper (GSAM) which improves generalization (e.g. +3.8% top-1 accuracy on ImageNet with ViT-B/32)☆144Updated 2 years ago
- ☆21Updated 2 years ago
- OpenReivew Submission Visualization (ICLR 2024/2025)☆151Updated 9 months ago
- The official PyTorch implementation of the paper: Xili Dai, Shengbang Tong, et al. "Closed-Loop Data Transcription to an LDR via Minimaxi…☆63Updated 2 years ago
- Official PyTorch Implementation for Fast Adaptive Multitask Optimization (FAMO)☆94Updated last year
- Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch☆413Updated 7 months ago
- [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)☆123Updated last year
- Implementation of Beyond Neural Scaling beating power laws for deep models and prototype-based models☆34Updated 2 weeks ago
- Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"☆368Updated last year
- Implementation of Block Recurrent Transformer - Pytorch☆221Updated 11 months ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆61Updated 5 months ago
- A repository for DenseSSMs☆88Updated last year