Alternatives and similar repositories for Forward-Forward-Network

Users that are interested in Forward-Forward-Network are comparing it to the libraries listed below

• loeweX / Forward-Forward
  Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm
  ☆149Updated last year
• transformer-vq / transformer_vq
  ☆191Updated last year
• omihub777 / ViT-CIFAR
  PyTorch implementation for Vision Transformer[Dosovitskiy, A.(ICLR'21)] modified to obtain over 90% accuracy FROM SCRATCH on CIFAR-10 wit…
  ☆197Updated last year
• lucidrains / block-recurrent-transformer-pytorch
  Implementation of Block Recurrent Transformer - Pytorch
  ☆219Updated 10 months ago
• OpenNLPLab / Transnormer
  [EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer
  ☆60Updated last year
• Johswald / awesome-hypernetworks
  ☆63Updated 3 years ago
• HazyResearch / fly
  ☆208Updated 2 years ago
• lucidrains / soft-moe-pytorch
  Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch
  ☆299Updated 2 months ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆111Updated 5 months ago
• Noahs-ARK / RFA
  ☆33Updated 4 years ago
• epfml / dynamic-sparse-flash-attention
  ☆147Updated 2 years ago
• minyoungg / vqtorch
  ☆131Updated last year
• zhixuan-lin / forgetting-transformer
  [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"
  ☆108Updated last month
• OPTML-Group / DeepZero
  [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…
  ☆59Updated 8 months ago
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆52Updated 5 months ago
• jzhang38 / LongMamba
  Some preliminary explorations of Mamba's context scaling.
  ☆214Updated last year
• test-time-training / ttt-lm-kernels
  Inference Speed Benchmark for Learning to (Learn at Test Time): RNNs with Expressive Hidden States
  ☆67Updated 11 months ago
• facebookresearch / mega
  Sequence modeling with Mega.
  ☆296Updated 2 years ago
• lucidrains / Mega-pytorch
  Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena
  ☆204Updated last year
• omihub777 / MLP-Mixer-CIFAR
  PyTorch implementation of Mixer-nano (#parameters is 0.67M, originally Mixer-S/16 has 18M) with 90.83 % acc. on CIFAR-10. Training from s…
  ☆32Updated 3 years ago
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆59Updated 3 months ago
• berlino / gated_linear_attention
  ☆105Updated last year
• Cranial-XIX / FAMO
  Official PyTorch Implementation for Fast Adaptive Multitask Optimization (FAMO)
  ☆90Updated last year
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆86Updated 2 years ago
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆119Updated 8 months ago
• fedebotu / ICLR2023-OpenReviewData
  Crawl & Visualize ICLR 2023 Data from OpenReview
  ☆84Updated 2 years ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆124Updated last year
• lucidrains / recurrent-memory-transformer-pytorch
  Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch
  ☆409Updated 5 months ago
• weigq / iclr2022_stats
  ☆46Updated 2 years ago
• ischlag / fast-weight-transformers
  Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.
  ☆105Updated 4 years ago