Alternatives and similar repositories for Forward-Forward-Network:

Users that are interested in Forward-Forward-Network are comparing it to the libraries listed below

• Johswald / awesome-hypernetworks
  ☆59Updated 3 years ago
• lucidrains / soft-moe-pytorch
  Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch
  ☆257Updated 9 months ago
• minyoungg / vqtorch
  ☆123Updated 11 months ago
• loeweX / Forward-Forward
  Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm
  ☆138Updated last year
• transformer-vq / transformer_vq
  ☆186Updated last year
• berlino / gated_linear_attention
  ☆98Updated 10 months ago
• carloalbertobarbano / forward-forward-pytorch
  PyTorch implementation of Hinton's FF Algorithm with hard negatives sampling
  ☆14Updated 2 years ago
• lucidrains / block-recurrent-transformer-pytorch
  Implementation of Block Recurrent Transformer - Pytorch
  ☆217Updated 5 months ago
• dtsip / in-context-learning
  ☆211Updated 8 months ago
• google-deepmind / emergent_in_context_learning
  ☆80Updated 6 months ago
• lucidrains / recurrent-memory-transformer-pytorch
  Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch
  ☆403Updated 3 weeks ago
• amassivek / signalpropagation
  Forward Pass Learning and Inference Library, for neural networks and general intelligence, Signal Propagation (sigprop)
  ☆48Updated last year
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆138Updated 10 months ago
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆113Updated 3 months ago
• bwconrad / soft-moe
  PyTorch implementation of "From Sparse to Soft Mixtures of Experts"
  ☆50Updated last year
• booydar / LM-RMT
  Recurrent Memory Transformer
  ☆148Updated last year
• TsinghuaC3I / SoRA
  [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆70Updated 10 months ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆121Updated last year
• lucidrains / st-moe-pytorch
  Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch
  ☆299Updated 7 months ago
• test-time-training / ttt-lm-kernels
  Inference Speed Benchmark for Learning to (Learn at Test Time): RNNs with Expressive Hidden States
  ☆54Updated 6 months ago
• OpenNLPLab / Transnormer
  [EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer
  ☆59Updated last year
• HazyResearch / fly
  ☆200Updated last year
• gregorbachmann / Next-Token-Failures
  ☆78Updated 10 months ago
• locuslab / edge-of-stability
  ☆63Updated last month
• lucidrains / gated-state-spaces-pytorch
  Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
  ☆97Updated last year
• shibhansh / loss-of-plasticity
  Demonstrations of Loss of Plasticity and Implementation of Continual Backpropagation
  ☆257Updated 2 months ago
• epfml / dynamic-sparse-flash-attention
  ☆136Updated last year
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆89Updated 4 months ago
• cjyaras / deep-lora-transformers
  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)
  ☆13Updated 6 months ago
• srush / do-we-need-attention
  ☆164Updated last year