Alternatives and similar repositories for forward-forward

Users that are interested in forward-forward are comparing it to the libraries listed below

• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆40Updated 2 years ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆59Updated 2 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆81Updated 2 years ago
• jiaweizzhao / ZerO-initialization
  ☆75Updated 3 years ago
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆51Updated 2 years ago
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆83Updated 3 years ago
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated 2 years ago
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆37Updated 3 years ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆63Updated 4 years ago
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 3 years ago
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆79Updated 3 years ago
• rovle / gpt3-in-context-fitting
  Experiments on GPT-3's ability to fit numerical models in-context.
  ☆14Updated 3 years ago
• srush / do-we-need-attention
  ☆167Updated 2 years ago
• guy-dar / embedding-space
  ☆56Updated 2 years ago
• varunnair18 / FISH
  Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).
  ☆59Updated 4 years ago
• loeweX / Forward-Forward
  Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm
  ☆162Updated 2 years ago
• carloalbertobarbano / forward-forward-pytorch
  PyTorch implementation of Hinton's FF Algorithm with hard negatives sampling
  ☆15Updated 3 years ago
• google-research / jax-influence
  ☆63Updated 4 years ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated 2 years ago
• lucidrains / ponder-transformer
  Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper
  ☆81Updated 4 years ago
• RobertCsordas / modules
  The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We…
  ☆46Updated 2 years ago
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆35Updated 3 years ago
• maximzubkov / fft-scan
  Efficient PScan implementation in PyTorch
  ☆17Updated 2 years ago
• princeton-nlp / TransformerPrograms
  [NeurIPS 2023] Learning Transformer Programs
  ☆162Updated last year
• MadryLab / modeldiff
  ModelDiff: A Framework for Comparing Learning Algorithms
  ☆58Updated 2 years ago
• fjzzq2002 / random_transformers
  Official code for "Algorithmic Capabilities of Random Transformers" (NeurIPS 2024)
  ☆16Updated last year
• lucidrains / pause-transformer
  Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…
  ☆53Updated 2 years ago
• srush / mamba-scans
  Blog post
  ☆17Updated last year
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆92Updated 2 years ago
• automl / zero-shot-automl-with-pretrained-models
  Official repository for the paper "Zero-Shot AutoML with Pretrained Models"
  ☆48Updated 2 years ago