Trel725 / forward-forward

Related projects ⓘ

Alternatives and complementary repositories for forward-forward

• carloalbertobarbano / forward-forward-pytorch
  PyTorch implementation of Hinton's FF Algorithm with hard negatives sampling
  ☆14Updated last year
• berlino / seq_icl
  ☆50Updated 6 months ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆57Updated last year
• jiaweizzhao / ZerO-initialization
  ☆73Updated 2 years ago
• IDSIA / recurrent-fwp
  Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)
  ☆47Updated last year
• Leiay / looped_transformer
  ☆20Updated 11 months ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆24Updated 7 months ago
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆44Updated last year
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆63Updated 2 years ago
• radarFudan / mamba-minimal-jax
  ☆29Updated 2 months ago
• sustcsonglin / mamba-triton
  ☆45Updated 9 months ago
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆36Updated 2 years ago
• xu-ji / information-bottleneck
  Deep Learning & Information Bottleneck
  ☆50Updated last year
• Johswald / awesome-hypernetworks
  ☆58Updated 2 years ago
• oripress / EntropyEnigma
  Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"
  ☆44Updated 5 months ago
• smonsays / contrastive-meta-learning
  Code accompanying the paper "A contrastive rule for meta-learning"
  ☆11Updated 3 weeks ago
• loeweX / Forward-Forward
  Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm
  ☆132Updated last year
• RobertCsordas / modules
  The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We…
  ☆46Updated last year
• abaheti95 / LoL-RL
  Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients
  ☆26Updated 2 months ago
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆34Updated last year
• AndyShih12 / LongHorizonTemperatureScaling
  PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023
  ☆19Updated last year
• jysohn1108 / Looped-Transformer
  Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…
  ☆22Updated last year
• srush / mamba-primer
  ☆35Updated 7 months ago
• twitter-research / hyperbolic-rl
  ☆56Updated 2 years ago
• google-deepmind / emergent_in_context_learning
  ☆77Updated 3 months ago
• tristandeleu / jax-meta-learning
  A collection of meta-learning algorithms in Jax
  ☆23Updated 2 years ago
• YannDubs / Invariant-Self-Supervised-Learning
  Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"
  ☆40Updated last year
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆66Updated last year