Ads97 / ForwardForward

Related projects: ⓘ

• loeweX / Forward-Forward
  Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm
  ☆117Updated 10 months ago
• AllanYangZhou / universal_neural_functional
  ☆46Updated 7 months ago
• ago109 / predictive-forward-forward
  Implementation/simulation of the predictive forward-forward credit assignment algorithm for training neurobiologically-plausible recurren…
  ☆54Updated last year
• shikaiqiu / compute-better-spent
  ☆42Updated 3 months ago
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆40Updated last month
• louiskirsch / vsml-neurips2021
  Code for "Meta Learning Backpropagation And Improving It" @ NeurIPS 2021 https://arxiv.org/abs/2012.14905
  ☆31Updated 2 years ago
• smonsays / metax
  flexible meta-learning in jax
  ☆12Updated 11 months ago
• bhoov / energy-transformer-jax
  The Energy Transformer block, in JAX
  ☆48Updated 9 months ago
• radarFudan / mamba-minimal-jax
  ☆28Updated last week
• google-deepmind / spectral_ssm
  ☆25Updated 5 months ago
• Johswald / awesome-hypernetworks
  ☆55Updated 2 years ago
• sustcsonglin / mamba-triton
  ☆42Updated 7 months ago
• google-research / growneuron
  ☆52Updated last month
• enajx / HyperNCA
  ☆34Updated 2 years ago
• johnryan465 / pscan
  ☆33Updated 8 months ago
• mpezeshki / Epoch_wise_Double_Descent
  Official implementation of "Multi-scale Feature Learning Dynamics: Insights for Double Descent".
  ☆16Updated 2 years ago
• SamsungSAILMontreal / ghn3
  Code for "Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models?" [ICML 2023]
  ☆30Updated 3 weeks ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆57Updated 10 months ago
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆34Updated last year
• Trel725 / forward-forward
  A simple Python implementation of forward-forward NN training by G. Hinton from NeurIPS 2022
  ☆20Updated last year
• mechanistic-interpretability-grokking / progress-measures-paper
  ☆50Updated last year
• tobiaskatsch / GatedLinearRNN
  ☆23Updated 6 months ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆77Updated last year
• orobix / fwdgrad
  Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
  ☆94Updated last year
• facebookresearch / projUNN
  Fast training of unitary deep network layers from low-rank updates
  ☆28Updated last year
• jysohn1108 / Looped-Transformer
  Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…
  ☆21Updated last year
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆129Updated 2 months ago
• lucidrains / pause-transformer
  Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…
  ☆50Updated 10 months ago
• VITA-Group / SMC-Bench
  [ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen…
  ☆27Updated last year
• Doraemonzzz / hgru2-pytorch
  ☆19Updated last month