Alternatives and similar repositories for CaFo

Users that are interested in CaFo are comparing it to the libraries listed below

• carloalbertobarbano / forward-forward-pytorch
  PyTorch implementation of Hinton's FF Algorithm with hard negatives sampling
  ☆14Updated 2 years ago
• JacksonWuxs / Forward-Forward-Network
  Implementation of Forward Forward Network proposed by Hinton in NIPS 2022.
  ☆169Updated 2 years ago
• SamsungSAILMontreal / ghn3
  Code for "Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models?" [ICML 2023]
  ☆32Updated 8 months ago
• oripress / EntropyEnigma
  Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"
  ☆51Updated 11 months ago
• themrzmaster / git-re-basin-pytorch
  Git Re-Basin: Merging Models modulo Permutation Symmetries in PyTorch
  ☆75Updated 2 years ago
• KellerJordan / REPAIR
  Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair
  ☆47Updated last year
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆36Updated 2 years ago
• TrentBrick / SDMContinualLearner
  ☆17Updated 2 years ago
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆101Updated last year
• amassivek / signalpropagation
  Forward Pass Learning and Inference Library, for neural networks and general intelligence, Signal Propagation (sigprop)
  ☆52Updated 2 years ago
• Ads97 / ForwardForward
  Explorations with Geoffrey Hinton's Forward Forward algoithm
  ☆33Updated last year
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆92Updated 7 months ago
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆160Updated last year
• minyoungg / LTE
  ☆68Updated 10 months ago
• aim-uofa / LoRAPrune
  ☆50Updated 4 months ago
• ghadialhajj / FF_unsupervised
  An implementation of unsupervised example of the Forward-Forward algorithm proposed by (Hinton, 2022)
  ☆11Updated 10 months ago
• bfshi / TOAST
  Official code for "TOAST: Transfer Learning via Attention Steering"
  ☆189Updated last year
• loeweX / Forward-Forward
  Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm
  ☆148Updated last year
• AngusDujw / SAF
  ☆35Updated 2 years ago
• MohammadrezaBanaei / LoRA-XS
  LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
  ☆33Updated 2 months ago
• ago109 / predictive-forward-forward
  Implementation/simulation of the predictive forward-forward credit assignment algorithm for training neurobiologically-plausible recurren…
  ☆57Updated 2 years ago
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆71Updated last year
• bwconrad / soft-moe
  PyTorch implementation of "From Sparse to Soft Mixtures of Experts"
  ☆56Updated last year
• TianjinYellow / SPAM-Optimizer
  ☆28Updated 2 months ago
• ml-research / self-expanding-neural-networks
  Self-Expanding Neural Networks
  ☆39Updated last year
• TsinghuaC3I / SoRA
  [EMNLP 2023, Main Conference] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆76Updated last year
• BorealisAI / flora-opt
  This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.
  ☆104Updated 10 months ago
• shoaibahmed / blockwise_ssl
  Repository containing code for blockwise SSL training
  ☆29Updated 7 months ago
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆28Updated 11 months ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆114Updated this week