Alternatives and similar repositories for CaFo:

Users that are interested in CaFo are comparing it to the libraries listed below

• JacksonWuxs / Forward-Forward-Network
  Implementation of Forward Forward Network proposed by Hinton in NIPS 2022.
  ☆167Updated 2 years ago
• ghadialhajj / FF_unsupervised
  An implementation of unsupervised example of the Forward-Forward algorithm proposed by (Hinton, 2022)
  ☆10Updated 9 months ago
• berlino / gated_linear_attention
  ☆102Updated last year
• themrzmaster / git-re-basin-pytorch
  Git Re-Basin: Merging Models modulo Permutation Symmetries in PyTorch
  ☆75Updated 2 years ago
• oripress / EntropyEnigma
  Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"
  ☆49Updated 10 months ago
• AllanYangZhou / universal_neural_functional
  ☆49Updated last year
• lucidrains / soft-moe-pytorch
  Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch
  ☆271Updated 11 months ago
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆185Updated 3 weeks ago
• carloalbertobarbano / forward-forward-pytorch
  PyTorch implementation of Hinton's FF Algorithm with hard negatives sampling
  ☆14Updated 2 years ago
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆44Updated last year
• shoaibahmed / blockwise_ssl
  Repository containing code for blockwise SSL training
  ☆28Updated 5 months ago
• orobix / fwdgrad
  Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
  ☆108Updated last year
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆98Updated last year
• TsinghuaC3I / SoRA
  [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆72Updated last year
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆110Updated 2 months ago
• KellerJordan / cifar10-airbench
  CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds
  ☆221Updated 3 weeks ago
• test-time-training / ttt-lm-kernels
  Inference Speed Benchmark for Learning to (Learn at Test Time): RNNs with Expressive Hidden States
  ☆64Updated 8 months ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆53Updated 7 months ago
• bfshi / TOAST
  Official code for "TOAST: Transfer Learning via Attention Steering"
  ☆189Updated last year
• BorealisAI / flora-opt
  This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.
  ☆102Updated 8 months ago
• minyoungg / LTE
  ☆67Updated 8 months ago
• jzhang38 / LongMamba
  Some preliminary explorations of Mamba's context scaling.
  ☆212Updated last year
• bwconrad / soft-moe
  PyTorch implementation of "From Sparse to Soft Mixtures of Experts"
  ☆53Updated last year
• huyphan168 / PEER
  Mixture of A Million Experts
  ☆42Updated 7 months ago
• facebookresearch / RCDM
  Visualizing representations with diffusion based conditional generative model.
  ☆91Updated last year
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆35Updated 2 years ago
• UNITES-Lab / moe-quantization
  Official code for the paper "Examining Post-Training Quantization for Mixture-of-Experts: A Benchmark"
  ☆13Updated 9 months ago
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆150Updated last year
• tml-epfl / sam-low-rank-features
  Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]
  ☆28Updated last year
• pbelcak / fastfeedforward
  A repository for log-time feedforward networks
  ☆220Updated 11 months ago