Alternatives and similar repositories for Forward-Forward

Users that are interested in Forward-Forward are comparing it to the libraries listed below

• sap-ient-ai / FFF
  FastFeedForward Networks
  ☆20Updated last year
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆50Updated last year
• benja263 / Integer-Only-Inference-for-Deep-Learning-in-Native-C
  Converting a deep neural network to integer-only inference in native C via uniform quantization and the fixed-point representation.
  ☆25Updated 3 years ago
• AranKomat / Alpha-Transformer
  Alpha Zero equipped with Transformer with various novel techniques for speedup in tree search
  ☆27Updated 6 years ago
• orobix / fwdgrad
  Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
  ☆110Updated 2 years ago
• AlarioAI / bitnet
  Train and evaluate 1.58 bits Neural Networks
  ☆26Updated last year
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆110Updated last year
• NX-AI / mlstm_kernels
  Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.
  ☆67Updated 2 weeks ago
• davidar / eigenGPT
  Minimal C++ implementation of GPT2
  ☆40Updated 2 years ago
• Entropy-xcy / bitnet158
  ☆69Updated last year
• GATECH-EIC / SuperTickets
  [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning
  ☆21Updated 3 years ago
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆191Updated last year
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆121Updated last year
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆33Updated 11 months ago
• proger / hippogriff
  Griffin MQA + Hawk Linear RNN Hybrid
  ☆88Updated last year
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆109Updated 9 months ago
• schneiderkamplab / bitlinear
  BitLinear implementation
  ☆33Updated 8 months ago
• satabios / sconce
  E2E AutoML Model Compression Package
  ☆45Updated 5 months ago
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆72Updated last year
• Trel725 / forward-forward
  A simple Python implementation of forward-forward NN training by G. Hinton from NeurIPS 2022
  ☆21Updated 2 years ago
• LucasPrietoAl / grokking-at-the-edge-of-numerical-stability
  ☆100Updated 2 weeks ago
• erendn / pytorch-compression-for-mcu
  Deep Compression for PyTorch Model Deployment on Microcontrollers
  ☆19Updated 4 years ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆46Updated last year
• ago109 / predictive-forward-forward
  Implementation/simulation of the predictive forward-forward credit assignment algorithm for training neurobiologically-plausible recurren…
  ☆60Updated 2 years ago
• kyegomez / MultiQueryAttention
  This is a simple torch implementation of the high performance Multi-Query Attention
  ☆16Updated last year
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆38Updated last year
• staghado / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆291Updated last year
• facebookresearch / Ternary_Binary_Transformer
  ACL 2023
  ☆39Updated 2 years ago
• Oxen-AI / mamba-dive
  This is the code that went into our practical dive using mamba as information extraction
  ☆53Updated last year
• ruslangrimov / mnist-minimal-model
  Trying to find out what is the minimal model that can achieve 99% accuracy on MNIST dataset
  ☆26Updated 6 years ago