Alternatives and similar repositories for Forward-Forward

Users that are interested in Forward-Forward are comparing it to the libraries listed below

• erendn / pytorch-compression-for-mcu
  Deep Compression for PyTorch Model Deployment on Microcontrollers
  ☆19Updated 4 years ago
• ciodar / deep-compression
  PyTorch Lightning implementation of the paper Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and H…
  ☆35Updated last year
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆197Updated last year
• GreenWaves-Technologies / bfloat16
  bfloat16 dtype for numpy
  ☆20Updated 2 years ago
• Entropy-xcy / bitnet158
  ☆70Updated last year
• carloalbertobarbano / forward-forward-pytorch
  PyTorch implementation of Hinton's FF Algorithm with hard negatives sampling
  ☆15Updated 3 years ago
• orobix / fwdgrad
  Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
  ☆114Updated 2 years ago
• pulp-platform / pulp-transformer
  Optimizing the Deployment of Tiny Transformers on Low-Power MCUs
  ☆30Updated last year
• jaewoosong / pocketnn
  The official, proof-of-concept C++ implementation of PocketNN.
  ☆36Updated 4 months ago
• jacobfa / fft
  ☆129Updated 5 months ago
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆122Updated last year
• clabrugere / scratch-llm
  Implements a LLM similar to Meta's Llama 2 from the ground up in PyTorch, for educational purposes.
  ☆38Updated 11 months ago
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆73Updated last year
• satabios / sconce
  E2E AutoML Model Compression Package
  ☆45Updated 10 months ago
• amassivek / signalpropagation
  Forward Pass Learning and Inference Library, for neural networks and general intelligence, Signal Propagation (sigprop)
  ☆54Updated 2 years ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆46Updated last year
• ago109 / predictive-forward-forward
  Implementation/simulation of the predictive forward-forward credit assignment algorithm for training neurobiologically-plausible recurren…
  ☆64Updated 2 years ago
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆112Updated last year
• Oxen-AI / mamba-dive
  This is the code that went into our practical dive using mamba as information extraction
  ☆57Updated 2 years ago
• loeweX / Forward-Forward
  Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm
  ☆162Updated 2 years ago
• iml130 / nncg
  NNCG: A Neural Network Code Generator
  ☆36Updated last year
• kroggen / mamba.c
  Inference of Mamba and Mamba2 models in pure C
  ☆196Updated last week
• benja263 / Integer-Only-Inference-for-Deep-Learning-in-Native-C
  Converting a deep neural network to integer-only inference in native C via uniform quantization and the fixed-point representation.
  ☆26Updated 4 years ago
• UmerHA / triton_util
  Make triton easier
  ☆50Updated last year
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆110Updated 2 years ago
• kjslag / spacebyte
  A byte-level decoder architecture that matches the performance of tokenized Transformers.
  ☆67Updated last year
• NX-AI / flashrnn
  FlashRNN - Fast RNN Kernels with I/O Awareness
  ☆174Updated 3 months ago
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆157Updated 2 years ago
• facebookresearch / bit
  Code repo for the paper BiT Robustly Binarized Multi-distilled Transformer
  ☆114Updated 2 years ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago