cozheyuanzhangde / Forward-ForwardLinks
Hinton's Forward-Forward Algorithm for Deep Learning
☆10Updated 2 years ago
Alternatives and similar repositories for Forward-Forward
Users that are interested in Forward-Forward are comparing it to the libraries listed below
Sorting:
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆121Updated last year
- Deep Compression for PyTorch Model Deployment on Microcontrollers☆19Updated 4 years ago
- RWKV in nanoGPT style☆193Updated last year
- Train and evaluate 1.58 bits Neural Networks☆26Updated last month
- FastFeedForward Networks☆19Updated last year
- Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch☆113Updated 2 years ago
- PyTorch Lightning implementation of the paper Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and H…☆32Updated 10 months ago
- Implementation/simulation of the predictive forward-forward credit assignment algorithm for training neurobiologically-plausible recurren…☆60Updated 2 years ago
- In this repository, we explore model compression for transformer architectures via quantization. We specifically explore quantization awa…☆24Updated 4 years ago
- Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm☆157Updated last year
- This is the code that went into our practical dive using mamba as information extraction☆56Updated last year
- Converting a deep neural network to integer-only inference in native C via uniform quantization and the fixed-point representation.☆26Updated 3 years ago
- Implemented here a Binary Neural Network (BNN) achieving nearly state-of-art results but recorded a significant reduction in memory usage…☆74Updated 4 years ago
- ☆128Updated 3 months ago
- Implementation of GateLoop Transformer in Pytorch and Jax☆90Updated last year
- E2E AutoML Model Compression Package☆46Updated 7 months ago
- FlashRNN - Fast RNN Kernels with I/O Awareness☆103Updated 3 weeks ago
- The official, proof-of-concept C++ implementation of PocketNN.☆35Updated last month
- Alpha Zero equipped with Transformer with various novel techniques for speedup in tree search☆27Updated 6 years ago
- [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning☆20Updated 3 years ago
- Context Manager to profile the forward and backward times of PyTorch's nn.Module☆82Updated 2 years ago
- ☆69Updated last year
- ☆54Updated 3 years ago
- Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs☆110Updated last year
- A repository for log-time feedforward networks☆222Updated last year
- Minimal C++ implementation of GPT2☆40Updated 2 years ago
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆91Updated 2 years ago
- Code repo for the paper BiT Robustly Binarized Multi-distilled Transformer☆112Updated 2 years ago
- ☆59Updated last year
- Make triton easier☆48Updated last year