lightonai / principled-dfa-trainingLinks
Code for our paper on best practices to train neural networks with direct feedback alignment (DFA).
☆21Updated 6 years ago
Alternatives and similar repositories for principled-dfa-training
Users that are interested in principled-dfa-training are comparing it to the libraries listed below
Sorting:
- Demo: Slightly More Bio-Plausible Backprop☆21Updated 8 years ago
- PyTorch-based code for training fully-connected and convolutional networks using backpropagation (BP), feedback alignment (FA), direct fe…☆65Updated 4 years ago
- Study on the applicability of Direct Feedback Alignment to neural view synthesis, recommender systems, geometric learning, and natural la…☆88Updated 3 years ago
- ML benchmarks performance featuring LightOn's Optical Processing Unit (OPU) vs CPU and GPU.☆22Updated last year
- Proximal Mean-field for Neural Network Quantization☆22Updated 5 years ago
- Implementation for the paper "Latent Weights Do Not Exist: Rethinking Binarized Neural Network Optimization"☆74Updated 5 years ago
- Butterfly matrix multiplication in PyTorch☆172Updated last year
- Code for the paper "Training Binary Neural Networks with Bayesian Learning Rule☆39Updated 3 years ago
- Optical Transfer Learning☆27Updated last year
- This repository contains the code for our recent paper `Minimal Random Code Learning: Getting Bits Back from Compressed Model Parameters'☆21Updated 6 years ago
- Python implementation of supervised PCA, supervised random projections, and their kernel counterparts.☆19Updated 5 years ago
- Conformational exploration SARS-CoV-2 (coronavirus responsible for COVID-19)☆16Updated 3 years ago
- Experiments with Direct Feedback Alignment training scheme for DNNs☆32Updated 8 years ago
- Identify a binary weight or binary weight and activation subnetwork within a randomly initialized network by only pruning and binarizing …☆52Updated 3 years ago
- Python library for running large-scale computations on LightOn's OPUs☆36Updated 3 years ago
- Successfully training approximations to full-rank matrices for efficiency in deep learning.☆17Updated 4 years ago
- Factorized Neural Layers☆29Updated 2 years ago
- ☆47Updated 5 years ago
- Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".☆62Updated 6 years ago
- [ICLR 2021 Spotlight] "CPT: Efficient Deep Neural Network Training via Cyclic Precision" by Yonggan Fu, Han Guo, Meng Li, Xin Yang, Yinin…☆31Updated last year
- Deep learning with a multiplication budget☆47Updated 7 years ago
- DeepHoyer: Learning Sparser Neural Network with Differentiable Scale-Invariant Sparsity Measures☆33Updated 4 years ago
- Pruning methods for pytorch with an optimizer-like interface☆15Updated 5 years ago
- This repository provides code source used in the paper: A Mean Field Theory of Quantized Deep Networks: The Quantization-Depth Trade-Off☆13Updated 6 years ago
- Implementation of BinaryConnect on Pytorch☆39Updated 4 years ago
- Band-limited Training and Inference for Convolutional Neural Networks☆20Updated 2 years ago
- Implemented here a Binary Neural Network (BNN) achieving nearly state-of-art results but recorded a significant reduction in memory usage…☆74Updated 4 years ago
- Double Descent Curve with Optical Random Features☆29Updated 3 years ago
- This repository implements the paper "Effective Training of Convolutional Neural Networks with Low-bitwidth Weights and Activations"☆20Updated 3 years ago
- XNOR-Net, with binary gemm and binary conv2d kernels, support both CPU and GPU.☆85Updated 6 years ago