dcmocanu / sparse-evolutionary-artificial-neural-networks
Always sparse. Never dense. But never say never. A Sparse Training repository for the Adaptive Sparse Connectivity concept and its algorithmic instantiation, i.e. Sparse Evolutionary Training, to boost Deep Learning scalability on various aspects (e.g. memory and computational time efficiency, representation and generalization power).
☆247Updated 3 years ago
Alternatives and similar repositories for sparse-evolutionary-artificial-neural-networks:
Users that are interested in sparse-evolutionary-artificial-neural-networks are comparing it to the libraries listed below
- ☆71Updated 4 years ago
- Neural Architecture Search with Bayesian Optimisation and Optimal Transport☆133Updated 5 years ago
- Code for Neural Architecture Search without Training (ICML 2021)☆462Updated 3 years ago
- ☆182Updated 5 months ago
- Deep Neural Networks Entropy from Replicas☆32Updated 5 years ago
- ☆143Updated last year
- End-to-end training of sparse deep neural networks with little-to-no performance loss.☆317Updated last year
- demonstration of the information bottleneck theory for deep learning☆60Updated 7 years ago
- A collection of Deep Neuroevolution resources or evolutionary algorithms applying in Deep Learning (constantly updating)☆222Updated 3 years ago
- ☆150Updated 4 years ago
- Keras implementation of Legendre Memory Units☆211Updated 6 months ago
- Guided Evolutionary Strategies☆268Updated last year
- Naszilla is a Python library for neural architecture search (NAS)☆306Updated 2 years ago
- Discovering Neural Wirings (https://arxiv.org/abs/1906.00586)☆138Updated 4 years ago
- Experiments for the paper "Exponential expressivity in deep neural networks through transient chaos"☆70Updated 8 years ago
- ☆222Updated 5 months ago
- An implementation of KFAC for TensorFlow☆198Updated 2 years ago
- Sparse learning library and sparse momentum resources.☆379Updated 2 years ago
- paper lists and information on mean-field theory of deep learning☆75Updated 5 years ago
- ☆94Updated 5 years ago
- PyTorch-based code for training fully-connected and convolutional networks using backpropagation (BP), feedback alignment (FA), direct fe…☆64Updated 3 years ago
- Gradient based hyperparameter optimization & meta-learning package for TensorFlow☆188Updated 4 years ago
- Implementing Bayes by Backprop☆183Updated 5 years ago
- ☆67Updated 5 years ago
- Convolutional Neural Tangent Kernel☆109Updated 5 years ago
- Adaptive Neural Trees☆151Updated 5 years ago
- Evolution Strategy Library☆55Updated 4 years ago
- A tutorial on "Bayesian Compression for Deep Learning" published at NIPS (2017).☆205Updated 6 years ago
- Experiments with spiking neural networks (SNNs) in PyTorch. See https://github.com/BINDS-LAB-UMASS/bindsnet for the successor to this pro…☆90Updated 6 years ago
- Hypergradient descent☆143Updated 7 months ago