dcmocanu / sparse-evolutionary-artificial-neural-networks
Always sparse. Never dense. But never say never. A Sparse Training repository for the Adaptive Sparse Connectivity concept and its algorithmic instantiation, i.e. Sparse Evolutionary Training, to boost Deep Learning scalability on various aspects (e.g. memory and computational time efficiency, representation and generalization power).
☆247Updated 3 years ago
Alternatives and similar repositories for sparse-evolutionary-artificial-neural-networks:
Users that are interested in sparse-evolutionary-artificial-neural-networks are comparing it to the libraries listed below
- ☆72Updated 5 years ago
- Neural Architecture Search with Bayesian Optimisation and Optimal Transport☆133Updated 6 years ago
- ☆182Updated 6 months ago
- Gradient based hyperparameter optimization & meta-learning package for TensorFlow☆188Updated 4 years ago
- Naszilla is a Python library for neural architecture search (NAS)☆306Updated 2 years ago
- End-to-end training of sparse deep neural networks with little-to-no performance loss.☆317Updated 2 years ago
- [IJCAI'19, NeurIPS'19] Anode: Unconditionally Accurate Memory-Efficient Gradients for Neural ODEs☆103Updated 4 years ago
- Code for "EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis" https://arxiv.org/abs/1905.05934☆112Updated 4 years ago
- ☆143Updated last year
- Experiments for the paper "Exponential expressivity in deep neural networks through transient chaos"☆70Updated 8 years ago
- ☆95Updated 5 years ago
- Discovering Neural Wirings (https://arxiv.org/abs/1906.00586)☆138Updated 5 years ago
- ☆222Updated 6 months ago
- Gradient based Hyperparameter Tuning library in PyTorch☆289Updated 4 years ago
- Code release for paper "Random Search and Reproducibility for NAS"☆167Updated 5 years ago
- ☆150Updated 4 years ago
- Guided Evolutionary Strategies☆268Updated last year
- ☆82Updated 5 years ago
- Sparse learning library and sparse momentum resources.☆379Updated 2 years ago
- Code for the paper "Training Binary Neural Networks with Bayesian Learning Rule☆38Updated 3 years ago
- A tutorial on "Bayesian Compression for Deep Learning" published at NIPS (2017).☆205Updated 6 years ago
- A collection of Deep Neuroevolution resources or evolutionary algorithms applying in Deep Learning (constantly updating)☆223Updated 3 years ago
- hessian in pytorch☆186Updated 4 years ago
- Sample implementation of Neural Ordinary Differential Equations☆260Updated 6 years ago
- Code for experiments in my blog post on the Neural Tangent Kernel: https://eigentales.com/NTK☆172Updated 5 years ago
- Implementing Bayes by Backprop☆183Updated 5 years ago
- Keras implementation of Legendre Memory Units☆212Updated 7 months ago
- [ICLR 2020] Drawing Early-Bird Tickets: Toward More Efficient Training of Deep Networks☆137Updated 4 years ago
- A small library implementing magnitude-based pruning in PyTorch☆28Updated 5 years ago
- Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)☆137Updated 5 years ago