Always sparse. Never dense. But never say never. A Sparse Training repository for the Adaptive Sparse Connectivity concept and its algorithmic instantiation, i.e. Sparse Evolutionary Training, to boost Deep Learning scalability on various aspects (e.g. memory and computational time efficiency, representation and generalization power).
☆255Jul 21, 2021Updated 4 years ago
Alternatives and similar repositories for sparse-evolutionary-artificial-neural-networks
Users that are interested in sparse-evolutionary-artificial-neural-networks are comparing it to the libraries listed below
Sorting:
- ☆71Jan 27, 2020Updated 6 years ago
- [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…☆45Nov 11, 2023Updated 2 years ago
- [NeurIPS2022] Where to Pay Attention in Sparse Training for Feature Selection?☆12Feb 10, 2023Updated 3 years ago
- Implementation of Tabular Neural Gradient Orthogonalization and Specialization (TANGOS). A regularizer for neural networks described in o…☆19Feb 23, 2023Updated 3 years ago
- SNIP: SINGLE-SHOT NETWORK PRUNING BASED ON CONNECTION SENSITIVITY☆116Jun 26, 2019Updated 6 years ago
- [IJCAI 2022] "Dynamic Sparse Training for Deep Reinforcement Learning" by Ghada Sokar, Elena Mocanu , Decebal Constantin Mocanu, Mykola P…☆15May 13, 2022Updated 3 years ago
- A collection of Deep Neuroevolution resources or evolutionary algorithms applying in Deep Learning (constantly updating)☆225Apr 20, 2021Updated 4 years ago
- End-to-end training of sparse deep neural networks with little-to-no performance loss.☆335Jan 26, 2023Updated 3 years ago
- A public python implementation of the DeepHyperNEAT system for evolving neural networks. Developed by Felix Sosa and Kenneth Stanley. See…☆76Mar 13, 2022Updated 3 years ago
- Code for ICML 2021 submission☆35Mar 24, 2021Updated 4 years ago
- Paper: Challenges in High-dimensional Reinforcement Learning with Evolution Strategies☆29May 30, 2022Updated 3 years ago
- Tensorflow implementation of the paper "Fast Compressive Sensing Using Generative Model with Structed Latent Variables"☆10Apr 7, 2020Updated 5 years ago
- ☆564Jan 4, 2023Updated 3 years ago
- Implementation of OpenAI's Evolution Strategies in PyTorch.☆20Apr 22, 2020Updated 5 years ago
- A visualization of k-means clustering on terrorist attack locations☆10Apr 27, 2020Updated 5 years ago
- Global Sparse Momentum SGD for pruning very deep neural networks☆44Sep 8, 2022Updated 3 years ago
- Multi-Agent training using Deep Deterministic Policy Gradient Networks, Solving the Tennis Environment☆11Oct 20, 2018Updated 7 years ago
- Multivariate cumulants of any order☆14May 17, 2023Updated 2 years ago
- (MIRROR) Quantumsim, a GPU-accellerated full density matrix simulator of quantum circuits☆31Apr 5, 2023Updated 2 years ago
- Evolution Strategy Library☆56Jun 11, 2020Updated 5 years ago
- tabular q learning for trading☆12Dec 10, 2018Updated 7 years ago
- Demo code for CVPR2023 paper "Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers"☆15Jul 4, 2023Updated 2 years ago
- the solustion to https://openai.com/requests-for-research☆12Mar 23, 2017Updated 8 years ago
- general functions for your data .pipe()-lines.☆17Nov 8, 2023Updated 2 years ago
- Gradient based hyperparameter optimization & meta-learning package for TensorFlow☆190Mar 24, 2020Updated 5 years ago
- indoor localization demo with WIFI☆13May 26, 2017Updated 8 years ago
- Code to run the ASEBO algorithm from the paper: From Complexity to Simplicity: Adaptive ES-Active Subspaces for Blackbox Optimization... …☆16Oct 14, 2020Updated 5 years ago
- Lottery Tickets in Evolutionary Optimization (Lange & Sprekeler, ICML 2023)☆17Jun 2, 2023Updated 2 years ago
- Deep Neuroevolution☆1,663Jan 8, 2024Updated 2 years ago
- Macros to define custom adjoints for TensorOperations.jl☆14Aug 17, 2021Updated 4 years ago
- Compressing Neural Networks using the Variational Information Bottleneck☆66Aug 3, 2022Updated 3 years ago
- ☆14Jul 11, 2022Updated 3 years ago
- Official PyTorch implementation of Agglomerative Token Clustering presented at ECCV 2024☆19Sep 19, 2024Updated last year
- *SEM 2018: Learning Distributed Event Representations with a Multi-Task Approach☆21Oct 30, 2018Updated 7 years ago
- An Evolutionary Computation framework☆18Dec 13, 2021Updated 4 years ago
- Minimal PyTorch Library for Natural Evolution Strategies☆18Sep 29, 2021Updated 4 years ago
- Learning Deep Parsimonious Representations, Deep Learning, Clustering, NIPS 2016☆14Dec 25, 2019Updated 6 years ago
- This repo contains my solution to the Stanford course "NLP with Deep Learning" under CS224n code. Here, you can find the solution for all…☆18May 8, 2021Updated 4 years ago
- Workbench for practical machine learning in Ruby.☆20Nov 2, 2021Updated 4 years ago