Bibtex for Sparsity in Deep Learning paper (https://arxiv.org/abs/2102.00554) - open for pull requests
☆47May 4, 2022Updated 4 years ago
Alternatives and similar repositories for sparsity-in-deep-learning
Users that are interested in sparsity-in-deep-learning are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wa…☆33Apr 9, 2023Updated 3 years ago
- [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…☆46Nov 11, 2023Updated 2 years ago
- Soft Threshold Weight Reparameterization for Learnable Sparsity☆91Feb 15, 2023Updated 3 years ago
- PyTorch implementation of LARS (Layer-wise Adaptive Rate Scaling)☆20May 11, 2019Updated 7 years ago
- [ICLR 2021] "Long Live the Lottery: The Existence of Winning Tickets in Lifelong Learning" by Tianlong Chen*, Zhenyu Zhang*, Sijia Liu, S…☆26Dec 30, 2021Updated 4 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 3 years ago
- A Signal Propagation Perspective for Pruning Neural Networks at Initialization☆14Jun 23, 2020Updated 6 years ago
- ☆18Nov 10, 2025Updated 10 months ago
- [NeurIPS‘2021] "MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge", Geng Yuan, Xiaolong Ma, Yanzhi Wang et al…☆18Mar 16, 2022Updated 4 years ago
- Official pytorch code for "APP: Anytime Progressive Pruning" (DyNN @ ICML, 2022; CLL @ ACML, 2022, SNN @ ICML, 2022 and SlowDNN 2023)☆16Nov 22, 2022Updated 3 years ago
- Code for ICML 2022 paper "SPDY: Accurate Pruning with Speedup Guarantees"☆20May 3, 2023Updated 3 years ago
- ☆38Nov 13, 2020Updated 5 years ago
- A branch predictor simulator in C++ that tests 6 different types of branch predictors.☆13Apr 26, 2018Updated 8 years ago
- Neural Arithmetic Logic Units by Trask et al.☆12Apr 10, 2019Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for ICML 2021 submission☆35Mar 24, 2021Updated 5 years ago
- Codebase for the paper "Beyond BatchNorm: Towards a Unified Understanding of Normalization in Deep Learning"☆17Jul 12, 2021Updated 5 years ago
- [ICLR 2022] "Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity" by Shiwei Liu,…☆27Jun 15, 2022Updated 4 years ago
- Ensemble Knowledge Guided Sub-network Search and Fine-tuning for Filter Pruning☆19Sep 20, 2022Updated 4 years ago
- Code Implemntion from the article Multi-Armed Bandit Based Client Schedulingfor Federated Learning☆18Mar 27, 2021Updated 5 years ago
- Deep Learning Research☆16Nov 13, 2019Updated 6 years ago
- OpenDLA for trying the demo and FPGA solution☆16Jul 28, 2022Updated 4 years ago
- End-to-end training of sparse deep neural networks with little-to-no performance loss.☆338Jan 26, 2023Updated 3 years ago
- Code for the ICML 2021 and ICLR 2022 papers: Skew Orthogonal Convolutions, Improved deterministic l2 robustness on CIFAR-10 and CIFAR-100☆19Feb 20, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…☆20Sep 18, 2023Updated 3 years ago
- PyTorch implementation of TinyWASE described in our paper "Compressing Speaker Extraction Model with Ultra-low Precision Quantization and…☆11Jun 28, 2021Updated 5 years ago
- Attention-Based Guided Structured Sparsity of Deep Neural Networks☆29Mar 22, 2020Updated 6 years ago
- A repository in preparation for open-sourcing lottery ticket hypothesis code.☆640Sep 6, 2022Updated 4 years ago
- Implementation of NM sparsity recipe presented in the paper "Progressive Gradient Flow for Robust N:M Sparsity Training in Transformers".☆11Feb 5, 2024Updated 2 years ago
- 语音切割，python ，webrtc☆11Sep 28, 2018Updated 7 years ago
- ☆43Jan 30, 2024Updated 2 years ago
- ☆16Mar 2, 2019Updated 7 years ago
- [ICLR 2023] Pruning Deep Neural Networks from a Sparsity Perspective☆25Jan 8, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Biomedical concept relatedness benchmark sampled from electronic health records☆11Jul 14, 2022Updated 4 years ago
- [ICLR 2021] Beyond Categorical Label Representations for Image Classification☆26Dec 12, 2021Updated 4 years ago
- Comparison of method "Pruning at initialization prior to training" (Synflow/SNIP/GraSP) in PyTorch☆18May 12, 2024Updated 2 years ago
- code to show F-Principle in the DNN training☆59Sep 21, 2022Updated 4 years ago
- [ICML 2021] "Auto-NBA: Efficient and Effective Search Over the Joint Space of Networks, Bitwidths, and Accelerators" by Yonggan Fu, Yonga…☆16Jan 3, 2022Updated 4 years ago
- Code for the paper☆12May 24, 2024Updated 2 years ago
- ☆10Dec 22, 2023Updated 2 years ago