A compressed adaptive optimizer for training large-scale deep learning models using PyTorch
☆25Nov 26, 2019Updated 6 years ago
Alternatives and similar repositories for Count-Sketch-Optimizers
Users that are interested in Count-Sketch-Optimizers are comparing it to the libraries listed below
Sorting:
- MISSION: Ultra Large-Scale Feature Selection using Count-Sketches☆13Oct 6, 2019Updated 6 years ago
- Simple Hierarchical Count Sketch in Python☆21Jun 3, 2021Updated 4 years ago
- Layer-wise Sparsification of Distributed Deep Learning☆10Jul 6, 2020Updated 5 years ago
- ☆10May 15, 2018Updated 7 years ago
- Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)☆16Oct 11, 2021Updated 4 years ago
- PyTorch for benchmarking communication-efficient distributed SGD optimization algorithms☆78Aug 30, 2021Updated 4 years ago
- Code for reproducing experiments performed for Accoridon☆13Jun 11, 2021Updated 4 years ago
- A Sparse-tensor Communication Framework for Distributed Deep Learning☆13Nov 1, 2021Updated 4 years ago
- MG-WFBP: Merging Gradients Wisely for Efficient Communication in Distributed Deep Learning☆12Apr 26, 2021Updated 4 years ago
- Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k c…☆27Dec 10, 2022Updated 3 years ago
- A Learnable LSH Framework for Efficient NN Training☆34Jul 22, 2021Updated 4 years ago
- Sparsified SGD with Memory: https://arxiv.org/abs/1809.07599☆58Oct 25, 2018Updated 7 years ago
- Code for testing DCT plus Sparse (DCTpS) networks☆15Jun 15, 2021Updated 4 years ago
- gTop-k S-SGD: A Communication-Efficient Distributed Synchronous SGD Algorithm for Deep Learning☆37Aug 19, 2019Updated 6 years ago
- Private Adaptive Optimization with Side Information (ICML '22)☆16Jun 23, 2022Updated 3 years ago
- RecZilla: Metalearning for algorithm selection on Recommender Systems☆25Oct 21, 2023Updated 2 years ago
- [ICML2022] ProgFed: Effective, Communication, and Computation Efficient Federated Learning by Progressive Training☆23Oct 17, 2022Updated 3 years ago
- "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation☆30Feb 4, 2025Updated last year
- implement distributed machine learning with Pytorch + OpenMPI☆53Mar 22, 2019Updated 6 years ago
- bigcomputing☆33Nov 3, 2020Updated 5 years ago
- LearnedSketch: Learning-Based Frequency Estimation Algorithms (ICLR 2019)☆32Mar 24, 2023Updated 2 years ago
- Sketching linear classifiers over data streams with the Weight-Median Sketch (SIGMOD 2018).☆40Jul 20, 2018Updated 7 years ago
- This is the repository for our WSDM 2020 publication: Interpretable Click-through Rate Prediction through Hierarchical Attention☆40Oct 29, 2019Updated 6 years ago
- ☆12Aug 15, 2023Updated 2 years ago
- Code accompanying the NeurIPS 2019 paper AutoAssist: A Framework to Accelerate Training of Deep Neural Networks.☆14Oct 3, 2022Updated 3 years ago
- A fast heuristic search algorithm for finding the longest common subsequence of multiple strings☆10Nov 22, 2023Updated 2 years ago
- netbeacon - monitoring your network capture, NIDS or network analysis process☆19Oct 26, 2013Updated 12 years ago
- Sparsity support for PyTorch☆38Mar 22, 2025Updated 11 months ago
- Official repository for "DYPLOC: Dynamic Planning of Content Using Mixed Language Models for Opinion Text Generation"☆10May 20, 2022Updated 3 years ago
- ☆11Feb 16, 2021Updated 5 years ago
- Residual Quantization Autoencoder, used for interpreting LLMs☆14Jan 1, 2025Updated last year
- Automatically exported from code.google.com/p/malder☆11Mar 17, 2015Updated 10 years ago
- ☆12May 18, 2024Updated last year
- Boiler: a software tool for highly efficient, lossy compression of RNA-seq alignments☆13Jul 14, 2016Updated 9 years ago
- ☆10Jun 4, 2021Updated 4 years ago
- a fast and customizable CUDA int4 tensor core gemm☆15Aug 2, 2024Updated last year
- ☆11Mar 13, 2023Updated 2 years ago
- PSTensor provides a way to hack the memory management of tensors in TensorFlow and PyTorch by defining your own C++ Tensor Class.☆10Feb 10, 2022Updated 4 years ago
- [CVPRW 2019] Fractal Residual Network☆11Mar 25, 2019Updated 6 years ago