A compressed adaptive optimizer for training large-scale deep learning models using PyTorch
☆25Nov 26, 2019Updated 6 years ago
Alternatives and similar repositories for Count-Sketch-Optimizers
Users that are interested in Count-Sketch-Optimizers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Sketched SGD☆28Jul 4, 2020Updated 5 years ago
- Simple Hierarchical Count Sketch in Python☆21Jun 3, 2021Updated 4 years ago
- Layer-wise Sparsification of Distributed Deep Learning☆10Jul 6, 2020Updated 5 years ago
- ☆10May 15, 2018Updated 7 years ago
- PyTorch for benchmarking communication-efficient distributed SGD optimization algorithms☆78Aug 30, 2021Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- MG-WFBP: Merging Gradients Wisely for Efficient Communication in Distributed Deep Learning☆12Apr 26, 2021Updated 5 years ago
- Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)☆16Oct 11, 2021Updated 4 years ago
- Code for testing DCT plus Sparse (DCTpS) networks☆14Jun 15, 2021Updated 4 years ago
- Code for reproducing experiments performed for Accoridon☆13Jun 11, 2021Updated 4 years ago
- ☆21Mar 7, 2024Updated 2 years ago
- A Sparse-tensor Communication Framework for Distributed Deep Learning☆13Nov 1, 2021Updated 4 years ago
- Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k c…☆27Dec 10, 2022Updated 3 years ago
- SGD with compressed gradients and error-feedback: https://arxiv.org/abs/1901.09847☆32Jul 25, 2024Updated last year
- Probabilistic data structures for large or streaming data sets.☆20May 13, 2017Updated 8 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Running massive simulations using RNNs on CPUs for building bots and all kinds of things.☆13Jun 13, 2021Updated 4 years ago
- [ICML2022] ProgFed: Effective, Communication, and Computation Efficient Federated Learning by Progressive Training☆23Oct 17, 2022Updated 3 years ago
- implement distributed machine learning with Pytorch + OpenMPI☆53Mar 22, 2019Updated 7 years ago
- ☆13Mar 22, 2023Updated 3 years ago
- Source code for SIGIR 2022 paper.☆16Apr 25, 2022Updated 4 years ago
- PyTorch implementation of a 9-layer ResNet for CIFAR-10.☆12May 8, 2024Updated last year
- Proximal Asynchronous SAGA☆13Nov 30, 2017Updated 8 years ago
- ☆13Oct 15, 2022Updated 3 years ago
- A simple python implementation of count min sketch.☆14Feb 17, 2016Updated 10 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆10Jul 21, 2021Updated 4 years ago
- A LaTeX template for note☆10May 4, 2023Updated 2 years ago
- ☆10Sep 3, 2017Updated 8 years ago
- RecZilla: Metalearning for algorithm selection on Recommender Systems☆25Oct 21, 2023Updated 2 years ago
- C++ Implementations of sketch data structures with SIMD Parallelism, including Python bindings☆158Jul 23, 2024Updated last year
- High-dimensional approximate nearest neighbor in python☆11Sep 18, 2018Updated 7 years ago
- A Neovim client for VsCoq 2 vscoqtop.☆13Nov 8, 2025Updated 5 months ago
- LearnedSketch: Learning-Based Frequency Estimation Algorithms (ICLR 2019)☆32Mar 24, 2023Updated 3 years ago
- Code for PAC-Bayes Compression Bounds So Tight That They Can Explain Generalization, NeurIPS 2022☆18Nov 23, 2022Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A pure-Python count-min sketch, fast and accurate.☆16May 21, 2017Updated 8 years ago
- Minimal Transformer base in JAX. A single backbone for language modelling, diffusion, classification, etc...☆15May 28, 2025Updated 11 months ago
- A framework for index based similarity search.☆20May 10, 2019Updated 6 years ago
- bigcomputing☆33Nov 3, 2020Updated 5 years ago
- Convolutional 3D autoencoder☆14Aug 21, 2016Updated 9 years ago
- Hadamard Response: Communication efficient, sample optimal, linear time locally private learning of distributions☆16Sep 18, 2020Updated 5 years ago
- Multi-index hashing for the resolution of ANN search problem on large datasets☆15Oct 16, 2018Updated 7 years ago