A compressed adaptive optimizer for training large-scale deep learning models using PyTorch
☆25Nov 26, 2019Updated 6 years ago
Alternatives and similar repositories for Count-Sketch-Optimizers
Users that are interested in Count-Sketch-Optimizers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Simple Hierarchical Count Sketch in Python☆21Jun 3, 2021Updated 5 years ago
- MISSION: Ultra Large-Scale Feature Selection using Count-Sketches☆13Oct 6, 2019Updated 7 years ago
- Layer-wise Sparsification of Distributed Deep Learning☆10Jul 6, 2020Updated 6 years ago
- MG-WFBP: Merging Gradients Wisely for Efficient Communication in Distributed Deep Learning☆12Apr 26, 2021Updated 5 years ago
- Extreme Classification in Log Memory via Count-Min Sketch☆45Sep 6, 2020Updated 6 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A framework for index based similarity search.☆20May 10, 2019Updated 7 years ago
- PyTorch for benchmarking communication-efficient distributed SGD optimization algorithms☆80Aug 30, 2021Updated 5 years ago
- gTop-k S-SGD: A Communication-Efficient Distributed Synchronous SGD Algorithm for Deep Learning☆37Aug 19, 2019Updated 7 years ago
- Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k c…☆27Dec 10, 2022Updated 3 years ago
- A Sparse-tensor Communication Framework for Distributed Deep Learning☆13Nov 1, 2021Updated 5 years ago
- Code for reproducing experiments performed for Accoridon☆13Jun 11, 2021Updated 5 years ago
- Probabilistic data structures for large or streaming data sets.☆19May 13, 2017Updated 9 years ago
- Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)☆17Oct 11, 2021Updated 5 years ago
- A Learnable LSH Framework for Efficient NN Training☆35Jul 22, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Source code for SIGIR 2022 paper.☆16Apr 25, 2022Updated 4 years ago
- QSFL: A Two-Level Uplink Communication Optimization Framework for Federated Learning (ICML'22)☆13Jul 26, 2023Updated 3 years ago
- A Python Snowpark CLI for loading the TPC-DI dataset into Snowflake. Additional dbt models for building the data warehouse.☆11Sep 4, 2025Updated last year
- [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation☆12Jul 31, 2023Updated 3 years ago
- ☆13Mar 22, 2023Updated 3 years ago
- PyTorch implementation of a 9-layer ResNet for CIFAR-10.☆11May 8, 2024Updated 2 years ago
- This repository contains implementations of the Count-Min and Count-Median sketches. Furthermore it contains 6 different implementations …☆15Jun 13, 2016Updated 10 years ago
- ☆14Oct 15, 2022Updated 4 years ago
- ☆10Jul 21, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Proximal Asynchronous SAGA☆13Nov 30, 2017Updated 8 years ago
- ☆14Mar 27, 2019Updated 7 years ago
- Code repository for "Spatiotemporal Traffic Matrix Synthesis", Paul Tune and Matthew Roughan, ACM SIGCOMM 2015, London, UK, August 2015.☆15Jan 13, 2016Updated 10 years ago
- C++ Implementations of sketch data structures with SIMD Parallelism, including Python bindings☆156Oct 23, 2026Updated last week
- LearnedSketch: Learning-Based Frequency Estimation Algorithms (ICLR 2019)☆33Mar 24, 2023Updated 3 years ago
- RecZilla: Metalearning for algorithm selection on Recommender Systems☆25Oct 21, 2023Updated 3 years ago
- Random program generator for Python☆10Jun 20, 2013Updated 13 years ago
- Multi-index hashing for the resolution of ANN search problem on large datasets☆15Oct 16, 2018Updated 8 years ago
- ☆12Apr 25, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for "Practical Low-Rank Communication Compression in Decentralized Deep Learning"☆17Aug 4, 2020Updated 6 years ago
- ☆10Jul 30, 2021Updated 5 years ago
- bigcomputing☆33Nov 3, 2020Updated 5 years ago
- Caffe version of code for our paper "Joint unsupervised learning of deep representations and image clusters"☆16Jul 4, 2017Updated 9 years ago
- Baseline implementations on the MuMiN dataset☆10Oct 18, 2023Updated 3 years ago
- pytorch implementation of trDesign☆45Mar 19, 2021Updated 5 years ago
- Code for PAC-Bayes Compression Bounds So Tight That They Can Explain Generalization, NeurIPS 2022☆18Nov 23, 2022Updated 3 years ago