A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification for Adaptivity
☆48Feb 7, 2020Updated 6 years ago
Alternatives and similar repositories for why-clipping-accelerates
Users that are interested in why-clipping-accelerates are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆68Mar 4, 2020Updated 6 years ago
- Don't just regulate gradients like in Muon, regulate the weights too☆32Jul 30, 2025Updated 8 months ago
- Official codebase for our paper "Joslim: Joint Widths and Weights Optimization for Slimmable Neural Networks"☆12Jun 30, 2021Updated 4 years ago
- Implementation of the paper "Meta-Learning by Adjusting Priors Based on Extended PAC-Bayes Theory", Ron Amit and Ron Meir, ICML 2018☆18Apr 13, 2021Updated 5 years ago
- ☆20Oct 3, 2019Updated 6 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- batchboost is a variation on MixUp that instead of mixing just two images, mixes many images together.☆44Jan 26, 2020Updated 6 years ago
- An empirical investigation of deep learning theory☆16Oct 3, 2019Updated 6 years ago
- Official Code for MIMETIC^2☆13Nov 19, 2024Updated last year
- Source codes for our AAAI'20 paper: Adaptive Factorization Network: Learning Adaptive-Order Feature Interactions☆38Sep 22, 2020Updated 5 years ago
- PyTorch Implementation of Variance Reduced Optimization Algorithms -- SARAH and SVRG.☆15Jul 11, 2021Updated 4 years ago
- [JMLR] TRADES + random smoothing for certifiable robustness☆14Sep 13, 2020Updated 5 years ago
- Comparison of gradient estimation techniques for black-box adversarial examples☆11Oct 31, 2018Updated 7 years ago
- Create PDF animations from graphics files and inline graphics using LaTeX☆12Jun 8, 2018Updated 7 years ago
- This repository contains the code used in a publication 'Active Learning for Decision-Making from Imbalanced Observational Data', Iiris S…☆11May 14, 2019Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code for "A Spectral Approach to Gradient Estimation for Implicit Distributions" (ICML'18)☆34May 11, 2023Updated 2 years ago
- CIFAR10 ResNets implemented in JAX+Flax☆12Apr 6, 2022Updated 4 years ago
- Official PyTorch implementation of "Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets" (ICLR 2023 notable top 25%)☆26Mar 18, 2024Updated 2 years ago
- Analyze the dynamic stability of SGD☆13Nov 25, 2018Updated 7 years ago
- ☆11Jul 27, 2018Updated 7 years ago
- ☆12Jul 7, 2021Updated 4 years ago
- Atomo: Communication-efficient Learning via Atomic Sparsification☆28Dec 9, 2018Updated 7 years ago
- Fork of the differential privacy module of TF/models/research☆14Oct 9, 2019Updated 6 years ago
- Code for the paper "Robustness Certificates for Sparse Adversarial Attacks by Randomized Ablation" by Alexander Levine and Soheil Feizi.☆10Aug 22, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A pytorch implementation of text-to-3D dreamfusion, powered by stable diffusion.☆22May 2, 2023Updated 2 years ago
- Automatic Mixed Precision Tutorials using pytorch. Based on PyTorch 1.6 Official Features, implement classification codebase using custo…☆90Sep 3, 2020Updated 5 years ago
- This repository contains the code for the paper in Findings of EMNLP 2021: "EfficientBERT: Progressively Searching Multilayer Perceptron …☆33Jun 14, 2023Updated 2 years ago
- Pretraining summarization models using a corpus of nonsense☆13Sep 28, 2021Updated 4 years ago
- The implement of layer-wise training denoise autoencoder in pytorch.☆13Oct 9, 2017Updated 8 years ago
- Implementing use-based privacy for ubiquitous computing.☆18Jun 26, 2025Updated 9 months ago
- HackerRank, LeetCode, Cracking the Coding Interview Solutions in Python/C++☆11Mar 15, 2026Updated last month
- Code to reproduce some of the figures in the paper "On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima"☆146Apr 24, 2017Updated 8 years ago
- ☆27Feb 10, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- CEVAE with VampPrior☆11Jul 18, 2018Updated 7 years ago
- A personal AI therapist to help you with your mental health☆24Nov 29, 2025Updated 4 months ago
- Code release to accompany paper "Geometry-Aware Gradient Algorithms for Neural Architecture Search."☆25Oct 7, 2020Updated 5 years ago
- Accelerated Bregman Proximal Gradient Methods☆29Jun 12, 2023Updated 2 years ago
- Robust Attribution Regularization☆16Feb 17, 2022Updated 4 years ago
- Experiments from "The Generalization-Stability Tradeoff in Neural Network Pruning": https://arxiv.org/abs/1906.03728.☆14Oct 23, 2020Updated 5 years ago
- Predicting Air Quality from Webcam Images with Deep Learning☆10Jan 19, 2019Updated 7 years ago