MADGRAD Optimization Method
☆801Jan 27, 2025Updated last year
Alternatives and similar repositories for madgrad
Users that are interested in madgrad are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- torch-optimizer -- collection of optimizers for Pytorch☆3,172Mar 22, 2024Updated 2 years ago
- Repository for NeurIPS 2020 Spotlight "AdaBelief Optimizer: Adapting stepsizes by the belief in observed gradients"☆1,071Aug 9, 2024Updated 2 years ago
- VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.☆3,288Mar 3, 2024Updated 2 years ago
- Ranger deep learning optimizer rewrite to use newest components☆339Mar 17, 2026Updated 8 months ago
- Your PyTorch AI Factory - Flash enables you to easily configure and run complex AI recipes for over 15 tasks across 7 data domains☆1,726Oct 8, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A data augmentations library for audio, image, text, and video.☆5,098Updated this week
- Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable☆218Apr 4, 2021Updated 5 years ago
- PyTorch extensions for high performance and large scale training.☆3,404Apr 26, 2025Updated last year
- Generative Adversarial Transformers☆1,344Jun 14, 2022Updated 4 years ago
- Official code Cross-Covariance Image Transformer (XCiT)☆683Sep 28, 2021Updated 5 years ago
- functorch is JAX-like composable function transforms for PyTorch.☆1,434Aug 21, 2025Updated last year
- FFCV: Fast Forward Computer Vision (and other ML workloads!)☆2,995Jun 16, 2024Updated 2 years ago
- Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute☆1,530Nov 18, 2020Updated 6 years ago
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)☆9,638Aug 26, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Toolbox of models, callbacks, and datasets for AI/ML researchers.☆1,750Jan 20, 2026Updated 9 months ago
- Fast, differentiable sorting and ranking in PyTorch☆866Mar 3, 2026Updated 8 months ago
- Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.☆1,485May 2, 2025Updated last year
- Ranger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase☆1,207Dec 22, 2023Updated 2 years ago
- ☆3,234Jul 30, 2024Updated 2 years ago
- Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.☆31,450Updated this week
- A deep learning library for video understanding research.☆3,569Oct 16, 2026Updated last month
- Train and evaluate embeddings for similarity search with PyTorch. Includes contrastive losses, hard example mining, samplers, and retriev…☆6,343Updated this week
- AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)☆413Jan 13, 2021Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- On the Variance of the Adaptive Learning Rate and Beyond☆2,548Jul 31, 2021Updated 5 years ago
- Shape and dimension inference (Keras-like) for PyTorch layers and neural networks☆572Jun 13, 2022Updated 4 years ago
- Fast Block Sparse Matrices for Pytorch☆551Jan 21, 2021Updated 5 years ago
- Library for 8-bit optimizers and quantization routines.☆778Aug 18, 2022Updated 4 years ago
- Reformer, the efficient Transformer, in Pytorch☆2,193Jun 21, 2023Updated 3 years ago
- Model interpretability and understanding for PyTorch☆5,722Updated this week
- Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch☆252Sep 1, 2022Updated 4 years ago
- Pytorch library for fast transformer implementations☆1,785Mar 23, 2023Updated 3 years ago
- StudioGAN is a Pytorch library providing implementations of representative Generative Adversarial Networks (GANs) for conditional/uncondi…☆3,495Aug 9, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- PyTorch code for Vision Transformers training with the Self-Supervised learning method DINO☆7,608Jul 3, 2024Updated 2 years ago
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,266Updated this week
- Accelerated deep learning R&D☆3,389Jul 8, 2026Updated 4 months ago
- A New Optimization Technique for Deep Neural Networks☆536Jan 13, 2022Updated 4 years ago
- higher is a pytorch library allowing users to obtain higher order gradients over losses spanning training loops rather than individual tr…☆1,624Mar 25, 2022Updated 4 years ago
- HiPlot makes understanding high dimensional data easy☆2,795Jan 10, 2024Updated 2 years ago
- Research repo for code that may or may not end up in fastai3☆51Jun 15, 2021Updated 5 years ago
Are these results useful?