Implements https://arxiv.org/abs/1711.05101 AdamW optimizer, cosine learning rate scheduler and "Cyclical Learning Rates for Training Neural Networks" https://arxiv.org/abs/1506.01186 for PyTorch framework
☆153Jul 14, 2019Updated 6 years ago
Alternatives and similar repositories for adamwr
Users that are interested in adamwr are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation and experiments for AdamW on Pytorch☆94Nov 23, 2019Updated 6 years ago
- The source code for the paper: Yirong Mao, Ruiping Wang, Shiguang Shan, Xilin Chen. COSONet: Compact Second-Order Network for Video Face …☆12Dec 27, 2018Updated 7 years ago
- Using the CLR algorithm for training (https://arxiv.org/abs/1506.01186)☆108Jun 7, 2018Updated 8 years ago
- pytorch implement of Lookahead Optimizer☆194Jun 20, 2022Updated 3 years ago
- Blazing Fast & Minimalist Blog Hugo Themes for Developer☆11Apr 28, 2019Updated 7 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Multi Stopwatch for Python☆12Sep 28, 2019Updated 6 years ago
- Synchronized Multi-GPU Batch Normalization for PyTorch based on https://github.com/tamakoji/pytorch-syncbn☆12Nov 22, 2018Updated 7 years ago
- Implementation of elastic distortion algorithm in C++ (Using OpenCV)☆10Oct 19, 2018Updated 7 years ago
- Decoupled Weight Decay Regularization (ICLR 2019)☆296Jan 9, 2019Updated 7 years ago
- LGEB: Benchmark of Language Generation Evaluation☆16Oct 21, 2022Updated 3 years ago
- Used torch.optim.lr_scheduler.CosineAnnealingLR()☆32Jul 22, 2019Updated 6 years ago
- Cyclical_LR_Scheduler_With_Decay_Pytorch☆34Mar 14, 2020Updated 6 years ago
- SGDR with pytorch on CIFAR-10 (now superseded by official PyTorch CosineAnnealingLR)☆47Aug 12, 2019Updated 6 years ago
- L4: Practical loss-based stepsize adaptation for PyTorch☆18May 7, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Pre-trained NFNets with 99% of the accuracy of the official paper "High-Performance Large-Scale Image Recognition Without Normalization".☆158Mar 13, 2021Updated 5 years ago
- ☆1,207Jun 5, 2020Updated 6 years ago
- Supplementary Material "Modeling and Control of Morphing Covers for the Adaptive Morphology of Humanoid Robots" published in IEEE Transac…☆13Dec 9, 2024Updated last year
- An optimizer that trains as fast as Adam and as good as SGD.☆2,904Jul 23, 2023Updated 2 years ago
- On the Variance of the Adaptive Learning Rate and Beyond☆2,548Jul 31, 2021Updated 4 years ago
- ☆90Sep 13, 2019Updated 6 years ago
- Synchronized Batch Normalization implementation in PyTorch.☆1,504Apr 8, 2021Updated 5 years ago
- Implementation code of the paper: FishNet: A Versatile Backbone for Image, Region, and Pixel Level Prediction, NeurIPS 2018☆543May 17, 2019Updated 7 years ago
- Code for the Lovász-Softmax loss (CVPR 2018)☆1,412Apr 12, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆470Apr 8, 2023Updated 3 years ago
- Pytorch implementation of "Hallucinating Agnostic Images to Generalize Across Domains"☆11Jul 10, 2019Updated 6 years ago
- Try to implement and test CVPR 2019 paper "Res2Net: A New Multi-scale Backbone Architecture" in PyTorch.☆17Jun 7, 2020Updated 6 years ago
- torch-optimizer -- collection of optimizers for Pytorch☆3,166Mar 22, 2024Updated 2 years ago
- CVAE based School Idol image generation. Published in proc. of SSCC 2nd, 2017.☆12Nov 16, 2017Updated 8 years ago
- A hand pose estimation system using dual-KD-trees☆10Nov 3, 2015Updated 10 years ago
- Ranger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase☆1,205Dec 22, 2023Updated 2 years ago
- Slides from various talks I gave☆18Oct 25, 2018Updated 7 years ago
- A PyTorch Implementation of popular cyclic learning rate schedules☆35Sep 17, 2018Updated 7 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Implementation in Keras of: Snapshot Ensembles: Train 1, get M for free (https://arxiv.org/abs/1704.00109)☆26Oct 19, 2018Updated 7 years ago
- Minimal codes for "Task-Oriented Dexterous Hand Pose Synthesis Using Differentiable Grasp Wrench Boundary Estimator [IROS 2024]"☆16Feb 12, 2025Updated last year
- Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization☆181Nov 21, 2021Updated 4 years ago
- PyTorch DataLoaders implemented with DALI for accelerating image preprocessing☆883Jul 4, 2020Updated 5 years ago
- Pretrained ConvNets for pytorch: NASNet, ResNeXt, ResNet, InceptionV4, InceptionResnetV2, Xception, DPN, etc.☆9,102Apr 22, 2022Updated 4 years ago
- ☆10Apr 19, 2020Updated 6 years ago
- Robust Principal Component Analysis☆10Apr 1, 2014Updated 12 years ago