Implements https://arxiv.org/abs/1711.05101 AdamW optimizer, cosine learning rate scheduler and "Cyclical Learning Rates for Training Neural Networks" https://arxiv.org/abs/1506.01186 for PyTorch framework
☆154Jul 14, 2019Updated 6 years ago
Alternatives and similar repositories for adamwr
Users that are interested in adamwr are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation and experiments for AdamW on Pytorch☆94Nov 23, 2019Updated 6 years ago
- The source code for the paper: Yirong Mao, Ruiping Wang, Shiguang Shan, Xilin Chen. COSONet: Compact Second-Order Network for Video Face …☆12Dec 27, 2018Updated 7 years ago
- Using the CLR algorithm for training (https://arxiv.org/abs/1506.01186)☆108Jun 7, 2018Updated 7 years ago
- pytorch implement of Lookahead Optimizer☆195Jun 20, 2022Updated 3 years ago
- Blazing Fast & Minimalist Blog Hugo Themes for Developer☆11Apr 28, 2019Updated 6 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Synchronized Multi-GPU Batch Normalization for PyTorch based on https://github.com/tamakoji/pytorch-syncbn☆12Nov 22, 2018Updated 7 years ago
- Implementation of elastic distortion algorithm in C++ (Using OpenCV)☆10Oct 19, 2018Updated 7 years ago
- Decoupled Weight Decay Regularization (ICLR 2019)☆295Jan 9, 2019Updated 7 years ago
- LGEB: Benchmark of Language Generation Evaluation☆16Oct 21, 2022Updated 3 years ago
- Used torch.optim.lr_scheduler.CosineAnnealingLR()☆32Jul 22, 2019Updated 6 years ago
- Cyclical_LR_Scheduler_With_Decay_Pytorch☆34Mar 14, 2020Updated 6 years ago
- Pre-trained NFNets with 99% of the accuracy of the official paper "High-Performance Large-Scale Image Recognition Without Normalization".☆159Mar 13, 2021Updated 5 years ago
- memory efficient densenet+lstm+ctc实现中文识别☆31Jun 21, 2022Updated 3 years ago
- An optimizer that trains as fast as Adam and as good as SGD.☆2,907Jul 23, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- On the Variance of the Adaptive Learning Rate and Beyond☆2,551Jul 31, 2021Updated 4 years ago
- codes and pre-trained models of paper "Segatron: Segment-aware Transformer for Language Modeling and Understanding"☆18Oct 25, 2022Updated 3 years ago
- ☆90Sep 13, 2019Updated 6 years ago
- Synchronized Batch Normalization implementation in PyTorch.☆1,503Apr 8, 2021Updated 5 years ago
- Experiments with Adam/AdamW/amsgrad☆201Sep 5, 2018Updated 7 years ago
- Implementation code of the paper: FishNet: A Versatile Backbone for Image, Region, and Pixel Level Prediction, NeurIPS 2018☆545May 17, 2019Updated 6 years ago
- Code for the Lovász-Softmax loss (CVPR 2018)☆1,410Apr 12, 2024Updated 2 years ago
- Pytorch implementation of "Hallucinating Agnostic Images to Generalize Across Domains"☆11Jul 10, 2019Updated 6 years ago
- Try to implement and test CVPR 2019 paper "Res2Net: A New Multi-scale Backbone Architecture" in PyTorch.☆18Jun 7, 2020Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Implementation of the ICML 2024 paper "Discovering Mixtures of Structural Causal Models from Time Series Data"☆24Jun 26, 2025Updated 9 months ago
- ICCV23 "Householder Projector for Unsupervised Latent Semantics Discovery"☆17Jun 26, 2025Updated 9 months ago
- torch-optimizer -- collection of optimizers for Pytorch☆3,170Mar 22, 2024Updated 2 years ago
- CVAE based School Idol image generation. Published in proc. of SSCC 2nd, 2017.☆12Nov 16, 2017Updated 8 years ago
- My implementation of the vehicle anomaly detection from https://github.com/ShuaiBai623/AI-City-Anomaly-Detection☆10Aug 30, 2019Updated 6 years ago
- Ranger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase☆1,206Dec 22, 2023Updated 2 years ago
- Slides from various talks I gave☆18Oct 25, 2018Updated 7 years ago
- A PyTorch Implementation of popular cyclic learning rate schedules☆35Sep 17, 2018Updated 7 years ago
- An attempt to apply reinforcement learning to graph signal recovery problem☆11Aug 25, 2021Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Implementation in Keras of: Snapshot Ensembles: Train 1, get M for free (https://arxiv.org/abs/1704.00109)☆26Oct 19, 2018Updated 7 years ago
- Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization☆182Nov 21, 2021Updated 4 years ago
- PyTorch DataLoaders implemented with DALI for accelerating image preprocessing☆883Jul 4, 2020Updated 5 years ago
- Pretrained ConvNets for pytorch: NASNet, ResNeXt, ResNet, InceptionV4, InceptionResnetV2, Xception, DPN, etc.☆9,109Apr 22, 2022Updated 3 years ago
- Robust Principal Component Analysis☆10Apr 1, 2014Updated 12 years ago
- Clean minimal implementation of Free-Form Image Inpainting with Gated Convolutions in pytorch lightning. Inspired from pytorch implementa…☆13Nov 22, 2022Updated 3 years ago
- Weakly Supervised Learning On Images☆601Oct 14, 2021Updated 4 years ago