bojone / accum_optimizer_for_keras
wrapping a keras optimizer to implement gradient accumulation
☆119Updated 4 years ago
Alternatives and similar repositories for accum_optimizer_for_keras:
Users that are interested in accum_optimizer_for_keras are comparing it to the libraries listed below
- lookahead optimizer for keras☆170Updated 5 years ago
- RAdam optimizer for keras☆71Updated 5 years ago
- Tensorflow version implementation of focal loss for binary and multi classification☆109Updated 6 years ago
- Try to use tf.estimator and tf.data together to train a cnn model.☆79Updated 6 years ago
- saving memory by recomputing for keras☆37Updated 4 years ago
- Focal Loss of multi-classification in tensorflow☆80Updated 5 years ago
- LAMB Optimizer for Large Batch Training (TensorFlow version)☆120Updated 5 years ago
- Keras implement of Lazy optimizer☆21Updated 5 years ago
- Lookahead optimizer ("Lookahead Optimizer: k steps forward, 1 step back") for tensorflow☆25Updated 5 years ago
- The implementation of focal loss proposed on "Focal Loss for Dense Object Detection" by KM He and support for multi-label dataset.☆313Updated 6 years ago
- bert-of-theseus via bert4keras☆31Updated 4 years ago
- Gradient accumulation for Keras☆35Updated 3 years ago
- Converting A PyTorch Model to Tensorflow pb using ONNX☆160Updated 5 years ago
- Cyclic learning rate TensorFlow implementation.☆66Updated 5 years ago
- Adversarial Training for NLP in Keras☆46Updated 4 years ago
- The unofficial tensorflow implementation of loss weights of in "Gradient Harmonized Single-stage Detector" published on AAAI 2019 (Oral).…☆29Updated 5 years ago
- AdamW optimizer for Keras☆114Updated 5 years ago
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆167Updated 3 years ago
- Transformer-XL with checkpoint loader☆68Updated 3 years ago
- A pytorch implementation of Attention is all you need☆91Updated 6 years ago
- Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"☆75Updated 5 years ago
- Learning rate multiplier☆46Updated 3 years ago
- Implementation of Learning Rate Finder, SGDR and Cyclical Learning Rate in Keras☆29Updated 6 years ago
- Octave convolution☆34Updated 3 years ago
- adafactor optimizer for keras☆20Updated 3 years ago
- 高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese Language Model for NLP Task☆57Updated 4 years ago
- pytorch implement of Lookahead Optimizer☆189Updated 2 years ago
- KDD Cup 2020 Challenges for Modern E-Commerce Platform: Multimodalities Recall first place☆190Updated 4 years ago
- This is our solution for KDD Cup 2020. We implemented a very neat and simple neural ranking model based on siamese BERT which ranked firs…☆70Updated 4 years ago
- Focal Loss implementation in Keras☆327Updated 3 years ago