Janus-Shiau / lookahead_tensorflow
Lookahead optimizer ("Lookahead Optimizer: k steps forward, 1 step back") for tensorflow
☆25Updated 5 years ago
Alternatives and similar repositories for lookahead_tensorflow:
Users that are interested in lookahead_tensorflow are comparing it to the libraries listed below
- wrapping a keras optimizer to implement gradient accumulation☆119Updated 4 years ago
- Tensorflow version implementation of focal loss for binary and multi classification☆109Updated 6 years ago
- RAdam optimizer for keras☆71Updated 5 years ago
- Focal Loss of multi-classification in tensorflow☆79Updated 5 years ago
- lookahead optimizer for keras☆170Updated 5 years ago
- Simple Tensorflow implementation of "On The Variance Of The Adaptive Learning Rate And Beyond"☆97Updated 4 years ago
- Try to use tf.estimator and tf.data together to train a cnn model.☆79Updated 6 years ago
- Keras implement of Lazy optimizer☆21Updated 5 years ago
- pytorch implement of Lookahead Optimizer☆188Updated 2 years ago
- 高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese Language Model for NLP Task☆57Updated 4 years ago
- Cyclic learning rate TensorFlow implementation.☆66Updated 5 years ago
- Octave convolution☆34Updated 3 years ago
- The implementation of focal loss proposed on "Focal Loss for Dense Object Detection" by KM He and support for multi-label dataset.☆313Updated 6 years ago
- Lookahead mechanism for optimizers in Keras.☆49Updated 3 years ago
- The unofficial tensorflow implementation of loss weights of in "Gradient Harmonized Single-stage Detector" published on AAAI 2019 (Oral).…☆29Updated 4 years ago
- saving memory by recomputing for keras☆37Updated 4 years ago
- tf2.0 implementation of circle loss☆32Updated 4 years ago
- AutoTorch, A HPO Toolkit☆60Updated 4 years ago
- Reversible Recurrent Neural Network Pytorch Implementation☆21Updated 7 years ago
- Densely Connected CNN with Multi-scale Feature Attention for Text Classification☆133Updated 6 years ago
- Converting A PyTorch Model to Tensorflow pb using ONNX☆160Updated 5 years ago
- Stochastic Weight Averaging - TensorFlow implementation☆33Updated 5 years ago
- Simple Tensorflow implementation of "Adaptive Gradient Methods with Dynamic Bound of Learning Rate" (ICLR 2019)☆150Updated 5 years ago
- Transformer-XL with checkpoint loader☆68Updated 3 years ago
- LAMB Optimizer for Large Batch Training (TensorFlow version)☆120Updated 5 years ago
- Radam+lookahead implemented by tensorflow☆11Updated 5 years ago
- tunz's CUDA pytorch operator (MaskedSoftmax)☆75Updated 5 years ago
- tensorflow version of bert-of-theseus☆62Updated 4 years ago
- A pytorch implementation of Attention is all you need☆91Updated 6 years ago
- From basic linear regression, to CNN, to RNN, to seq2seq.☆47Updated 6 years ago