OrigamiDream / lion-tf
Lion - EvoLved Sign Momentum w/ New Optimizer API in TensorFlow 2.11+
☆10Updated 2 years ago
Alternatives and similar repositories for lion-tf:
Users that are interested in lion-tf are comparing it to the libraries listed below
- Usable implementation of Mogrifier, a circuit for enhancing LSTMs and potentially other networks, from Deepmind☆18Updated 10 months ago
- TensorFlow GPU & TPU compatible operations: MelSpectrogram, TimeFreqMask, CutMix, MixUp, ZScore, and more☆18Updated last year
- ☆8Updated 5 months ago
- This repository hosts code for converting the original MLP Mixer models (JAX) to TensorFlow.☆15Updated 3 years ago
- This repository hosts code for converting the original Vision Transformer models (JAX) to TensorFlow.☆33Updated 3 years ago
- Implements RNNPool and SoftPool for CNNs.☆14Updated 4 years ago
- Implements MLP-Mixer (https://arxiv.org/abs/2105.01601) with the CIFAR-10 dataset.☆56Updated 2 years ago
- ☆15Updated 3 years ago
- ResNet-RS models rewritten in Tensorflow / Keras functional API.☆27Updated last year
- ☆73Updated 2 years ago
- ☆16Updated 2 years ago
- ☆18Updated 3 years ago
- Official repository for Automated Learning Rate Scheduler for Large-Batch Training (8th ICML Workshop on AutoML)☆40Updated 3 years ago
- Local Attention - Flax module for Jax☆20Updated 3 years ago
- Implementation of Swin Transformers in TensorFlow along with converted pre-trained models, code for off-the-shelf classification and fine…☆57Updated 2 years ago
- PyTorch implementation of GLOM☆21Updated 3 years ago
- Unofficial Implementation of MLP-Mixer in TensorFlow☆27Updated 3 years ago
- Unofficial implementation of "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" (https://arxiv.org/abs/2103.14030)☆65Updated 3 years ago
- PyTorch reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Repr…☆22Updated 2 years ago
- Simple stochastic weight averaging callback for Keras☆63Updated 3 years ago
- Recursive Leasting Squares (RLS) with Neural Network for fast learning☆53Updated last year
- Shows how to do parameter ensembling using differential evolution.☆10Updated 3 years ago
- This repository shows how to efficiently process variable-length sequences in TensorFlow.☆14Updated 2 years ago
- This repository hosts the code to port NumPy model weights of BiT-ResNets to TensorFlow SavedModel format.☆14Updated 3 years ago
- A convolution-free, transformer-only version of the CycleGAN framework☆33Updated 3 years ago
- TensorFlow implementation of involution.☆13Updated 3 years ago
- Tensorflow 2.0 implementation of STAR RNN☆10Updated 4 years ago
- Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)☆50Updated 2 weeks ago
- Contains code to demonstrate distributed training in TensorFlow 2 with AI Platform and custom Docker contains.☆20Updated 3 years ago
- This repository demonstrates how to use TensorFlow based SegFormer model in 🤗 transformers package.☆30Updated 2 years ago