shreyansh26 / ML-Optimizers-JAXLinks
Toy implementations of some popular ML optimizers using Python/JAX
☆44Updated 4 years ago
Alternatives and similar repositories for ML-Optimizers-JAX
Users that are interested in ML-Optimizers-JAX are comparing it to the libraries listed below
Sorting:
- a lightweight transformer library for PyTorch☆72Updated 3 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆79Updated 4 years ago
- ☆85Updated 4 years ago
- Framework-agnostic library for checking array/tensor shapes at runtime.☆46Updated 4 years ago
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆114Updated 3 years ago
- A lightweight library for tensorflow 2.0☆66Updated 5 years ago
- Loss Patterns of Neural Networks☆86Updated 4 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆53Updated 4 years ago
- ☆42Updated 5 years ago
- A GPT, made only of MLPs, in Jax☆58Updated 4 years ago
- Pretrained TorchVision models on CIFAR10 dataset (with weights)☆24Updated 5 years ago
- EfficientNet, MobileNetV3, MobileNetV2, MixNet, etc in JAX w/ Flax Linen and Objax☆128Updated last year
- Some small scale experiments for my blog posts 📝☆79Updated 3 years ago
- ☆104Updated 4 years ago
- Minimal implementation of adaptive gradient clipping (https://arxiv.org/abs/2102.06171) in TensorFlow 2.☆85Updated 4 years ago
- A collection of optimizers, some arcane others well known, for Flax.☆29Updated 4 years ago
- A simple implementation of a deep linear Pytorch module☆21Updated 5 years ago
- A simple Transformer where the softmax has been replaced with normalization☆20Updated 5 years ago
- ☆71Updated last year
- A selection of neural network models ported from torchvision for JAX & Flax.☆44Updated 3 months ago
- An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain☆34Updated 4 years ago
- JAX implementation of Learning to learn by gradient descent by gradient descent☆28Updated 2 months ago
- Usable implementation of Emerging Symbol Binding Network (ESBN), in Pytorch☆25Updated 4 years ago
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆49Updated 3 years ago
- Notebook for comprehensive analysis of authors, organizations, and countries of ICML 2020 papers.☆56Updated 5 years ago
- PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"☆62Updated last year
- Example python package with pybind11 cpp extension☆57Updated 4 years ago
- Yet another mini autodiff system for educational purposes☆30Updated 11 months ago
- An implementation of 2021 paper by Geoffrey Hinton: "How to represent part-whole hierarchies in a neural network" in Pytorch.☆57Updated 4 years ago
- ☆47Updated 4 years ago