google / learned_optimizationLinks
☆783Updated 2 months ago
Alternatives and similar repositories for learned_optimization
Users that are interested in learned_optimization are comparing it to the libraries listed below
Sorting:
- Code for our NeurIPS 2022 paper☆369Updated 2 years ago
- TensorDict is a pytorch dedicated tensor container.☆955Updated 2 weeks ago
- Advanced evolutionary computation library built directly on top of PyTorch, created at NNAISENSE.☆1,080Updated 3 weeks ago
- ML Collections is a library of Python Collections designed for ML use cases.☆974Updated this week
- maximal update parametrization (µP)☆1,590Updated last year
- functorch is JAX-like composable function transforms for PyTorch.☆1,437Updated last week
- MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…☆391Updated this week
- A library to inspect and extract intermediate layers of PyTorch models.☆473Updated 3 years ago
- Tensors, for human consumption☆1,285Updated 2 months ago
- TorchOpt is an efficient library for differentiable optimization built upon PyTorch.☆612Updated 3 weeks ago
- For optimization algorithm research and development.☆532Updated this week
- Cockpit: A Practical Debugging Tool for Training Deep Neural Networks☆479Updated 3 years ago
- Named tensors with first-class dimensions for PyTorch☆331Updated 2 years ago
- Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.☆1,439Updated 4 months ago
- ☆880Updated last week
- Optax is a gradient processing and optimization library for JAX.☆1,992Updated last week
- D-Adaptation for SGD, Adam and AdaGrad☆523Updated 7 months ago
- ☆350Updated last week
- Type annotations and runtime checking for shape and dtype of JAX/NumPy/PyTorch/etc. arrays. https://docs.kidger.site/jaxtyping/☆1,516Updated 4 months ago
- A platform for managing machine learning experiments☆869Updated last week
- The merlin dataloader lets you rapidly load tabular data for training deep leaning models with TensorFlow, PyTorch or JAX☆420Updated last year
- 🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch☆2,157Updated 9 months ago
- Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory☆437Updated last year
- The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”☆967Updated last year
- Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"☆379Updated 2 years ago
- Cramming the training of a (BERT-type) language model into limited compute.☆1,346Updated last year
- Implementation of https://srush.github.io/annotated-s4☆500Updated 2 months ago
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆236Updated last week
- Code release for "Git Re-Basin: Merging Models modulo Permutation Symmetries"☆487Updated 2 years ago
- The WeightWatcher tool for predicting the accuracy of Deep Neural Networks☆1,649Updated 2 months ago