google / learned_optimizationLinks
☆781Updated 3 weeks ago
Alternatives and similar repositories for learned_optimization
Users that are interested in learned_optimization are comparing it to the libraries listed below
Sorting:
- Tensors, for human consumption☆1,257Updated last week
- TensorDict is a pytorch dedicated tensor container.☆931Updated this week
- functorch is JAX-like composable function transforms for PyTorch.☆1,432Updated this week
- MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…☆384Updated this week
- Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory☆437Updated 10 months ago
- For optimization algorithm research and development.☆520Updated this week
- Code for our NeurIPS 2022 paper☆368Updated 2 years ago
- ML Collections is a library of Python Collections designed for ML use cases.☆960Updated 2 months ago
- TorchOpt is an efficient library for differentiable optimization built upon PyTorch.☆597Updated 3 weeks ago
- The merlin dataloader lets you rapidly load tabular data for training deep leaning models with TensorFlow, PyTorch or JAX☆418Updated last year
- CLU lets you write beautiful training loops in JAX.☆349Updated last week
- torchview: visualize pytorch models☆957Updated last month
- ☆863Updated 3 weeks ago
- maximal update parametrization (µP)☆1,549Updated 11 months ago
- Named tensors with first-class dimensions for PyTorch☆332Updated 2 years ago
- Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.☆380Updated last year
- A library to inspect and extract intermediate layers of PyTorch models.☆473Updated 3 years ago
- Advanced evolutionary computation library built directly on top of PyTorch, created at NNAISENSE.☆1,066Updated last week
- Optax is a gradient processing and optimization library for JAX.☆1,924Updated this week
- ☆350Updated this week
- 🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch☆2,143Updated 7 months ago
- Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.☆1,431Updated last month
- JAX - A curated list of resources https://github.com/google/jax☆1,845Updated 4 months ago
- D-Adaptation for SGD, Adam and AdaGrad☆522Updated 5 months ago
- Type annotations and runtime checking for shape and dtype of JAX/NumPy/PyTorch/etc. arrays. https://docs.kidger.site/jaxtyping/☆1,454Updated 2 months ago
- Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch☆699Updated 7 months ago
- Implementation of https://srush.github.io/annotated-s4☆499Updated last week
- Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch☆252Updated 2 years ago
- Annotated version of the Mamba paper☆485Updated last year
- Code release for "Git Re-Basin: Merging Models modulo Permutation Symmetries"☆480Updated 2 years ago