facebookresearch / ppuda
Code for Parameter Prediction for Unseen Deep Architectures (NeurIPS 2021)
☆483Updated last year
Related projects ⓘ
Alternatives and complementary repositories for ppuda
- Code for Neural Architecture Search without Training (ICML 2021)☆460Updated 3 years ago
- This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"☆180Updated 3 years ago
- End-to-end training of sparse deep neural networks with little-to-no performance loss.☆317Updated last year
- Naszilla is a Python library for neural architecture search (NAS)☆304Updated last year
- Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities☆208Updated 6 months ago
- Cockpit: A Practical Debugging Tool for Training Deep Neural Networks☆474Updated 2 years ago
- Code to reproduce the results in the FAIR research papers "Semi-Supervised Learning of Visual Features by Non-Parametrically Predicting V…☆487Updated last year
- ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning☆265Updated last year
- Official code for the Stochastic Polyak step-size optimizer☆137Updated 4 months ago
- Is the attention layer even necessary? (https://arxiv.org/abs/2105.02723)☆480Updated 3 years ago
- ☆466Updated 3 months ago
- A library to inspect and extract intermediate layers of PyTorch models.☆470Updated 2 years ago
- Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch☆247Updated 2 years ago
- ☆362Updated last year
- Betty: an automatic differentiation library for generalized meta-learning and multilevel optimization☆332Updated 4 months ago
- Gradient based Hyperparameter Tuning library in PyTorch☆288Updated 4 years ago
- ☆565Updated 2 weeks ago
- EfficientNet, MobileNetV3, MobileNetV2, MixNet, etc in JAX w/ Flax Linen and Objax☆127Updated 10 months ago
- Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable☆211Updated 3 years ago
- Unofficial JAX implementations of deep learning research papers☆151Updated 2 years ago
- Official codebase for Pretrained Transformers as Universal Computation Engines.☆244Updated 2 years ago
- [Prototype] Tools for the concurrent manipulation of variably sized Tensors.☆253Updated last year
- Ranger deep learning optimizer rewrite to use newest components☆322Updated 8 months ago
- Lightweight Hyperparameter Optimization 🚂☆145Updated 2 months ago
- BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.☆561Updated 6 months ago
- NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/☆345Updated 9 months ago
- Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions☆258Updated last year
- ☆294Updated 4 months ago
- ☆218Updated 3 months ago
- Transformer based on a variant of attention that is linear complexity in respect to sequence length☆695Updated 6 months ago