tensorflow / kfac
An implementation of KFAC for TensorFlow
☆198Updated 3 years ago
Alternatives and similar repositories for kfac:
Users that are interested in kfac are comparing it to the libraries listed below
- ☆132Updated 7 years ago
- Forward-mode Automatic Differentiation for TensorFlow☆140Updated 6 years ago
- A colab that implements the Symplectic Gradient Adjustment optimizer from "The mechanics of n-player differentiable games"☆154Updated 6 years ago
- Hypergradient descent☆145Updated 8 months ago
- ☆219Updated 6 years ago
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆130Updated 5 years ago
- hessian in pytorch☆186Updated 4 years ago
- Guided Evolutionary Strategies☆268Updated last year
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆141Updated last year
- Optimizing control variates for black-box gradient estimation☆162Updated 5 years ago
- Lua implementation of Entropy-SGD☆81Updated 6 years ago
- Small Python library to automatically set CUDA_VISIBLE_DEVICES to the least loaded device on multi-GPU systems.☆106Updated 2 years ago
- Implementation of Spectral Inference Networks, ICLR 2019☆171Updated 5 years ago
- This repository is no longer maintained. Check☆81Updated 4 years ago
- ☆164Updated 6 months ago
- Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)☆136Updated 5 years ago
- Hessian spectral density estimation in TF and Jax☆121Updated 4 years ago
- ☆82Updated 5 years ago
- Decoupled Neural Interfaces using Synthetic Gradients for PyTorch☆236Updated 6 years ago
- TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".☆60Updated 6 years ago
- Example code for the paper "Understanding deep learning requires rethinking generalization"☆177Updated 4 years ago
- Implementation of Model-Agnostic Meta-Learning (MAML) in Jax☆188Updated 2 years ago
- Code used to generate the results appearing in "Train longer, generalize better: closing the generalization gap in large batch training o…☆148Updated 7 years ago
- Differentiable bitonic sorting☆138Updated 4 years ago
- Optimization with orthogonal constraints and on general manifolds☆127Updated 4 years ago
- Concise deep learning for JAX☆184Updated 4 years ago
- Experiments for the paper "Exponential expressivity in deep neural networks through transient chaos"☆70Updated 8 years ago
- Second-order optimiser for deep networks☆76Updated 6 years ago
- Original PyTorch implementation of the Leap meta-learner (https://arxiv.org/abs/1812.01054) along with code for running the Omniglot expe…☆148Updated last year
- Code for paper "L4: Practical loss-based stepsize adaptation for deep learning"☆124Updated 5 years ago