tensorflow / kfacLinks
An implementation of KFAC for TensorFlow
☆199Updated 3 years ago
Alternatives and similar repositories for kfac
Users that are interested in kfac are comparing it to the libraries listed below
Sorting:
- ☆135Updated 8 years ago
- hessian in pytorch☆187Updated 5 years ago
- Hypergradient descent☆147Updated last year
- ☆172Updated last year
- A colab that implements the Symplectic Gradient Adjustment optimizer from "The mechanics of n-player differentiable games"☆153Updated 7 years ago
- Forward-mode Automatic Differentiation for TensorFlow☆139Updated 7 years ago
- Optimizing control variates for black-box gradient estimation☆163Updated 6 years ago
- Guided Evolutionary Strategies☆272Updated 2 years ago
- Autoregressive Energy Machines☆78Updated 3 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆148Updated 2 years ago
- Code for experiments regarding importance sampling for training neural networks☆328Updated 4 years ago
- Hessian spectral density estimation in TF and Jax☆124Updated 5 years ago
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆149Updated 2 years ago
- Limitations of the Empirical Fisher Approximation☆49Updated 10 months ago
- Decoupled Neural Interfaces using Synthetic Gradients for PyTorch☆239Updated 6 years ago
- TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".☆60Updated 6 years ago
- Neural Architecture Search with Bayesian Optimisation and Optimal Transport☆135Updated 6 years ago
- Experiments for the paper "Exponential expressivity in deep neural networks through transient chaos"☆74Updated 9 years ago
- Lua implementation of Entropy-SGD☆81Updated 7 years ago
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆109Updated 2 years ago
- Code for NeurIPS 2019 paper: "Tensor Programs I: Wide Feedforward or Recurrent Neural Networks of Any Architecture are Gaussian Processes…☆248Updated 5 years ago
- Probabilistic line search algorithm for stochastic optimization with a TensorFlow interface.☆22Updated 8 years ago
- This repository is no longer maintained. Check☆81Updated 5 years ago
- Regularization, Neural Network Training Dynamics☆14Updated 5 years ago
- ☆219Updated 7 years ago
- Convolutional Neural Tangent Kernel☆112Updated 6 years ago
- Natural Gradient, Variational Inference☆29Updated 5 years ago
- Optimization with orthogonal constraints and on general manifolds☆130Updated 5 years ago
- Sparse Variational Dropout, ICML 2017☆312Updated 5 years ago
- Differentiable bitonic sorting☆141Updated 5 years ago