tensorflow / kfac

Related projects ⓘ

Alternatives and complementary repositories for kfac

• yaroslavvb / kfac_pytorch
  ☆132Updated 7 years ago
• koz4k / dni-pytorch
  Decoupled Neural Interfaces using Synthetic Gradients for PyTorch
  ☆236Updated 5 years ago
• gbaydin / hypergradient-descent
  Hypergradient descent
  ☆138Updated 5 months ago
• uber-research / intrinsic-dimension
  ☆219Updated 6 years ago
• mariogeiger / hessian
  hessian in pytorch
  ☆185Updated 4 years ago
• renmengye / tensorflow-forward-ad
  Forward-mode Automatic Differentiation for TensorFlow
  ☆140Updated 6 years ago
• google-deepmind / symplectic-gradient-adjustment
  A colab that implements the Symplectic Gradient Adjustment optimizer from "The mechanics of n-player differentiable games"
  ☆153Updated 5 years ago
• ericjang / maml-jax
  Implementation of Model-Agnostic Meta-Learning (MAML) in Jax
  ☆188Updated 2 years ago
• openai / weightnorm
  Example code for Weight Normalization, from "Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Netw…
  ☆365Updated 5 years ago
• ucla-vision / entropy-sgd
  Lua implementation of Entropy-SGD
  ☆81Updated 6 years ago
• alecwangcq / KFAC-Pytorch
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆127Updated 5 years ago
• duvenaud / relax
  Optimizing control variates for black-box gradient estimation
  ☆162Updated 5 years ago
• brain-research / guided-evolutionary-strategies
  Guided Evolutionary Strategies
  ☆264Updated last year
• bamos / setGPU
  Small Python library to automatically set CUDA_VISIBLE_DEVICES to the least loaded device on multi-GPU systems.
  ☆106Updated 2 years ago
• google-deepmind / spectral_inference_networks
  Implementation of Spectral Inference Networks, ICLR 2019
  ☆171Updated 5 years ago
• google / spectral-density
  Hessian spectral density estimation in TF and Jax
  ☆115Updated 4 years ago
• bayesgroup / variational-dropout-sparsifies-dnn
  Sparse Variational Dropout, ICML 2017
  ☆310Updated 4 years ago
• toiaydcdyywlhzvlob / backpack
  This repository is no longer maintained. Check
  ☆82Updated 4 years ago
• juliuskunze / jaxnet
  Concise deep learning for JAX
  ☆184Updated 4 years ago
• jotaf98 / curveball
  Second-order optimiser for deep networks
  ☆76Updated 6 years ago
• Thrandis / EKFAC-pytorch
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆140Updated last year
• eladhoffer / bigBatch
  Code used to generate the results appearing in "Train longer, generalize better: closing the generalization gap in large batch training o…
  ☆148Updated 7 years ago
• amirgholami / anode
  [IJCAI'19, NeurIPS'19] Anode: Unconditionally Accurate Memory-Efficient Gradients for Neural ODEs
  ☆104Updated 4 years ago
• cybertronai / pytorch-sso
  PyTorch-SSO: Scalable Second-Order methods in PyTorch
  ☆141Updated last year
• martius-lab / l4-optimizer
  Code for paper "L4: Practical loss-based stepsize adaptation for deep learning"
  ☆124Updated 5 years ago
• wiseodd / natural-gradients
  Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)
  ☆135Updated 5 years ago
• noahgolmant / pytorch-hessian-eigenthings
  Efficient PyTorch Hessian eigendecomposition tools!
  ☆363Updated 8 months ago
• alecwangcq / EigenDamage-Pytorch
  Code for "EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis" https://arxiv.org/abs/1905.05934
  ☆111Updated 4 years ago
• google-deepmind / mc_gradients
  ☆158Updated 3 months ago
• kirthevasank / nasbot
  Neural Architecture Search with Bayesian Optimisation and Optimal Transport
  ☆133Updated 5 years ago