Alternatives and similar repositories for kfac-pytorch

Users that are interested in kfac-pytorch are comparing it to the libraries listed below

• alecwangcq / KFAC-Pytorch

  View on GitHub
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆132Jul 2, 2019Updated 6 years ago
• amirgholami / adahessian

  View on GitHub
  ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning
  ☆283Feb 27, 2023Updated 2 years ago
• f-dangel / backpack

  View on GitHub
  BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.
  ☆604Nov 28, 2025Updated 2 months ago
• Thrandis / EKFAC-pytorch

  View on GitHub
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆152Jun 22, 2023Updated 2 years ago
• google-deepmind / kfac-jax

  View on GitHub
  Second Order Optimization and Curvature Estimation with K-FAC in JAX.
  ☆311Feb 6, 2026Updated last week
• amirgholami / PyHessian

  View on GitHub
  PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks
  ☆773Jul 10, 2025Updated 7 months ago
• gd-zhang / Weight-Decay

  View on GitHub
  Regularization, Neural Network Training Dynamics
  ☆14Jan 13, 2020Updated 6 years ago
• KordingLab / hilbert-constrained-gradient-descent

  View on GitHub
  Pytorch optimizers implementing Hilbert Constrained Gradient Descent
  ☆19May 9, 2019Updated 6 years ago
• yaroslavvb / kfac_pytorch

  View on GitHub
  ☆135Oct 23, 2017Updated 8 years ago
• Kid-key / MimicNorm

  View on GitHub
  ☆19Jan 27, 2021Updated 5 years ago
• f-dangel / singd

  View on GitHub
  [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)
  ☆24Nov 4, 2024Updated last year
• kunimi00 / ContrastiveSSLMusicAudio

  View on GitHub
  ☆13Jun 2, 2022Updated 3 years ago
• SirRob1997 / Crowded-Valley---Results

  View on GitHub
  This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"
  ☆184Jul 17, 2021Updated 4 years ago
• hydra-hoard / hydra

  View on GitHub
  A decentralised application that creates high quality machine learning datasets
  ☆13Jan 22, 2019Updated 7 years ago
• LIJUNYI95 / SuperAdam

  View on GitHub
  Official Pytorch Implementation for the paper 'SUPER-ADAM: Faster and Universal Framework of Adaptive Gradients'
  ☆17Jan 12, 2022Updated 4 years ago
• kazukiosawa / pipe-fisher

  View on GitHub
  ☆10Apr 29, 2023Updated 2 years ago
• foxlf823 / DilatedRnn

  View on GitHub
  A PyTorch implement of Dilated RNN
  ☆11Dec 31, 2017Updated 8 years ago
• HKBU-HPML / OMGS-SGD

  View on GitHub
  Layer-wise Sparsification of Distributed Deep Learning
  ☆10Jul 6, 2020Updated 5 years ago
• fKunstner / limitations-empirical-fisher

  View on GitHub
  Limitations of the Empirical Fisher Approximation
  ☆49Mar 3, 2025Updated 11 months ago
• uw-mad-dash / Accordion

  View on GitHub
  Code for reproducing experiments performed for Accoridon
  ☆13Jun 11, 2021Updated 4 years ago
• rwightman / py-lmdb

  View on GitHub
  Universal Python binding for the LMDB 'Lightning' Database
  ☆13Nov 7, 2017Updated 8 years ago
• Chavdarova / LAGAN-Lookahead_Minimax

  View on GitHub
  Source code for "Taming GANs with Lookahead–Minmax", ICLR 2021.
  ☆15Mar 28, 2021Updated 4 years ago
• Lifelong-ML / LASEM

  View on GitHub
  Code for the ICML 2021 paper "Sharing Less is More: Lifelong Learning in Deep Networks with Selective Layer Transfer"
  ☆12Aug 17, 2021Updated 4 years ago
• LongLong-Jing / awesome-unsupervised-learning

  View on GitHub
  awesome unsupervised learning paper list
  ☆12Jan 4, 2018Updated 8 years ago
• lzhangbv / eva

  View on GitHub
  [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation
  ☆12Jul 31, 2023Updated 2 years ago
• modestyachts / cifar-10.2

  View on GitHub
  Host CIFAR-10.2 Data Set
  ☆13Sep 22, 2021Updated 4 years ago
• Kaffaljidhmah2 / SpecDec_pp

  View on GitHub
  Repository for the COLM 2025 paper SpecDec++: Boosting Speculative Decoding via Adaptive Candidate Lengths
  ☆15Jul 10, 2025Updated 7 months ago
• 2prime / OpenBlackBox

  View on GitHub
  ☆12Nov 5, 2019Updated 6 years ago
• Anil-Gaihre / DrTopKSC

  View on GitHub
  ☆14Sep 14, 2021Updated 4 years ago
• lzhangbv / dear_pytorch

  View on GitHub
  [ICDCS 2023] DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining
  ☆12Dec 4, 2023Updated 2 years ago
• wiseodd / last_layer_laplace

  View on GitHub
  Last-layer Laplace approximation code examples
  ☆83Oct 18, 2021Updated 4 years ago
• XuchanBao / linear-ae

  View on GitHub
  ☆13Jul 25, 2024Updated last year
• amitport / EDEN-Distributed-Mean-Estimation

  View on GitHub
  This repository is the official implementation of 'EDEN: Communication-Efficient and Robust Distributed Mean Estimation for Federated Lea…
  ☆14Aug 2, 2022Updated 3 years ago
• Daniil-Selikhanovych / Shampoo_optimizer

  View on GitHub
  Our implementation of Shampoo optimizer based on https://arxiv.org/pdf/1802.09568.pdf
  ☆12Dec 23, 2019Updated 6 years ago
• mttmantovani / zotero-arxiv-doi-retriever

  View on GitHub
  Look for arXiv papers in a Zotero library and find available DOIs of published versions.
  ☆14Apr 11, 2024Updated last year
• xingchenwan / MLRG_DeepCurvature

  View on GitHub
  ☆15Apr 19, 2020Updated 5 years ago
• MengjiaoZhang / DBCL

  View on GitHub
  Code for Double Blind CollaborativeLearning (DBCL)
  ☆14May 14, 2021Updated 4 years ago
• githubharald / analyze_ada_hessian

  View on GitHub
  Analyze AdaHessian optimizer on 2D functions.
  ☆13Aug 13, 2021Updated 4 years ago
• wiseodd / natural-gradients

  View on GitHub
  Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)
  ☆142May 26, 2019Updated 6 years ago