[ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)
☆24Nov 4, 2024Updated last year
Alternatives and similar repositories for singd
Users that are interested in singd are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Posterior Refinement Improves Sample Efficiency in Bayesian Neural Networks☆11Oct 21, 2022Updated 3 years ago
- [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…☆17Jul 19, 2023Updated 3 years ago
- PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)☆69Jul 17, 2026Updated 3 weeks ago
- ☆16Apr 26, 2023Updated 3 years ago
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆192Dec 5, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Limitations of the Empirical Fisher Approximation☆48Mar 3, 2025Updated last year
- Probabilistic ODE solvers are fun, but are they fast? See also: https://github.com/pnkraemer/probdiffeq for JAX code or https://github.c…☆22Jul 20, 2024Updated 2 years ago
- Code for "Accelerating Natural Gradient with Higher-Order Invariance"☆30Jun 28, 2019Updated 7 years ago
- BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.☆616Jul 17, 2026Updated 3 weeks ago
- Integrals of Gaussians under linear domain constraints☆15Feb 27, 2020Updated 6 years ago
- ☆24Mar 1, 2022Updated 4 years ago
- MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…☆424May 11, 2026Updated 3 months ago
- Large-batch Training, Neural Network Optimization☆10Nov 8, 2019Updated 6 years ago
- This code accompanies the manuscript "A Generative Framework for Probabilistic, Spatiotemporally Coherent Downscaling of Climate Simulati…☆37Jul 21, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆10Apr 5, 2024Updated 2 years ago
- ☆10Jun 13, 2022Updated 4 years ago
- Backward-filtering forward-guiding with StochasticDiffEq.jl☆12Feb 23, 2024Updated 2 years ago
- Influence Functions with (Eigenvalue-corrected) Kronecker-Factored Approximate Curvature☆198May 23, 2026Updated 2 months ago
- Efficient SDE samplers including Gaussian-based probabilistic solvers. Written in JAX.☆10Feb 8, 2025Updated last year
- A simple and efficient baseline for data attribution☆11Nov 10, 2023Updated 2 years ago
- ☆92Aug 6, 2026Updated last week
- A package for computing matrix exponentials and finite horizon Gramians☆11Jan 21, 2026Updated 6 months ago
- code related to "UNSURE: Unknown Noise level Stein's Unbiased Risk Estimator" by Tachella, Davies and Jacques☆13Nov 21, 2025Updated 8 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Code accompanying the NeurIPS 2021 Paper: A Probabilistic State Space Model for Joint Inference from Differential Equations and Data (Sch…☆13Nov 7, 2022Updated 3 years ago
- ☆34Jul 9, 2026Updated last month
- Official PyTorch implementation of CD-MOE☆12Mar 18, 2026Updated 4 months ago
- Chirp instantaneous frequency estimation using stochastic differential equation Gaussian processes☆13Oct 30, 2024Updated last year
- Distributed K-FAC preconditioner for PyTorch☆98Updated this week
- Laplace approximations for Deep Learning.☆550Apr 22, 2025Updated last year
- LLM benchmarks☆13Feb 22, 2024Updated 2 years ago
- An implementation of a Brownian motion using ClojureScript with re-frame and Highcharts☆11Feb 8, 2019Updated 7 years ago
- Pytorch implementation of our paper accepted by ICML 2023 -- "Bi-directional Masks for Efficient N:M Sparse Training"☆14Jun 7, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning☆288Feb 27, 2023Updated 3 years ago
- ☆13May 22, 2025Updated last year
- This repository is no longer maintained. Check☆81Apr 23, 2020Updated 6 years ago
- Marginal distributions and Markov kernels that play nice with each other for the purpose of Bayesian state estimation.☆18Oct 22, 2025Updated 9 months ago
- Building the Bi-LSTM & the CNN-GAN models to compose Classical Music in different eras☆12Aug 2, 2021Updated 5 years ago
- Contains code for the NeurIPS 2020 paper by Pan et al., "Continual Deep Learning by FunctionalRegularisation of Memorable Past"☆44Nov 10, 2020Updated 5 years ago
- coloring terminal text with intensities (used for plotting probability, entropy with tokens)☆12Oct 11, 2024Updated last year