Alternatives and similar repositories for sirfshampoo:

Users that are interested in sirfshampoo are comparing it to the libraries listed below

• f-dangel / vivit
  [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…
  ☆17Updated last year
• f-dangel / singd
  [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)
  ☆21Updated 4 months ago
• peerdavid / layerwise-batch-entropy
  Layerwise Batch Entropy Regularization
  ☆22Updated 2 years ago
• ag1988 / dlr
  The accompanying code for "Simplifying and Understanding State Space Models with Diagonal Linear RNNs" (Ankit Gupta, Harsh Mehta, Jonatha…
  ☆19Updated 2 years ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆169Updated 3 months ago
• gisilvs / AEF
  ☆33Updated 2 years ago
• GallagherCommaJack / modulax
  ☆16Updated 6 months ago
• johnryan465 / pscan
  ☆38Updated last year
• juliagusak / neural-ode-metasolver
  Supplementary code for the paper "Meta-Solver for Neural Ordinary Differential Equations" https://arxiv.org/abs/2103.08561
  ☆24Updated 3 years ago
• tk-rusch / LEM
  Official code for Long Expressive Memory (ICLR 2022, Spotlight)
  ☆69Updated 3 years ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆122Updated last year
• fKunstner / noise-sgd-adam-sign
  ☆16Updated last year
• srush / mamba-scans
  Blog post
  ☆17Updated last year
• sdrobert / pydrobert-pytorch
  PyTorch utilities for ML, specifically speech
  ☆13Updated last year
• lxxue / prefix_sum
  A PyTorch wrapper of parallel exclusive scan in CUDA
  ☆10Updated last year
• akbir / deq-jax
  [NeurIPS'19] Deep Equilibrium Models Jax Implementation
  ☆39Updated 4 years ago
• opooladz / Preconditioned-Stochastic-Gradient-Descent
  A repo based on XiLin Li's PSGD repo that extends some of the experiments.
  ☆14Updated 5 months ago
• f-dangel / curvlinops
  PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)
  ☆34Updated 2 weeks ago
• toshas / torch-householder
  Efficient Householder Transformation in PyTorch
  ☆64Updated 3 years ago
• fKunstner / limitations-empirical-fisher
  Limitations of the Empirical Fisher Approximation
  ☆47Updated 2 weeks ago
• optimizedlearning / mechanic
  ☆36Updated last year
• shikaiqiu / compute-better-spent
  ☆52Updated 5 months ago
• Newbeeer / Anytime-Auto-Regressive-Model
  Code for ICLR 2021 Paper, "Anytime Sampling for Autoregressive Models via Ordered Autoencoding"
  ☆26Updated last year
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆45Updated 2 years ago
• AndPotap / einsum-search
  ☆30Updated 5 months ago
• facebookresearch / semi-discrete-flow
  code for "Semi-Discrete Normalizing Flows through Differentiable Tessellation"
  ☆26Updated 2 years ago
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆63Updated 2 years ago
• ganguli-lab / degrees-of-freedom
  ☆36Updated 3 years ago
• gcambara / cape
  Continuous Augmented Positional Embeddings (CAPE) implementation for PyTorch
  ☆39Updated 2 years ago