evanatyourservice / kron_torch

Related projects ⓘ

Alternatives and complementary repositories for kron_torch

• cloneofsimo / zeroshampoo
  ☆31Updated 2 months ago
• ClashLuke / HeavyBall
  Efficient optimizers
  ☆58Updated this week
• ethansmith2000 / TransformerExperiments
  ☆18Updated last month
• crowsonkb / torch-dist-utils
  Utilities for PyTorch distributed
  ☆23Updated last year
• crowsonkb / jax-wavelets
  The 2D discrete wavelet transform for JAX
  ☆38Updated last year
• nikhilvyas / SOAP
  ☆121Updated this week
• gisilvs / AEF
  ☆33Updated last year
• matthias-wright / jax-fid
  FID computation in Jax/Flax.
  ☆24Updated 3 months ago
• layer6ai-labs / calo-forest
  A scalable implementation of diffusion and flow-matching with XGBoost models, applied to calorimeter data.
  ☆17Updated last week
• opooladz / Preconditioned-Stochastic-Gradient-Descent
  A repo based on XiLin Li's PSGD repo that extends some of the experiments.
  ☆14Updated last month
• jxbz / modula
  Scalable neural net training via automatic normalization in the modular norm.
  ☆119Updated 2 months ago
• f-dangel / sirfshampoo
  [ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)
  ☆13Updated last week
• thecharlieblake / lovely-llama
  An implementation of the Llama architecture, to instruct and delight
  ☆21Updated 2 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆71Updated 9 months ago
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆31Updated last year
• cloneofsimo / ezmup
  Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam
  ☆69Updated 3 months ago
• crowsonkb / dice-mc
  DiCE: The Infinitely Differentiable Monte-Carlo Estimator
  ☆30Updated last year
• tobiaskatsch / GatedLinearRNN
  ☆23Updated 8 months ago
• ClashLuke / SOAP
  ☆19Updated this week
• GallagherCommaJack / modulax
  ☆16Updated 2 months ago
• cloneofsimo / efae
  ☆21Updated 4 months ago
• cloneofsimo / karras-power-ema-tutorial
  ☆50Updated 10 months ago
• f-dangel / vivit
  [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…
  ☆17Updated last year
• shikaiqiu / compute-better-spent
  ☆46Updated last month
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆51Updated last month
• apple / ml-ademamix
  ☆46Updated last month
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆35Updated 3 months ago
• Newbeeer / Anytime-Auto-Regressive-Model
  Code for ICLR 2021 Paper, "Anytime Sampling for Autoregressive Models via Ordered Autoencoding"
  ☆24Updated last year
• cloneofsimo / min-fsdp
  ☆72Updated 4 months ago