Alternatives and similar repositories for modulax:

Users that are interested in modulax are comparing it to the libraries listed below

• evanatyourservice / psgd_jax
  Implementation of PSGD optimizer in JAX
  ☆26Updated 2 weeks ago
• davisyoshida / haiku-mup
  A port of muP to JAX/Haiku
  ☆25Updated 2 years ago
• evanatyourservice / kron_torch
  An implementation of PSGD Kron second-order optimizer for PyTorch
  ☆21Updated 2 weeks ago
• johnryan465 / pscan
  ☆37Updated last year
• dlwh / jax_sourceror
  Turn jitted jax functions back into python source code
  ☆22Updated last month
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• Z-T-WANG / LaProp-Optimizer
  Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"
  ☆26Updated 4 years ago
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆75Updated last month
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆34Updated last year
• shikaiqiu / compute-better-spent
  ☆50Updated 3 months ago
• davisyoshida / qax
  If it quacks like a tensor...
  ☆55Updated 2 months ago
• opooladz / Preconditioned-Stochastic-Gradient-Descent
  A repo based on XiLin Li's PSGD repo that extends some of the experiments.
  ☆14Updated 3 months ago
• cloneofsimo / zeroshampoo
  ☆33Updated 4 months ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆146Updated last month
• cgarciae / einop
  ☆58Updated 2 years ago
• AndPotap / einsum-search
  ☆29Updated 3 months ago
• google-deepmind / spectral_ssm
  ☆31Updated 9 months ago
• BirkhoffG / jax-dataloader
  Pytorch-like dataloaders in JAX.
  ☆67Updated 3 months ago
• jopetty / word-problem
  Experiments on the impact of depth in transformers and SSMs.
  ☆21Updated 2 months ago
• ethansmith2000 / TransformerExperiments
  ☆19Updated 3 months ago
• crowsonkb / dice-mc
  DiCE: The Infinitely Differentiable Monte-Carlo Estimator
  ☆31Updated last year
• davisyoshida / lorax
  LoRA for arbitrary JAX models and functions
  ☆135Updated 10 months ago
• tobiaskatsch / GatedLinearRNN
  ☆26Updated 10 months ago
• young-geng / scalax
  A simple library for scaling up JAX programs
  ☆129Updated 2 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆74Updated 11 months ago
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆28Updated 2 months ago
• yixiaoer / einshard
  Einsum-like high-level array sharding API for JAX
  ☆33Updated 6 months ago
• modula-systems / modula
  🧱 Modula software package
  ☆132Updated this week
• Silent-Zebra / twisted-smc-lm
  ☆24Updated this week
• srush / Tensor-Puzzles-Penzai
  ☆20Updated 8 months ago