Alternatives and similar repositories for modulax

Users that are interested in modulax are comparing it to the libraries listed below

• davisyoshida / haiku-mup
  A port of muP to JAX/Haiku
  ☆25Updated 3 years ago
• glassroom / heinsen_sequence
  Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)
  ☆98Updated last year
• AndPotap / einsum-search
  ☆33Updated last year
• davisyoshida / lorax
  LoRA for arbitrary JAX models and functions
  ☆144Updated last year
• dlwh / jax_sourceror
  Turn jitted jax functions back into python source code
  ☆23Updated last year
• johnryan465 / pscan
  ☆40Updated 2 years ago
• bhoov / energy-transformer-jax
  The Energy Transformer block, in JAX
  ☆63Updated 2 years ago
• anh-tong / nanoGPT-equinox
  nanoGPT using Equinox
  ☆15Updated 2 years ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆190Updated 3 weeks ago
• davisyoshida / qax
  If it quacks like a tensor...
  ☆59Updated last year
• evanatyourservice / psgd_jax
  Implementation of PSGD optimizer in JAX
  ☆35Updated last year
• JesseFarebro / flax-mup
  Maximal Update Parametrization (μP) with Flax & Optax.
  ☆16Updated 2 years ago
• young-geng / scalax
  A simple library for scaling up JAX programs
  ☆145Updated 3 months ago
• shikaiqiu / compute-better-spent
  ☆62Updated last year
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆92Updated 2 years ago
• jenkspt / gpt-jax
  Jax/Flax rewrite of Karpathy's nanoGPT
  ☆63Updated 2 years ago
• dvruette / barrel-rec-pytorch
  ☆53Updated 2 years ago
• yixiaoer / einshard
  Einsum-like high-level array sharding API for JAX
  ☆34Updated last year
• cgarciae / ciclo
  A functional training loops library for JAX
  ☆88Updated last year
• google-deepmind / neural_networks_solomonoff_induction
  Learning Universal Predictors
  ☆81Updated last year
• cgarciae / einop
  ☆60Updated 3 years ago
• lindermanlab / elk
  Scalable and Stable Parallelization of Nonlinear RNNS
  ☆28Updated 3 months ago
• opooladz / Preconditioned-Stochastic-Gradient-Descent
  A repo based on XiLin Li's PSGD repo that extends some of the experiments.
  ☆14Updated last year
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆84Updated last year
• nestordemeure / jochastic
  A JAX implementation of stochastic addition.
  ☆14Updated 3 years ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆92Updated last year
• yixiaoer / mistral-v0.2-jax
  JAX implementation of the Mistral 7b v0.2 model
  ☆35Updated last year
• proger / nanokitchen
  Parallel Associative Scan for Language Models
  ☆18Updated 2 years ago
• j-towns / scanagram
  Tidy autoregressive inference in JAX
  ☆15Updated 5 months ago
• ethansmith2000 / TransformerExperiments
  ☆19Updated 2 months ago