Alternatives and similar repositories for jax_transformer

Users that are interested in jax_transformer are comparing it to the libraries listed below

• davisyoshida / lorax
  LoRA for arbitrary JAX models and functions
  ☆135Updated last year
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆82Updated last year
• jenkspt / gpt-jax
  Jax/Flax rewrite of Karpathy's nanoGPT
  ☆57Updated 2 years ago
• toshas / torch-discounted-cumsum
  Fast Discounted Cumulative Sums in PyTorch
  ☆95Updated 3 years ago
• alvarobartt / safejax
  Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`
  ☆44Updated 11 months ago
• davisyoshida / haiku-mup
  A port of muP to JAX/Haiku
  ☆25Updated 2 years ago
• mgrankin / minGPT
  minGPT in JAX
  ☆48Updated 3 years ago
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆50Updated last year
• cgarciae / ciclo
  A functional training loops library for JAX
  ☆88Updated last year
• sholtodouglas / scalingExperiments
  ☆59Updated 3 years ago
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆78Updated 2 years ago
• cgarciae / nanoGPT-jax
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆33Updated last year
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆36Updated 2 years ago
• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆204Updated last year
• dylandoblar / noether-networks
  Meta-learning inductive biases in the form of useful conserved quantities.
  ☆37Updated 2 years ago
• cgarciae / nnx
  Neural Networks for JAX
  ☆84Updated 7 months ago
• BlinkDL / SmallInitEmb
  LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
  ☆59Updated 3 years ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆87Updated 11 months ago
• young-geng / mlxu
  Machine Learning eXperiment Utilities
  ☆46Updated 11 months ago
• lucaslingle / mu_transformer
  Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.
  ☆30Updated last week
• cgarciae / treeo
  A small library for creating and manipulating custom JAX Pytree classes
  ☆56Updated 2 years ago
• ColinQiyangLi / AdaCat
  AdaCat
  ☆49Updated 2 years ago
• irregular-rhomboid / EAI-Math-Reading-Group
  Resources from the EleutherAI Math Reading Group
  ☆53Updated 2 months ago
• andyljones / boardlaw
  Scaling scaling laws with board games.
  ☆48Updated last year
• arogozhnikov / adamw_bfloat16
  AdamW optimizer for bfloat16 models in pytorch 🔥.
  ☆32Updated 11 months ago
• anh-tong / nanoGPT-equinox
  nanoGPT using Equinox
  ☆13Updated 2 years ago
• lucidrains / ponder-transformer
  Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper
  ☆81Updated 3 years ago
• srush / torch-golf
  Silly twitter torch implementations.
  ☆46Updated 2 years ago
• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆34Updated 2 years ago
• NTT123 / pax
  A stateful pytree library for training neural networks.
  ☆22Updated 2 years ago