Alternatives and similar repositories for jax_transformer

Users that are interested in jax_transformer are comparing it to the libraries listed below

• davisyoshida / lorax
  LoRA for arbitrary JAX models and functions
  ☆138Updated last year
• cgarciae / nanoGPT-jax
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆33Updated last year
• cgarciae / ciclo
  A functional training loops library for JAX
  ☆88Updated last year
• toshas / torch-discounted-cumsum
  Fast Discounted Cumulative Sums in PyTorch
  ☆96Updated 3 years ago
• mgrankin / minGPT
  minGPT in JAX
  ☆48Updated 3 years ago
• cgarciae / jax_metrics
  A metrics library for the JAX ecosystem
  ☆40Updated 2 years ago
• lucaslingle / mu_transformer
  Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.
  ☆30Updated 3 weeks ago
• BlinkDL / SmallInitEmb
  LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
  ☆59Updated 3 years ago
• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆205Updated last year
• cgarciae / nnx
  Neural Networks for JAX
  ☆84Updated 9 months ago
• NTT123 / pax
  A stateful pytree library for training neural networks.
  ☆22Updated 2 years ago
• andyljones / boardlaw
  Scaling scaling laws with board games.
  ☆49Updated last year
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆83Updated last year
• sholtodouglas / scalingExperiments
  ☆60Updated 3 years ago
• young-geng / mlxu
  Machine Learning eXperiment Utilities
  ☆46Updated last year
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆78Updated 2 years ago
• jax-ml / jax-llm-examples
  ☆126Updated last month
• google-deepmind / tf2jax
  ☆114Updated 3 weeks ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆81Updated 3 years ago
• cgarciae / einop
  ☆60Updated 3 years ago
• alvarobartt / safejax
  Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`
  ☆45Updated last year
• niklexical / brc_pytorch
  Pytorch implementation of bistable recurrent cell with baseline comparisons.
  ☆25Updated last year
• young-geng / scalax
  A simple library for scaling up JAX programs
  ☆139Updated 7 months ago
• cat-state / tinypar
  ☆20Updated last year
• google-deepmind / jmp
  JMP is a Mixed Precision library for JAX.
  ☆203Updated 4 months ago
• 4rtemi5 / imax
  Image augmentation library for Jax
  ☆39Updated last year
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆50Updated last year
• davisyoshida / haiku-mup
  A port of muP to JAX/Haiku
  ☆25Updated 2 years ago
• ayaka14732 / jax-smi
  JAX Synergistic Memory Inspector
  ☆174Updated 11 months ago
• fattorib / transformer_shmap
  Tensor Parallelism with JAX + Shard Map
  ☆11Updated last year