Alternatives and similar repositories for transformer_shmap

Users that are interested in transformer_shmap are comparing it to the libraries listed below

• google-deepmind / jmp
  JMP is a Mixed Precision library for JAX.
  ☆210Updated 11 months ago
• young-geng / scalax
  A simple library for scaling up JAX programs
  ☆144Updated 2 months ago
• dlwh / jax_sourceror
  Turn jitted jax functions back into python source code
  ☆23Updated last year
• irhum / esmjax
  ESM2 protein language models in JAX/Flax
  ☆17Updated 3 years ago
• jax-ml / jax-llm-examples
  Minimal yet performant LLM examples in pure JAX
  ☆225Updated this week
• openxla / tokamax
  Tokamax: A GPU and TPU kernel library.
  ☆149Updated last week
• davisyoshida / lorax
  LoRA for arbitrary JAX models and functions
  ☆143Updated last year
• phlippe / jax_trainer
  Lightning-like training API for JAX with Flax
  ☆45Updated last year
• yixiaoer / einshard
  Einsum-like high-level array sharding API for JAX
  ☆34Updated last year
• BirkhoffG / jax-dataloader
  Pytorch-like dataloaders for JAX.
  ☆97Updated 3 weeks ago
• erfanzar / jax-flash-attn2
  A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/…
  ☆33Updated 10 months ago
• jax-ml / jax-triton
  jax-triton contains integrations between JAX and OpenAI Triton
  ☆435Updated 3 weeks ago
• ayaka14732 / jax-smi
  JAX Synergistic Memory Inspector
  ☆183Updated last year
• google-deepmind / jaxline
  ☆162Updated 2 years ago
• proger / nanokitchen
  Parallel Associative Scan for Language Models
  ☆18Updated 2 years ago
• jenkspt / gpt-jax
  Jax/Flax rewrite of Karpathy's nanoGPT
  ☆62Updated 2 years ago
• nestordemeure / jochastic
  A JAX implementation of stochastic addition.
  ☆14Updated 3 years ago
• marin-community / haliax
  Named Tensors for Legible Deep Learning in JAX
  ☆215Updated 2 months ago
• google-deepmind / tf2jax
  ☆118Updated 3 weeks ago
• yixiaoer / mistral-v0.2-jax
  JAX implementation of the Mistral 7b v0.2 model
  ☆35Updated last year
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆133Updated 5 months ago
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆169Updated 5 months ago
• AakashKumarNain / mistral_jax
  This is a port of Mistral-7B model in JAX
  ☆32Updated last year
• lucidrains / flash-attention-jax
  Implementation of Flash Attention in Jax
  ☆223Updated last year
• google-deepmind / kfac-jax
  Second Order Optimization and Curvature Estimation with K-FAC in JAX.
  ☆303Updated 3 weeks ago
• JesseFarebro / flax-mup
  Maximal Update Parametrization (μP) with Flax & Optax.
  ☆16Updated 2 years ago
• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆210Updated 2 years ago
• cgarciae / ciclo
  A functional training loops library for JAX
  ☆88Updated last year
• ludwigwinkler / JaxLightning
  Running Jax in PyTorch Lightning
  ☆118Updated last year
• jax-ml / bonsai
  Minimal, lightweight JAX implementations of popular models.
  ☆175Updated last week