Alternatives and similar repositories for tunix

Users that are interested in tunix are comparing it to the libraries listed below

• jax-ml / jax-llm-examples
  Minimal yet performant LLM examples in pure JAX
  ☆160Updated this week
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆167Updated 2 months ago
• google-deepmind / nanodo
  ☆281Updated last year
• young-geng / scalax
  A simple library for scaling up JAX programs
  ☆143Updated 10 months ago
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆226Updated this week
• marin-community / marin
  Open-source framework for the research and development of foundation models.
  ☆452Updated this week
• yixiaoer / tpux
  A set of Python scripts that makes your experience on TPU better
  ☆54Updated last week
• marin-community / levanter
  Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
  ☆665Updated this week
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆129Updated 9 months ago
• erfanzar / EasyDeL
  Accelerate, Optimize performance with streamlined training and serving options with JAX.
  ☆311Updated this week
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆162Updated 3 months ago
• google / praxis
  ☆187Updated 3 weeks ago
• huggingface / kernels
  Load compute kernels from the Hub
  ☆287Updated this week
• young-geng / mlxu
  Machine Learning eXperiment Utilities
  ☆47Updated last month
• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆72Updated last week
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆35Updated 3 weeks ago
• m-a-n-i-f-e-s-t / power-attention
  Attention Kernels for Symmetric Power Transformers
  ☆115Updated 3 weeks ago
• nebius / kvax
  A FlashAttention implementation for JAX with support for efficient document mask computation and context parallelism.
  ☆141Updated 5 months ago
• nshepperd / flash_attn_jax
  JAX bindings for Flash Attention v2
  ☆91Updated 2 weeks ago
• jax-ml / jax-triton
  jax-triton contains integrations between JAX and OpenAI Triton
  ☆424Updated 3 weeks ago
• modula-systems / modula
  🧱 Modula software package
  ☆239Updated last month
• marin-community / haliax
  Named Tensors for Legible Deep Learning in JAX
  ☆203Updated last week
• NVIDIA / JAX-Toolbox
  JAX-Toolbox
  ☆340Updated this week
• ayaka14732 / llama-2-jax
  JAX implementation of the Llama 2 model
  ☆219Updated last year
• Sea-Snell / JAX_llama
  Inference code for LLaMA models in JAX
  ☆120Updated last year
• huggingface / picotron_tutorial
  ☆220Updated 7 months ago
• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆209Updated last year
• davisyoshida / lorax
  LoRA for arbitrary JAX models and functions
  ☆142Updated last year
• ServiceNow / PipelineRL
  A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
  ☆140Updated 2 weeks ago
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆268Updated 2 months ago