Alternatives and similar repositories for tpu-recipes:

Users that are interested in tpu-recipes are comparing it to the libraries listed below

• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆59Updated 3 weeks ago
• google / saxml
  ☆138Updated last week
• cat-state / tinypar
  ☆20Updated last year
• AI-Hypercomputer / xpk
  xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…
  ☆115Updated last week
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆108Updated 3 months ago
• sholtodouglas / multihost_dataloading
  Experimenting with how best to do multi-host dataloading
  ☆10Updated 2 years ago
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆34Updated 5 months ago
• yixiaoer / tpux
  A set of Python scripts that makes your experience on TPU better
  ☆51Updated 9 months ago
• jax-ml / jax-llm-examples
  ☆102Updated this week
• erfanzar / jax-flash-attn2
  A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/…
  ☆23Updated last month
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆123Updated last year
• Sea-Snell / JAX_llama
  Inference code for LLaMA models in JAX
  ☆118Updated 11 months ago
• AI-Hypercomputer / gpu-recipes
  Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.
  ☆56Updated this week
• huggingface / kernels
  Load compute kernels from the Hub
  ☆115Updated this week
• young-geng / mlxu
  Machine Learning eXperiment Utilities
  ☆46Updated 10 months ago
• cloneofsimo / min-fsdp
  ☆78Updated 9 months ago
• alvarobartt / safejax
  Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`
  ☆44Updated 10 months ago
• iwiwi / epochraft
  Checkpointable dataset utilities for foundation model training
  ☆32Updated last year
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆78Updated last year
• warner-benjamin / optimi
  Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers
  ☆92Updated 9 months ago
• IBM / dolomite-engine
  Dolomite Engine is a library for pretraining/finetuning LLMs
  ☆49Updated this week
• lianakoleva / no-libtorch-compile
  ☆21Updated last month
• google-deepmind / asyncdiloco
  ☆43Updated last year
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …
  ☆59Updated 6 months ago
• Jaykef / Triton-nanoGPT
  Custom triton kernels for training Karpathy's nanoGPT.
  ☆18Updated 6 months ago
• fattorib / ZeRO-transformer
  Two implementations of ZeRO-1 optimizer sharding in JAX
  ☆14Updated last year
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated last month
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆49Updated last week
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• google / jaxonnxruntime
  A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.
  ☆109Updated last week