Alternatives and similar repositories for scaling-book:

Users that are interested in scaling-book are comparing it to the libraries listed below

• google-deepmind / nanodo
  ☆217Updated 9 months ago
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆155Updated last month
• jax-ml / jax-llm-examples
  ☆109Updated this week
• jax-ml / jax-triton
  jax-triton contains integrations between JAX and OpenAI Triton
  ☆393Updated last week
• modula-systems / modula
  🧱 Modula software package
  ☆188Updated last month
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆131Updated last year
• stanford-crfm / levanter
  Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
  ☆569Updated this week
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆536Updated this week
• stanford-crfm / haliax
  Named Tensors for Legible Deep Learning in JAX
  ☆172Updated last week
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆180Updated this week
• rwitten / HighPerfLLMs2024
  ☆450Updated 9 months ago
• jax-ml / jax-ai-stack
  ☆166Updated this week
• huggingface / picotron_tutorial
  ☆184Updated 2 months ago
• google / aqt
  ☆297Updated last week
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆346Updated 2 years ago
• google / praxis
  ☆186Updated last week
• srush / Autodiff-Puzzles
  ☆431Updated 6 months ago
• jax-ml / ml_dtypes
  A stand-alone implementation of several NumPy dtype extensions used in machine learning.
  ☆261Updated this week
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆182Updated 8 months ago
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆252Updated this week
• imbue-ai / carbs
  Cost aware hyperparameter tuning algorithm
  ☆151Updated 10 months ago
• fferflo / einx
  Universal Tensor Operations in Einstein-Inspired Notation for Python.
  ☆369Updated last month
• gpu-mode / ring-attention
  ring-attention experiments
  ☆140Updated 6 months ago
• young-geng / scalax
  A simple library for scaling up JAX programs
  ☆134Updated 6 months ago
• google / orbax
  Orbax provides common checkpointing and persistence utilities for JAX users
  ☆376Updated this week
• Deep-Learning-Profiling-Tools / triton-viz
  ☆202Updated 2 weeks ago
• nshepperd / flash_attn_jax
  JAX bindings for Flash Attention v2
  ☆89Updated 9 months ago
• NVIDIA / JAX-Toolbox
  JAX-Toolbox
  ☆301Updated this week
• mlcommons / algorithmic-efficiency
  MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…
  ☆380Updated this week
• samuela / torch2jax
  Run PyTorch in JAX. 🤝
  ☆240Updated 2 months ago