google-deepmind / nanodo

Related projects: ⓘ

• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆129Updated 2 months ago
• stanford-crfm / levanter
  Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
  ☆492Updated this week
• young-geng / scalax
  A simple library for scaling up JAX programs
  ☆116Updated last month
• jxbz / modula
  Scalable neural net training via automatic normalization in the modular norm.
  ☆108Updated 3 weeks ago
• rwitten / HighPerfLLMs2024
  ☆201Updated 2 months ago
• davisyoshida / lorax
  LoRA for arbitrary JAX models and functions
  ☆127Updated 6 months ago
• HMUNACHI / nanodl
  A Jax-based library for designing and training transformer models from scratch.
  ☆271Updated 3 weeks ago
• imbue-ai / carbs
  Cost aware hyperparameter tuning algorithm
  ☆95Updated 2 months ago
• ayaka14732 / jax-smi
  JAX Synergistic Memory Inspector
  ☆161Updated 2 months ago
• stanford-crfm / haliax
  Named Tensors for Legible Deep Learning in JAX
  ☆146Updated this week
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆84Updated 4 months ago
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆151Updated 3 weeks ago
• google / grain
  ☆253Updated this week
• google-research / jaxpruner
  ☆202Updated 4 months ago
• samuela / torch2jax
  Run PyTorch in JAX. 🤝
  ☆187Updated 10 months ago
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆156Updated 4 months ago
• NVIDIA / JAX-Toolbox
  JAX-Toolbox
  ☆231Updated this week
• kvfrans / jax-diffusion-transformer
  Implementation of Diffusion Transformer (DiT) in JAX
  ☆245Updated 3 months ago
• google / orbax
  Orbax provides common checkpointing and persistence utilities for JAX users
  ☆283Updated this week
• jenkspt / gpt-jax
  Jax/Flax rewrite of Karpathy's nanoGPT
  ☆46Updated last year
• srush / Autodiff-Puzzles
  ☆325Updated 11 months ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆110Updated 5 months ago
• google-deepmind / synjax
  ☆238Updated 2 weeks ago
• fferflo / einx
  Universal Tensor Operations in Einstein-Inspired Notation for Python.
  ☆314Updated last month
• ayaka14732 / llama-2-jax
  JAX implementation of the Llama 2 model
  ☆205Updated 7 months ago
• Sea-Snell / JAX_llama
  Inference code for LLaMA models in JAX
  ☆108Updated 3 months ago
• google-deepmind / jmp
  JMP is a Mixed Precision library for JAX.
  ☆183Updated 3 months ago
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆293Updated last year
• mlcommons / algorithmic-efficiency
  MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…
  ☆321Updated 2 weeks ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆94Updated 2 weeks ago