srush / Autodiff-Puzzles

Related projects ⓘ

Alternatives and complementary repositories for Autodiff-Puzzles

• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆325Updated last year
• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆903Updated 10 months ago
• srush / raspy
  An interactive exploration of Transformer programming.
  ☆246Updated last year
• google-deepmind / nanodo
  ☆197Updated 4 months ago
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆449Updated this week
• stanford-crfm / levanter
  Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
  ☆516Updated this week
• srush / GPTWorld
  A puzzle to learn about prompting
  ☆121Updated last year
• mlcommons / algorithmic-efficiency
  MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…
  ☆333Updated 3 weeks ago
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,135Updated this week
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆457Updated 8 months ago
• HMUNACHI / nanodl
  A Jax-based library for designing and training transformer models from scratch.
  ☆276Updated 2 months ago
• wilson-labs / cola
  Compositional Linear Algebra
  ☆432Updated 3 weeks ago
• jxbz / modula
  Scalable neural net training via automatic normalization in the modular norm.
  ☆121Updated 3 months ago
• dshah3 / GPU-Puzzles
  Solve puzzles. Learn CUDA.
  ☆61Updated 11 months ago
• facebookresearch / torchdim
  Named tensors with first-class dimensions for PyTorch
  ☆322Updated last year
• rwitten / HighPerfLLMs2024
  ☆224Updated 4 months ago
• fferflo / einx
  Universal Tensor Operations in Einstein-Inspired Notation for Python.
  ☆328Updated last month
• callummcdougall / ARENA_2.0
  Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.
  ☆200Updated 9 months ago
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆483Updated 3 weeks ago
• kvfrans / jax-diffusion-transformer
  Implementation of Diffusion Transformer (DiT) in JAX
  ☆252Updated 5 months ago
• google / grain
  ☆303Updated this week
• thomasahle / tensorgrad
  Tensor Network Library with Autograd
  ☆148Updated 2 weeks ago
• stanford-crfm / haliax
  Named Tensors for Legible Deep Learning in JAX
  ☆153Updated this week
• HazyResearch / aisys-building-blocks
  Building blocks for foundation models.
  ☆394Updated 10 months ago
• awf / functional-transformer
  A pure-functional implementation of a machine learning transformer model in Python/JAX
  ☆175Updated 2 years ago
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆133Updated 4 months ago
• srush / do-we-need-attention
  ☆161Updated last year
• irregular-rhomboid / EAI-Math-Reading-Group
  Resources from the EleutherAI Math Reading Group
  ☆51Updated last month
• BlackHC / neural_net_checklist
  ☆139Updated 3 months ago
• pytorch / tensordict
  TensorDict is a pytorch dedicated tensor container.
  ☆840Updated this week