srush / Transformer-Puzzles
Puzzles for exploring transformers
☆343Updated last year
Alternatives and similar repositories for Transformer-Puzzles:
Users that are interested in Transformer-Puzzles are comparing it to the libraries listed below
- ☆428Updated 6 months ago
- What would you do with 1000 H100s...☆1,038Updated last year
- A puzzle to learn about prompting☆127Updated last year
- An interactive exploration of Transformer programming.☆262Updated last year
- ☆215Updated 9 months ago
- Annotated version of the Mamba paper☆483Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆568Updated this week
- Building blocks for foundation models.☆482Updated last year
- ☆424Updated 9 months ago
- Implementation of Diffusion Transformer (DiT) in JAX☆272Updated 10 months ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆534Updated this week
- For optimization algorithm research and development.☆508Updated this week
- seqax = sequence modeling + JAX☆154Updated 2 weeks ago
- Language Modeling with the H3 State Space Model☆520Updated last year
- ☆302Updated 10 months ago
- Solve puzzles. Learn CUDA.☆63Updated last year
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆786Updated last month
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆246Updated this week
- ☆166Updated last year
- MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…☆375Updated last week
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆130Updated last year
- Puzzles for learning Triton☆1,591Updated 5 months ago
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆179Updated last year
- jax-triton contains integrations between JAX and OpenAI Triton☆390Updated 2 weeks ago
- JAX implementation of the Llama 2 model☆218Updated last year
- Named tensors with first-class dimensions for PyTorch☆320Updated last year
- Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.☆209Updated last year
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆255Updated last year
- Universal Tensor Operations in Einstein-Inspired Notation for Python.☆366Updated 2 weeks ago
- ☆153Updated last year