ayaka14732 / tpu-starter
Everything you want to know about Google Cloud TPU
☆495Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for tpu-starter
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆516Updated this week
- JAX implementation of the Llama 2 model☆210Updated 9 months ago
- Annotated version of the Mamba paper☆457Updated 8 months ago
- For optimization algorithm research and development.☆449Updated this week
- JAX Synergistic Memory Inspector☆164Updated 4 months ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆483Updated 3 weeks ago
- ☆224Updated 4 months ago
- Implementation of Flash Attention in Jax☆196Updated 8 months ago
- jax-triton contains integrations between JAX and OpenAI Triton☆343Updated 3 weeks ago
- What would you do with 1000 H100s...☆903Updated 10 months ago
- Pipeline Parallelism for PyTorch☆726Updated 3 months ago
- ☆178Updated last week
- ☆303Updated this week
- ☆334Updated 7 months ago
- Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…☆457Updated last week
- Puzzles for exploring transformers☆325Updated last year
- ☆267Updated this week
- MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…☆333Updated 3 weeks ago
- Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackab…☆1,535Updated 9 months ago
- Implementation of a Transformer, but completely in Triton☆249Updated 2 years ago
- ☆207Updated 6 months ago
- ☆292Updated 4 months ago
- Inference code for LLaMA models in JAX☆113Updated 6 months ago
- Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.☆378Updated 5 months ago
- Helpful tools and examples for working with flex-attention☆469Updated 3 weeks ago
- ☆391Updated last month
- Named tensors with first-class dimensions for PyTorch☆322Updated last year
- JAX-Toolbox☆245Updated this week
- Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch☆476Updated 3 weeks ago
- Puzzles for learning Triton☆1,135Updated this week