AI-Hypercomputer / torchprimeLinks
torchprime is a reference model implementation for PyTorch on TPU.
☆36Updated this week
Alternatives and similar repositories for torchprime
Users that are interested in torchprime are comparing it to the libraries listed below
Sorting:
- ☆15Updated 4 months ago
- Load compute kernels from the Hub☆283Updated this week
- A JAX-native LLM Post-Training Library☆143Updated this week
- ☆118Updated last year
- ☆14Updated 3 months ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆265Updated last month
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆71Updated 5 months ago
- Two implementations of ZeRO-1 optimizer sharding in JAX☆14Updated 2 years ago
- This repository contains the experimental PyTorch native float8 training UX☆224Updated last year
- ☆188Updated 2 weeks ago
- Minimal yet performant LLM examples in pure JAX☆158Updated this week
- A set of Python scripts that makes your experience on TPU better☆54Updated last year
- Google TPU optimizations for transformers models☆120Updated 7 months ago
- Accelerate, Optimize performance with streamlined training and serving options with JAX.☆310Updated this week
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆241Updated 3 months ago
- JAX implementation of the Llama 2 model☆219Updated last year
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆401Updated 2 weeks ago
- ☆168Updated last year
- ☆146Updated last month
- Pytorch/XLA SPMD Test code in Google TPU☆23Updated last year
- ☆330Updated this week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆160Updated 2 months ago
- ☆217Updated 7 months ago
- seqax = sequence modeling + JAX☆167Updated last month
- Scalable and Performant Data Loading☆299Updated this week
- ☆279Updated last year
- ☆88Updated last year
- Triton-based implementation of Sparse Mixture of Experts.☆239Updated 3 weeks ago
- A library for unit scaling in PyTorch☆130Updated 2 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆129Updated 9 months ago