AI-Hypercomputer / tpu-recipesLinks
☆72Updated this week
Alternatives and similar repositories for tpu-recipes
Users that are interested in tpu-recipes are comparing it to the libraries listed below
Sorting:
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆79Updated last month
- Google TPU optimizations for transformers models☆135Updated last week
- ☆152Updated 3 weeks ago
- Write a fast kernel and run it on Discord. See how you compare against the best!☆68Updated this week
- xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…☆162Updated this week
- MoE training for Me and You and maybe other people☆335Updated last month
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆197Updated 8 months ago
- 👷 Build compute kernels☆214Updated last week
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆403Updated 3 weeks ago
- Load compute kernels from the Hub☆389Updated this week
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆86Updated 2 years ago
- ☆192Updated 3 weeks ago
- Various transformers for FSDP research☆38Updated 3 years ago
- LM engine is a library for pretraining/finetuning LLMs☆113Updated this week
- ☆21Updated 11 months ago
- TPU inference for vLLM, with unified JAX and PyTorch support.☆223Updated last week
- ☆345Updated this week
- ML/DL Math and Method notes☆66Updated 2 years ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆474Updated 3 weeks ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆18Updated 6 months ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆334Updated 3 months ago
- ☆17Updated 2 years ago
- Package of Pathways-on-Cloud utilities☆23Updated last week
- Fast, Modern, and Low Precision PyTorch Optimizers☆121Updated last month
- A place to store reusable transformer components of my own creation or found on the interwebs☆72Updated 3 weeks ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 10 months ago
- A collection of reusable, high-performance, well-documented, thorough-tested layers and models in Jax☆22Updated 7 months ago
- ☆92Updated last year
- Experiment of using Tangent to autodiff triton☆82Updated 2 years ago
- JAX implementation of the Llama 2 model☆216Updated 2 years ago