AI-Hypercomputer / cloud-accelerator-diagnosticsLinks
☆26Updated this week
Alternatives and similar repositories for cloud-accelerator-diagnostics
Users that are interested in cloud-accelerator-diagnostics are comparing it to the libraries listed below
Sorting:
- Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…☆542Updated last week
- ☆148Updated last month
- ☆340Updated 2 weeks ago
- jax-triton contains integrations between JAX and OpenAI Triton☆436Updated 2 weeks ago
- ☆190Updated last week
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆462Updated this week
- Minimal yet performant LLM examples in pure JAX☆219Updated 3 weeks ago
- JAX-Toolbox☆369Updated this week
- Implementation of a Transformer, but completely in Triton☆277Updated 3 years ago
- Implementation of Flash Attention in Jax☆222Updated last year
- Tokamax: A GPU and TPU kernel library.☆142Updated this week
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆397Updated 6 months ago
- ☆548Updated last year
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆275Updated last month
- JAX Synergistic Memory Inspector☆183Updated last year
- torchprime is a reference model implementation for PyTorch on TPU.☆43Updated 2 months ago
- ☆290Updated last week
- A library for unit scaling in PyTorch☆133Updated 5 months ago
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆79Updated last week
- Everything you want to know about Google Cloud TPU☆555Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆687Updated last month
- Pipeline Parallelism for PyTorch☆783Updated last year
- A library to analyze PyTorch traces.☆452Updated last week
- ☆364Updated last year
- xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…☆155Updated this week
- This repository contains the experimental PyTorch native float8 training UX☆227Updated last year
- ☆121Updated last year
- JAX implementation of the Llama 2 model☆216Updated last year
- ☆286Updated last year
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆162Updated this week