AI-Hypercomputer / cloud-accelerator-diagnosticsLinks
☆26Updated 3 weeks ago
Alternatives and similar repositories for cloud-accelerator-diagnostics
Users that are interested in cloud-accelerator-diagnostics are comparing it to the libraries listed below
Sorting:
- Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…☆544Updated this week
- ☆342Updated last week
- ☆151Updated last week
- jax-triton contains integrations between JAX and OpenAI Triton☆436Updated last month
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆469Updated this week
- Implementation of Flash Attention in Jax☆223Updated last year
- ☆192Updated this week
- ☆552Updated last year
- JAX-Toolbox☆377Updated this week
- This repository contains the experimental PyTorch native float8 training UX☆227Updated last year
- Minimal yet performant LLM examples in pure JAX☆226Updated 2 weeks ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆690Updated this week
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆278Updated last month
- torchprime is a reference model implementation for PyTorch on TPU.☆44Updated last week
- Implementation of a Transformer, but completely in Triton☆278Updated 3 years ago
- Everything you want to know about Google Cloud TPU☆555Updated last year
- Pipeline Parallelism for PyTorch☆784Updated last year
- A library for unit scaling in PyTorch☆133Updated 6 months ago
- ☆124Updated last year
- ☆366Updated last year
- Tokamax: A GPU and TPU kernel library.☆158Updated this week
- JAX Synergistic Memory Inspector☆184Updated last year
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆79Updated last month
- Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch☆549Updated 8 months ago
- JAX implementation of the Llama 2 model☆215Updated last year
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆400Updated last week
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆594Updated 5 months ago
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆711Updated this week
- ☆296Updated this week
- seqax = sequence modeling + JAX☆169Updated 5 months ago