AI-Hypercomputer / cloud-accelerator-diagnosticsLinks
☆24Updated 2 weeks ago
Alternatives and similar repositories for cloud-accelerator-diagnostics
Users that are interested in cloud-accelerator-diagnostics are comparing it to the libraries listed below
Sorting:
- Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…☆540Updated 3 weeks ago
- ☆148Updated last month
- ☆337Updated 2 weeks ago
- ☆190Updated 2 weeks ago
- jax-triton contains integrations between JAX and OpenAI Triton☆436Updated this week
- torchprime is a reference model implementation for PyTorch on TPU.☆41Updated last month
- Minimal yet performant LLM examples in pure JAX☆204Updated 2 months ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆685Updated last week
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆78Updated 2 months ago
- seqax = sequence modeling + JAX☆168Updated 4 months ago
- JAX-Toolbox☆364Updated this week
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆455Updated this week
- Implementation of Flash Attention in Jax☆223Updated last year
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆271Updated last week
- ☆285Updated last year
- ☆545Updated last year
- This repository contains the experimental PyTorch native float8 training UX☆226Updated last year
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆392Updated 5 months ago
- JAX implementation of the Llama 2 model☆216Updated last year
- A library for unit scaling in PyTorch☆132Updated 4 months ago
- Tokamax: A GPU and TPU kernel library.☆122Updated this week
- A simple library for scaling up JAX programs☆144Updated last month
- JAX Synergistic Memory Inspector☆183Updated last year
- ☆121Updated last year
- Implementation of a Transformer, but completely in Triton☆277Updated 3 years ago
- Library for reading and processing ML training data.☆611Updated this week
- TPU inference for vLLM, with unified JAX and PyTorch support.☆178Updated this week
- ☆283Updated last week
- Accelerated First Order Parallel Associative Scan☆192Updated last year
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆658Updated this week