AI-Hypercomputer / cloud-accelerator-diagnosticsLinks
☆23Updated last week
Alternatives and similar repositories for cloud-accelerator-diagnostics
Users that are interested in cloud-accelerator-diagnostics are comparing it to the libraries listed below
Sorting:
- ☆146Updated 2 weeks ago
- Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…☆538Updated last month
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆268Updated 2 months ago
- ☆189Updated last week
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆414Updated last week
- jax-triton contains integrations between JAX and OpenAI Triton☆426Updated last month
- Implementation of a Transformer, but completely in Triton☆275Updated 3 years ago
- ☆122Updated last year
- ☆331Updated 3 weeks ago
- Minimal yet performant LLM examples in pure JAX☆181Updated 2 weeks ago
- JAX-Toolbox☆343Updated this week
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆143Updated last year
- ☆538Updated last year
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆73Updated 3 weeks ago
- Implementation of Flash Attention in Jax☆219Updated last year
- This repository contains the experimental PyTorch native float8 training UX☆224Updated last year
- JAX Synergistic Memory Inspector☆180Updated last year
- JAX implementation of the Llama 2 model☆218Updated last year
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆213Updated last week
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆379Updated 3 months ago
- torchprime is a reference model implementation for PyTorch on TPU.☆39Updated last week
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆667Updated last week
- ☆14Updated 4 months ago
- This repository hosts code that supports the testing infrastructure for the PyTorch organization. For example, this repo hosts the logic …☆102Updated this week
- ☆173Updated last year
- Train very large language models in Jax.☆209Updated last year
- PyTorch RFCs (experimental)☆135Updated 4 months ago
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆226Updated this week
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆392Updated this week
- A library for unit scaling in PyTorch☆130Updated 2 months ago