AI-Hypercomputer / jetstream-pytorchLinks
PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
☆68Updated 4 months ago
Alternatives and similar repositories for jetstream-pytorch
Users that are interested in jetstream-pytorch are comparing it to the libraries listed below
Sorting:
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆369Updated 2 months ago
- A JAX-native LLM Post-Training Library☆123Updated this week
- ☆143Updated 2 weeks ago
- Google TPU optimizations for transformers models☆118Updated 7 months ago
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆208Updated last week
- ☆217Updated 7 months ago
- ☆325Updated 3 weeks ago
- Fast low-bit matmul kernels in Triton☆349Updated last week
- This repository contains the experimental PyTorch native float8 training UX☆224Updated last year
- Load compute kernels from the Hub☆244Updated this week
- extensible collectives library in triton☆88Updated 4 months ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆261Updated last month
- Applied AI experiments and examples for PyTorch☆291Updated this week
- Write a fast kernel and run it on Discord. See how you compare against the best!☆52Updated this week
- ☆188Updated 3 weeks ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆383Updated last week
- Official implementation for Training LLMs with MXFP4☆77Updated 4 months ago
- ☆232Updated this week
- ☆110Updated 11 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆128Updated 8 months ago
- Collection of kernels written in Triton language☆147Updated 4 months ago
- A tool to configure, launch and manage your machine learning experiments.☆183Updated this week
- ☆118Updated last year
- ring-attention experiments☆149Updated 10 months ago
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆201Updated this week
- Learn CUDA with PyTorch☆35Updated last week
- Experiment of using Tangent to autodiff triton☆80Updated last year
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆207Updated this week
- A safetensors extension to efficiently store sparse quantized tensors on disk☆153Updated this week
- ☆247Updated this week