Lightning-AI / lightning-thunderLinks
Thunder gives you PyTorch models superpowers for training and inference. Unlock out-of-the-box optimizations for performance, memory and parallelism, or roll out your own.
☆1,357Updated this week
Alternatives and similar repositories for lightning-thunder
Users that are interested in lightning-thunder are comparing it to the libraries listed below
Sorting:
- PyTorch native quantization and sparsity for training and inference☆2,072Updated this week
- Transform datasets at scale. Optimize datasets for fast AI model training.☆485Updated this week
- Schedule-Free Optimization in PyTorch☆2,162Updated 2 weeks ago
- Minimalistic large language model 3D-parallelism training☆1,898Updated this week
- A PyTorch native platform for training generative AI models☆3,868Updated this week
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆546Updated this week
- Tile primitives for speedy kernels☆2,420Updated this week
- TensorDict is a pytorch dedicated tensor container.☆925Updated last week
- Puzzles for learning Triton☆1,671Updated 6 months ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,518Updated this week
- UNet diffusion model in pure CUDA☆606Updated 11 months ago
- A pytorch quantization backend for optimum☆946Updated 2 weeks ago
- NanoGPT (124M) in 3 minutes☆2,610Updated last week
- Best practices & guides on how to write distributed pytorch training code☆433Updated 3 months ago
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆795Updated last month
- Helpful tools and examples for working with flex-attention☆811Updated this week
- Official implementation of Half-Quadratic Quantization (HQQ)☆818Updated this week
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆876Updated last month
- ☆971Updated 4 months ago
- A simple, performant and scalable Jax LLM!☆1,746Updated this week
- A JAX research toolkit for building, editing, and visualizing neural networks.☆1,784Updated last month
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Bla…☆2,450Updated this week
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,046Updated last year
- A modern model graph visualizer and debugger☆1,212Updated last week
- What would you do with 1000 H100s...☆1,050Updated last year
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,396Updated last week
- Pipeline Parallelism for PyTorch☆767Updated 9 months ago
- For optimization algorithm research and development.☆518Updated this week
- Open weights language model from Google DeepMind, based on Griffin.☆639Updated 2 weeks ago
- PyTorch video decoding☆572Updated this week