Lightning-AI / litData
Transform datasets at scale. Optimize datasets for fast AI model training.
☆449Updated last week
Alternatives and similar repositories for litData:
Users that are interested in litData are comparing it to the libraries listed below
- Scalable and Performant Data Loading☆237Updated last week
- TensorDict is a pytorch dedicated tensor container.☆911Updated this week
- Thunder gives you PyTorch models superpowers for training and inference. Unlock out-of-the-box optimizations for performance, memory and …☆1,328Updated this week
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆229Updated 3 months ago
- For optimization algorithm research and development.☆508Updated this week
- Helpful tools and examples for working with flex-attention☆726Updated 2 weeks ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆534Updated this week
- PyTorch native quantization and sparsity for training and inference☆1,996Updated this week
- PyTorch video decoding☆497Updated this week
- ☆302Updated 10 months ago
- Universal Tensor Operations in Einstein-Inspired Notation for Python.☆367Updated 2 weeks ago
- TorchFix - a linter for PyTorch-using code with autofix support☆138Updated 2 months ago
- Efficient optimizers☆189Updated this week
- Minimalistic 4D-parallelism distributed training framework for education purpose☆991Updated last month
- PyTorch per step fault tolerance (actively under development)☆284Updated this week
- Named tensors with first-class dimensions for PyTorch☆320Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆568Updated this week
- Best practices & guides on how to write distributed pytorch training code☆401Updated 2 months ago
- ☆347Updated this week
- An implementation of PSGD Kron second-order optimizer for PyTorch☆89Updated 3 weeks ago
- Library for reading and processing ML training data.☆432Updated this week
- Annotated version of the Mamba paper☆483Updated last year
- Common Python utilities and GitHub Actions in Lightning Ecosystem☆56Updated this week
- Pipeline Parallelism for PyTorch☆764Updated 8 months ago
- Muon optimizer: +>30% sample efficiency with <3% wallclock overhead☆577Updated last month
- Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"☆425Updated 4 months ago
- Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory☆435Updated 7 months ago
- A Jax-based library for designing and training small transformers.☆286Updated 7 months ago
- The merlin dataloader lets you rapidly load tabular data for training deep leaning models with TensorFlow, PyTorch or JAX☆418Updated last year
- Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch☆511Updated 6 months ago