Lightning-AI / litDataLinks
Transform datasets at scale. Optimize datasets for fast AI model training.
β529Updated last week
Alternatives and similar repositories for litData
Users that are interested in litData are comparing it to the libraries listed below
Sorting:
- Scalable and Performant Data Loadingβ295Updated this week
- A lightweight, local-first, and free experiment tracking library from Hugging Face π€β710Updated this week
- PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wriβ¦β1,395Updated this week
- TensorDict is a pytorch dedicated tensor container.β955Updated last week
- For optimization algorithm research and development.β530Updated this week
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)β389Updated 2 weeks ago
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to facβ¦β236Updated last week
- Common Python utilities and GitHub Actions in Lightning Ecosystemβ57Updated last week
- Helpful tools and examples for working with flex-attentionβ943Updated last week
- PyTorch media decoding and encodingβ679Updated this week
- Best practices & guides on how to write distributed pytorch training codeβ470Updated 6 months ago
- Universal Tensor Operations in Einstein-Inspired Notation for Python.β400Updated 4 months ago
- PyTorch Single Controllerβ368Updated last week
- β307Updated last year
- Where GPUs get cooked π©βπ³π₯β279Updated 3 weeks ago
- Load compute kernels from the Hubβ258Updated this week
- Official Implementation of "ADOPT: Modified Adam Can Converge with Any Ξ²2 with the Optimal Rate"β427Updated 8 months ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.β571Updated 2 weeks ago
- A tool to configure, launch and manage your machine learning experiments.β183Updated this week
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.β159Updated last year
- Annotated version of the Mamba paperβ488Updated last year
- Implementation of π Ring Attention, from Liu et al. at Berkeley AI, in Pytorchβ536Updated 3 months ago
- π Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flashβ¦β262Updated last month
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modelingβ907Updated 4 months ago
- β350Updated this week
- Create powerful Hydra applications without the yaml files and boilerplate code.β395Updated this week
- The merlin dataloader lets you rapidly load tabular data for training deep leaning models with TensorFlow, PyTorch or JAXβ420Updated last year
- TorchFix - a linter for PyTorch-using code with autofix supportβ145Updated last week
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.β1,221Updated this week
- The AdEMAMix Optimizer: Better, Faster, Older.β185Updated 11 months ago