Lightning-AI / litDataLinks
Speed up model training by fixing data loading.
☆558Updated this week
Alternatives and similar repositories for litData
Users that are interested in litData are comparing it to the libraries listed below
Sorting:
- Scalable and Performant Data Loading☆335Updated this week
- PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wri…☆1,421Updated this week
- TensorDict is a pytorch dedicated tensor container.☆984Updated 3 weeks ago
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆244Updated last month
- For optimization algorithm research and development.☆544Updated this week
- A lightweight, local-first, and 🆓 experiment tracking library from Hugging Face 🤗☆1,089Updated this week
- Common Python utilities and GitHub Actions in Lightning Ecosystem☆61Updated last week
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆452Updated last week
- Create powerful Hydra applications without the yaml files and boilerplate code.☆428Updated last week
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,236Updated this week
- Helpful tools and examples for working with flex-attention☆1,053Updated last week
- Best practices & guides on how to write distributed pytorch training code☆536Updated 3 weeks ago
- The merlin dataloader lets you rapidly load tabular data for training deep leaning models with TensorFlow, PyTorch or JAX☆421Updated last year
- PyTorch media decoding and encoding☆811Updated this week
- PyTorch native quantization and sparsity for training and inference☆2,511Updated this week
- Where GPUs get cooked 👩🍳🔥☆317Updated 2 months ago
- Universal Notation for Tensor Operations in Python.☆447Updated 7 months ago
- ☆361Updated 2 weeks ago
- Install PyTorch distributions with computation backend auto-detection☆256Updated 3 months ago
- ☆310Updated last year
- Annotated version of the Mamba paper☆489Updated last year
- Recipes are a standard, well supported set of blueprints for machine learning engineers to rapidly train models using the latest research…☆330Updated this week
- A tool to configure, launch and manage your machine learning experiments.☆205Updated this week
- TorchFix - a linter for PyTorch-using code with autofix support☆151Updated 2 months ago
- Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"☆427Updated 11 months ago
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆400Updated this week
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.☆159Updated last year
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆582Updated 3 months ago
- The AdEMAMix Optimizer: Better, Faster, Older.☆186Updated last year
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆825Updated 3 months ago