Lightning-AI / litDataLinks
Speed up model training by fixing data loading.
☆552Updated last week
Alternatives and similar repositories for litData
Users that are interested in litData are comparing it to the libraries listed below
Sorting:
- Scalable and Performant Data Loading☆330Updated this week
- For optimization algorithm research and development.☆543Updated last week
- PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wri…☆1,420Updated this week
- TensorDict is a pytorch dedicated tensor container.☆975Updated this week
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆242Updated last month
- Common Python utilities and GitHub Actions in Lightning Ecosystem☆61Updated last week
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆436Updated last week
- A lightweight, local-first, and 🆓 experiment tracking library from Hugging Face 🤗☆1,029Updated last week
- Where GPUs get cooked 👩🍳🔥☆294Updated last month
- Best practices & guides on how to write distributed pytorch training code☆517Updated last week
- Universal Notation for Tensor Operations in Python.☆442Updated 6 months ago
- Helpful tools and examples for working with flex-attention☆1,029Updated last week
- PyTorch media decoding and encoding☆768Updated last week
- The merlin dataloader lets you rapidly load tabular data for training deep leaning models with TensorFlow, PyTorch or JAX☆420Updated last year
- Annotated version of the Mamba paper☆490Updated last year
- Create powerful Hydra applications without the yaml files and boilerplate code.☆418Updated this week
- Install PyTorch distributions with computation backend auto-detection☆255Updated 2 months ago
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.☆159Updated last year
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆580Updated 2 months ago
- ☆310Updated last year
- Efficient optimizers☆275Updated 2 weeks ago
- Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"☆426Updated 10 months ago
- An implementation of PSGD Kron second-order optimizer for PyTorch☆96Updated 3 months ago
- PyTorch native quantization and sparsity for training and inference☆2,464Updated this week
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,230Updated this week
- A pytorch quantization backend for optimum☆999Updated last week
- A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.☆295Updated last year
- ☆359Updated last week
- A tool to configure, launch and manage your machine learning experiments.☆198Updated last week
- TensorHue is a Python library that allows you to visualize tensors right in your console, making understanding and debugging tensor conte…☆121Updated 8 months ago