Lightning-AI / litDataLinks
Transform datasets at scale. Optimize datasets for fast AI model training.
☆538Updated last week
Alternatives and similar repositories for litData
Users that are interested in litData are comparing it to the libraries listed below
Sorting:
- Scalable and Performant Data Loading☆302Updated this week
- PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wri…☆1,411Updated this week
- TensorDict is a pytorch dedicated tensor container.☆967Updated last week
- A lightweight, local-first, and free experiment tracking library from Hugging Face 🤗☆872Updated this week
- For optimization algorithm research and development.☆536Updated last week
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆239Updated 3 weeks ago
- Common Python utilities and GitHub Actions in Lightning Ecosystem☆59Updated last week
- Universal Tensor Operations in Einstein-Inspired Notation for Python.☆408Updated 5 months ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆401Updated 3 weeks ago
- Best practices & guides on how to write distributed pytorch training code☆475Updated 6 months ago
- PyTorch media decoding and encoding☆700Updated this week
- Helpful tools and examples for working with flex-attention☆970Updated last week
- ☆307Updated last year
- The merlin dataloader lets you rapidly load tabular data for training deep leaning models with TensorFlow, PyTorch or JAX☆421Updated last year
- Create powerful Hydra applications without the yaml files and boilerplate code.☆406Updated last week
- PyTorch Single Controller☆419Updated this week
- Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"☆427Updated 9 months ago
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.☆158Updated last year
- Install PyTorch distributions with computation backend auto-detection☆254Updated last month
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆576Updated last month
- Next Generation Experimental Tracking for Machine Learning Operations☆342Updated 3 months ago
- TorchFix - a linter for PyTorch-using code with autofix support☆147Updated 3 weeks ago
- Annotated version of the Mamba paper☆489Updated last year
- A pytorch quantization backend for optimum☆987Updated 3 weeks ago
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,226Updated this week
- The AdEMAMix Optimizer: Better, Faster, Older.☆186Updated last year
- TensorHue is a Python library that allows you to visualize tensors right in your console, making understanding and debugging tensor conte…☆120Updated 6 months ago
- Package for extracting and mapping the results of every single tensor operation in a PyTorch model in one line of code.☆613Updated 6 months ago
- Efficient optimizers☆261Updated last month
- Load compute kernels from the Hub☆283Updated this week