Lightning-AI / litDataLinks
Transform datasets at scale. Optimize datasets for fast AI model training.
☆543Updated last week
Alternatives and similar repositories for litData
Users that are interested in litData are comparing it to the libraries listed below
Sorting:
- Scalable and Performant Data Loading☆304Updated this week
- For optimization algorithm research and development.☆539Updated 2 weeks ago
- PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wri…☆1,413Updated this week
- TensorDict is a pytorch dedicated tensor container.☆970Updated this week
- A lightweight, local-first, and free experiment tracking library from Hugging Face 🤗☆931Updated this week
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆414Updated last week
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆241Updated 2 weeks ago
- Common Python utilities and GitHub Actions in Lightning Ecosystem☆60Updated this week
- Universal Notation for Tensor Operations in Python.☆433Updated 6 months ago
- Best practices & guides on how to write distributed pytorch training code☆494Updated this week
- Create powerful Hydra applications without the yaml files and boilerplate code.☆411Updated last week
- Helpful tools and examples for working with flex-attention☆1,015Updated last month
- TensorHue is a Python library that allows you to visualize tensors right in your console, making understanding and debugging tensor conte…☆120Updated 7 months ago
- The merlin dataloader lets you rapidly load tabular data for training deep leaning models with TensorFlow, PyTorch or JAX☆420Updated last year
- ☆308Updated last year
- Efficient optimizers☆265Updated last week
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆577Updated last month
- ☆358Updated 2 weeks ago
- Load compute kernels from the Hub☆293Updated last week
- Library for reading and processing ML training data.☆553Updated this week
- Annotated version of the Mamba paper☆489Updated last year
- PyTorch Single Controller☆435Updated this week
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,227Updated this week
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆667Updated this week
- A tool to configure, launch and manage your machine learning experiments.☆197Updated this week
- PyTorch native quantization and sparsity for training and inference☆2,392Updated this week
- TorchFix - a linter for PyTorch-using code with autofix support☆148Updated last month
- Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch☆539Updated 4 months ago
- Tensors, for human consumption☆1,312Updated this week
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆394Updated this week