Lightning-AI / litDataLinks
Transform datasets at scale. Optimize datasets for fast AI model training.
☆520Updated this week
Alternatives and similar repositories for litData
Users that are interested in litData are comparing it to the libraries listed below
Sorting:
- Scalable and Performant Data Loading☆291Updated this week
- PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wri…☆1,385Updated this week
- For optimization algorithm research and development.☆524Updated this week
- TensorDict is a pytorch dedicated tensor container.☆949Updated last week
- Common Python utilities and GitHub Actions in Lightning Ecosystem☆56Updated this week
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆236Updated 6 months ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆377Updated this week
- A lightweight, local-first, and free experiment tracking Python library built on top of 🤗 Datasets and Spaces.☆570Updated this week
- Helpful tools and examples for working with flex-attention☆908Updated 3 weeks ago
- The merlin dataloader lets you rapidly load tabular data for training deep leaning models with TensorFlow, PyTorch or JAX☆421Updated last year
- PyTorch Single Controller☆345Updated this week
- Best practices & guides on how to write distributed pytorch training code☆463Updated 5 months ago
- ☆307Updated last year
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.☆158Updated last year
- Annotated version of the Mamba paper☆487Updated last year
- Universal Tensor Operations in Einstein-Inspired Notation for Python.☆392Updated 4 months ago
- A tool to configure, launch and manage your machine learning experiments.☆176Updated this week
- ☆350Updated last week
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,215Updated this week
- Create powerful Hydra applications without the yaml files and boilerplate code.☆392Updated this week
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆567Updated this week
- Install PyTorch distributions with computation backend auto-detection☆254Updated 3 months ago
- Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory☆437Updated 11 months ago
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆901Updated 3 months ago
- PyTorch media decoding and encoding☆652Updated this week
- A lightweight library designed to accelerate the process of training PyTorch models by providing a minimal, but extensible training loop …☆189Updated last month
- TorchFix - a linter for PyTorch-using code with autofix support☆145Updated 6 months ago
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆381Updated this week
- aim-mlflow integration☆216Updated 2 years ago
- PyTorch native quantization and sparsity for training and inference☆2,227Updated this week