Lightning-AI / litDataLinks
Speed up model training by fixing data loading.
β569Updated last week
Alternatives and similar repositories for litData
Users that are interested in litData are comparing it to the libraries listed below
Sorting:
- Scalable and Performant Data Loadingβ363Updated this week
- A lightweight, local-first, and π experiment tracking library from Hugging Face π€β1,223Updated last week
- For optimization algorithm research and development.β556Updated last week
- PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wriβ¦β1,437Updated this week
- TensorDict is a pytorch dedicated tensor container.β1,002Updated last week
- Common Python utilities and GitHub Actions in Lightning Ecosystemβ62Updated this week
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to facβ¦β247Updated last week
- Best practices & guides on how to write distributed pytorch training codeβ564Updated 2 months ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)β469Updated last week
- Create powerful Hydra applications without the yaml files and boilerplate code.β447Updated last week
- The merlin dataloader lets you rapidly load tabular data for training deep leaning models with TensorFlow, PyTorch or JAXβ423Updated last year
- Load compute kernels from the Hubβ376Updated this week
- Helpful tools and examples for working with flex-attentionβ1,108Updated last week
- A tool to configure, launch and manage your machine learning experiments.β214Updated this week
- β373Updated this week
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.β1,247Updated this week
- TorchFix - a linter for PyTorch-using code with autofix supportβ152Updated 4 months ago
- Helps you write algorithms in PyTorch that adapt to the available (CUDA) memoryβ438Updated last year
- β314Updated last year
- Annotated version of the Mamba paperβ493Updated last year
- Universal Notation for Tensor Operations in Python.β461Updated 9 months ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.β594Updated 5 months ago
- TensorHue is a Python library that allows you to visualize tensors right in your console, making understanding and debugging tensor conteβ¦β124Updated 11 months ago
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.β160Updated last year
- Official Implementation of "ADOPT: Modified Adam Can Converge with Any Ξ²2 with the Optimal Rate"β433Updated last year
- Implementation of π Ring Attention, from Liu et al. at Berkeley AI, in Pytorchβ549Updated 8 months ago
- Code repository for the paper - "Matryoshka Representation Learning"β589Updated last year
- Install PyTorch distributions with computation backend auto-detectionβ257Updated last month
- Tensors, for human consumptionβ1,350Updated 2 months ago
- PyTorch media decoding and encodingβ913Updated this week