Alternatives and similar repositories for litdata:

Users that are interested in litdata are comparing it to the libraries listed below

• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆210Updated this week
• Lightning-AI / lightning-thunder
  Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors a…
  ☆1,268Updated this week
• pytorch / tensordict
  TensorDict is a pytorch dedicated tensor container.
  ☆868Updated this week
• pytorch / torcheval
  A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…
  ☆225Updated last week
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆486Updated last week
• pytorch-labs / attention-gym
  Helpful tools and examples for working with flex-attention
  ☆603Updated this week
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆511Updated this week
• pytorch / torchft
  PyTorch per step fault tolerance (actively under development)
  ☆226Updated this week
• huggingface / picotron
  Minimalistic 4D-parallelism distributed training framework for education purpose
  ☆670Updated this week
• pytorch / ao
  PyTorch native quantization and sparsity for training and inference
  ☆1,783Updated this week
• fferflo / einx
  Universal Tensor Operations in Einstein-Inspired Notation for Python.
  ☆344Updated 2 months ago
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆470Updated 11 months ago
• apple / ml-sigma-reparam
  ☆296Updated 7 months ago
• google / fiddle
  ☆339Updated 2 weeks ago
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆739Updated 5 months ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,400Updated this week
• pytorch / torchcodec
  PyTorch video decoding
  ☆227Updated this week
• pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆341Updated last week
• huggingface / optimum-quanto
  A pytorch quantization backend for optimum
  ☆870Updated 2 weeks ago
• Lightning-AI / utilities
  Common Python utilities and GitHub Actions in Lightning Ecosystem
  ☆51Updated this week
• BlackHC / toma
  Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory
  ☆431Updated 5 months ago
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆342Updated this week
• lucidrains / ring-attention-pytorch
  Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
  ☆498Updated 3 months ago
• pytorch / torchdynamo
  A Python-level JIT compiler designed to make unmodified PyTorch programs faster.
  ☆1,019Updated 9 months ago
• pytorch-labs / torchfix
  TorchFix - a linter for PyTorch-using code with autofix support
  ☆122Updated 3 weeks ago
• huggingface / chug
  Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
  ☆155Updated 9 months ago
• kvfrans / jax-diffusion-transformer
  Implementation of Diffusion Transformer (DiT) in JAX
  ☆261Updated 7 months ago
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆216Updated this week
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆263Updated 7 months ago
• stanford-crfm / levanter
  Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
  ☆536Updated this week