Alternatives and similar repositories for litdata:

Users that are interested in litdata are comparing it to the libraries listed below

• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆222Updated this week
• pytorch-labs / attention-gym
  Helpful tools and examples for working with flex-attention
  ☆662Updated last week
• Lightning-AI / lightning-thunder
  Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors a…
  ☆1,290Updated this week
• pytorch / torcheval
  A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…
  ☆227Updated last month
• pytorch / tensordict
  TensorDict is a pytorch dedicated tensor container.
  ☆889Updated this week
• fferflo / einx
  Universal Tensor Operations in Einstein-Inspired Notation for Python.
  ☆357Updated 2 weeks ago
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆497Updated this week
• pytorch / torchft
  PyTorch per step fault tolerance (actively under development)
  ☆253Updated last week
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆515Updated last week
• huggingface / optimum-quanto
  A pytorch quantization backend for optimum
  ☆891Updated last month
• lucidrains / ring-attention-pytorch
  Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
  ☆503Updated 4 months ago
• stanford-crfm / levanter
  Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
  ☆550Updated this week
• huggingface / picotron
  Minimalistic 4D-parallelism distributed training framework for education purpose
  ☆872Updated this week
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆753Updated 6 months ago
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆474Updated last year
• pytorch-labs / torchfix
  TorchFix - a linter for PyTorch-using code with autofix support
  ☆133Updated 3 weeks ago
• Lightning-AI / utilities
  Common Python utilities and GitHub Actions in Lightning Ecosystem
  ☆53Updated this week
• apple / ml-sigma-reparam
  ☆301Updated 8 months ago
• google / fiddle
  ☆344Updated 3 weeks ago
• BlackHC / toma
  Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory
  ☆434Updated 6 months ago
• huggingface / chug
  Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
  ☆156Updated 11 months ago
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆225Updated this week
• KellerJordan / Muon
  Muon optimizer: +>30% sample efficiency with <3% wallclock overhead
  ☆434Updated this week
• explosion / curated-transformers
  🤖 A PyTorch library of curated Transformer models and their composable components
  ☆880Updated 10 months ago
• pytorch / ao
  PyTorch native quantization and sparsity for training and inference
  ☆1,869Updated this week
• mlfoundations / open_lm
  A repository for research on medium sized language models.
  ☆492Updated last month
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆356Updated last week
• triton-inference-server / pytriton
  PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
  ☆775Updated 2 weeks ago
• AI-Hypercomputer / maxdiffusion
  ☆191Updated this week
• microsoft / Samba
  Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"
  ☆849Updated last week