Alternatives and similar repositories for litData

Users that are interested in litData are comparing it to the libraries listed below

• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆258Updated this week
• Lightning-AI / lightning-thunder
  Thunder gives you PyTorch models superpowers for training and inference. Unlock out-of-the-box optimizations for performance, memory and …
  ☆1,342Updated this week
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆513Updated this week
• pytorch / tensordict
  TensorDict is a pytorch dedicated tensor container.
  ☆925Updated this week
• pytorch-labs / attention-gym
  Helpful tools and examples for working with flex-attention
  ☆766Updated last week
• pytorch / torcheval
  A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…
  ☆229Updated 3 months ago
• fferflo / einx
  Universal Tensor Operations in Einstein-Inspired Notation for Python.
  ☆369Updated last month
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆418Updated 2 months ago
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆536Updated this week
• pytorch / torchft
  PyTorch per step fault tolerance (actively under development)
  ☆300Updated this week
• pytorch / ao
  PyTorch native quantization and sparsity for training and inference
  ☆2,041Updated this week
• lucidrains / ring-attention-pytorch
  Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
  ☆512Updated 6 months ago
• apple / ml-sigma-reparam
  ☆302Updated 10 months ago
• mlfoundations / open_lm
  A repository for research on medium sized language models.
  ☆495Updated last week
• Lightning-AI / utilities
  Common Python utilities and GitHub Actions in Lightning Ecosystem
  ☆56Updated this week
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆245Updated this week
• pytorch / torchcodec
  PyTorch video decoding
  ☆545Updated this week
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆483Updated last year
• stanford-crfm / levanter
  Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
  ☆569Updated this week
• huggingface / optimum-quanto
  A pytorch quantization backend for optimum
  ☆935Updated 3 weeks ago
• KellerJordan / Muon
  Muon optimizer: +>30% sample efficiency with <3% wallclock overhead
  ☆623Updated last month
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆765Updated 8 months ago
• pytorch / data
  A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.
  ☆1,200Updated this week
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆267Updated last week
• triton-inference-server / pytriton
  PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
  ☆790Updated 3 months ago
• pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆362Updated this week
• google / fiddle
  ☆347Updated last week
• NVIDIA / NeMo-Curator
  Scalable data pre processing and curation toolkit for LLMs
  ☆910Updated this week
• huggingface / chug
  Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
  ☆157Updated last year
• microsoft / Samba
  [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
  ☆871Updated 2 weeks ago