Speed up model training by fixing data loading.
☆580Mar 2, 2026Updated 2 weeks ago
Alternatives and similar repositories for litData
Users that are interested in litData are comparing it to the libraries listed below
Sorting:
- PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wri…☆1,445Updated this week
- A minimal Python logger that tracks everything you try when building AI - metrics, prompts, models, etc, so you can see what changed and …☆24Updated this week
- A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.☆3,814Mar 2, 2026Updated 2 weeks ago
- Save, load, host, and share AI model checkpoints without slowing down training. Host on Lightning AI or your own cloud with enterprise-gr…☆42Mar 2, 2026Updated 2 weeks ago
- ☆15Aug 3, 2021Updated 4 years ago
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,228Mar 6, 2026Updated 2 weeks ago
- Machine learning metrics for distributed, scalable PyTorch applications.☆2,419Updated this week
- LLM router + minimal agent framework in one. Call any LLM API with OpenAI format. Unified billing, tools, retries, fallback, logging. Bui…☆49Jan 15, 2026Updated 2 months ago
- Lightning HPO & Training Studio App☆19Apr 12, 2023Updated 2 years ago
- Common Python utilities and GitHub Actions in Lightning Ecosystem☆62Updated this week
- Your PyTorch AI Factory - Flash enables you to easily configure and run complex AI recipes for over 15 tasks across 7 data domains☆1,731Oct 8, 2023Updated 2 years ago
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,250Updated this week
- Minimalistic large language model 3D-parallelism training☆2,617Feb 19, 2026Updated last month
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,956Updated this week
- The spiritual successor to knockknock for PyTorch Lightning, get notified when your training ends☆77Updated this week
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆282Nov 24, 2025Updated 3 months ago
- An active learning library for Pytorch based on Lightning-Fabric.☆79May 4, 2024Updated last year
- ☆26Feb 15, 2023Updated 3 years ago
- TensorDict is a pytorch dedicated tensor container.☆1,015Updated this week
- ☆21Mar 3, 2025Updated last year
- PyTorch native post-training library☆5,703Updated this week
- Toolbox of models, callbacks, and datasets for AI/ML researchers.☆1,752Jan 20, 2026Updated 2 months ago
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆6,082Jul 1, 2025Updated 8 months ago
- [NAACL 2025] WaveFM: A High-Fidelity and Efficient Vocoder Based on Flow Matching☆122Mar 27, 2025Updated 11 months ago
- Triton Server Component for lightning.ai☆14Feb 15, 2023Updated 3 years ago
- A PyTorch Lightning extension that accelerates and enhances foundation model experimentation with flexible fine-tuning schedules.☆70Jan 26, 2026Updated last month
- A PyTorch native platform for training generative AI models☆5,162Updated this week
- Test pytorch code with minimal computational overhead☆26Jun 8, 2023Updated 2 years ago
- Pytorch Lightning Distributed Accelerators using Ray☆216Nov 3, 2023Updated 2 years ago
- Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.☆30,926Mar 10, 2026Updated last week
- ☆16Nov 22, 2021Updated 4 years ago
- Chat with Phi 3.5/3 Vision LLMs. Phi-3.5-vision is a lightweight, state-of-the-art open multimodal model built upon datasets which includ…☆35Jan 2, 2025Updated last year
- PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ⚡🔥⚡☆5,188Aug 16, 2024Updated last year
- A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.☆3,022Feb 9, 2026Updated last month
- Flexible components pairing 🤗 Transformers with Pytorch Lightning☆612Nov 21, 2022Updated 3 years ago
- Automate issue discovery for your projects against Lightning nightly and releases.☆46May 6, 2025Updated 10 months ago
- PyTorch native quantization and sparsity for training and inference☆2,730Updated this week
- Performance benchmarks of Zarr V3 implementations☆19Feb 8, 2026Updated last month
- A small utility for generating ND array pyramids using Xarray and Zarr.☆116Feb 1, 2026Updated last month