Photoroom / datagoLinks
A natively parallel dataloader for Python, written in Rust. Serving data at GB/s speeds, while covering aspect ratio bucketing, crop and resize for image ML workloads.
☆126Updated last week
Alternatives and similar repositories for datago
Users that are interested in datago are comparing it to the libraries listed below
Sorting:
- Framework based on a vector dabase to store, manage and curate large image datasets☆82Updated 2 weeks ago
- ☆92Updated last year
- An implementation of PSGD Kron second-order optimizer for PyTorch☆98Updated 6 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Updated last year
- Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)☆34Updated 11 months ago
- Train vision models using JAX and 🤗 transformers☆100Updated last month
- supporting pytorch FSDP for optimizers☆84Updated last year
- Focused on fast experimentation and simplicity☆80Updated last year
- ☆34Updated last year
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.☆160Updated last year
- DeMo: Decoupled Momentum Optimization☆198Updated last year
- ☆50Updated last year
- Scalable and Performant Data Loading☆362Updated last week
- ☆314Updated last year
- WIP☆93Updated last year
- A place to store reusable transformer components of my own creation or found on the interwebs☆70Updated 2 weeks ago
- MoE training for Me and You and maybe other people☆331Updated 3 weeks ago
- Fast, Modern, and Low Precision PyTorch Optimizers☆120Updated last month
- Experimental CUDA kernel framework unifying typed dimensions, NVRTC JIT specialization, and ML‑guided tuning.☆46Updated last week
- PyTorch centric eager mode debugger☆48Updated last year
- Utilities for Training Very Large Models☆58Updated last year
- Automatically take good care of your preemptible TPUs☆37Updated 2 years ago
- Code and weights for the paper "Cluster and Predict Latents Patches for Improved Masked Image Modeling"☆129Updated 2 weeks ago
- ☆90Updated 6 months ago
- ☆22Updated last year
- Simplex Random Feature attention, in PyTorch☆75Updated 2 years ago
- A library for unit scaling in PyTorch☆133Updated 6 months ago
- research impl of Native Sparse Attention (2502.11089)☆63Updated 11 months ago
- ☆63Updated last year
- An implementation of the Llama architecture, to instruct and delight☆21Updated 7 months ago