Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
☆161Apr 3, 2024Updated last year
Alternatives and similar repositories for chug
Users that are interested in chug are comparing it to the libraries listed below
Sorting:
- Experimental CUDA kernel framework unifying typed dimensions, NVRTC JIT specialization, and ML‑guided tuning.☆46Feb 9, 2026Updated last month
- Convert datasets from Hugging Face to FiftyOne for Visualization☆11Mar 15, 2024Updated 2 years ago
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,956Updated this week
- Scripts to convert datasets from various sources to Hugging Face Datasets.☆57Oct 26, 2022Updated 3 years ago
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆23Jul 30, 2024Updated last year
- Manage scalable open LLM inference endpoints in Slurm clusters☆283Jul 11, 2024Updated last year
- Backtracing: Retrieving the Cause of the Query, EACL 2024 Long Paper, Findings.☆92Jul 21, 2024Updated last year
- A pytorch quantization backend for optimum☆1,032Nov 21, 2025Updated 4 months ago
- Minimalistic large language model 3D-parallelism training☆2,617Feb 19, 2026Updated last month
- OCR Annotations from Amazon Textract for Industry Documents Library☆103Aug 20, 2022Updated 3 years ago
- A dashboard for exploring timm learning rate schedulers☆20Nov 22, 2024Updated last year
- TensorDict is a pytorch dedicated tensor container.☆1,015Updated this week
- Tools to make language models a bit easier to use☆65Mar 12, 2026Updated last week
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆28Apr 17, 2024Updated last year
- ☆65Oct 4, 2023Updated 2 years ago
- InstructDoc: A Dataset for Zero-Shot Generalization of Visual Document Understanding with Instructions (AAAI2024)☆162May 31, 2024Updated last year
- Scaling Data-Constrained Language Models☆342Jun 28, 2025Updated 8 months ago
- ☆27Mar 21, 2024Updated 2 years ago
- My personal toolbox for doing datascience (especially deep learning) in python.☆18Mar 21, 2020Updated 6 years ago
- A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.☆3,022Feb 9, 2026Updated last month
- The backend behind the LLM-Perf Leaderboard☆11May 5, 2024Updated last year
- A PyTorch native platform for training generative AI models☆5,162Updated this week
- Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.☆3,380May 19, 2025Updated 10 months ago
- ☆211Nov 2, 2023Updated 2 years ago
- An open source implementation of CLIP.☆33Nov 7, 2022Updated 3 years ago
- ☆161Apr 17, 2024Updated last year
- Machine Learning eXperiment Utilities☆48Jul 29, 2025Updated 7 months ago
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆331Sep 25, 2025Updated 5 months ago
- Utilities for working with videos☆13Jul 5, 2025Updated 8 months ago
- Language models scale reliably with over-training and on downstream tasks☆100Apr 2, 2024Updated last year
- ☆14Updated this week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,339Mar 9, 2026Updated last week
- Annotated version of the Mamba paper☆499Feb 27, 2024Updated 2 years ago
- ImageNet-12k subset of ImageNet-21k (fall11)☆21Jun 13, 2023Updated 2 years ago
- Official code for the paper: "Metadata Archaeology"☆19May 10, 2023Updated 2 years ago
- Python Library to evaluate VLM models' robustness across diverse benchmarks☆222Oct 20, 2025Updated 5 months ago
- High-performance, asynchronous Python HTTP client library designed for faster file transfers using concurrency, semaphores, and fault-tol…☆60May 12, 2025Updated 10 months ago
- [AAAI 2025] Does VLM Classification Benefit from LLM Description Semantics?☆25Aug 5, 2025Updated 7 months ago
- ☆35Jun 13, 2023Updated 2 years ago