huggingface / chug
Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
☆156Updated 11 months ago
Alternatives and similar repositories for chug:
Users that are interested in chug are comparing it to the libraries listed below
- M4 experiment logbook☆57Updated last year
- Python Library to evaluate VLM models' robustness across diverse benchmarks☆192Updated this week
- Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…☆197Updated 6 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆253Updated 7 months ago
- LL3M: Large Language and Multi-Modal Model in Jax☆70Updated 10 months ago
- PyTorch code for hierarchical k-means -- a data curation method for self-supervised learning☆146Updated 8 months ago
- ☆64Updated last year
- The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"☆239Updated last month
- Supercharge huggingface transformers with model parallelism.☆76Updated 4 months ago
- ☆70Updated 5 months ago
- Multimodal language model benchmark, featuring challenging examples☆158Updated 2 months ago
- Let's build better datasets, together!☆256Updated 2 months ago
- Scalable and Performant Data Loading☆222Updated this week
- Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers☆84Updated 7 months ago
- ☆58Updated 11 months ago
- This project is a collection of fine-tuning scripts to help researchers fine-tune Qwen 2 VL on HuggingFace datasets.☆63Updated 5 months ago
- ☆142Updated 2 weeks ago
- ☆63Updated 5 months ago
- ☆88Updated last year
- experiments with inference on llama☆104Updated 8 months ago
- ☆67Updated 6 months ago
- Language models scale reliably with over-training and on downstream tasks☆96Updated 11 months ago
- Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.☆178Updated this week
- ☆75Updated 7 months ago
- ☆91Updated 9 months ago
- Code for Zero-Shot Tokenizer Transfer☆121Updated last month
- A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.☆89Updated 2 months ago
- Scaling Data-Constrained Language Models☆333Updated 5 months ago
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…☆42Updated last year
- Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…☆120Updated 7 months ago