Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M documents, 115B text tokens and 353M images.
☆218Aug 28, 2024Updated 2 years ago
Alternatives and similar repositories for OBELICS
Users that are interested in OBELICS are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.☆954Mar 19, 2025Updated last year
- A huge dataset for Document Visual Question Answering☆24Jul 29, 2024Updated 2 years ago
- DataComp: In search of the next generation of multimodal datasets☆788Apr 28, 2025Updated last year
- COYO-700M: Large-scale Image-Text Pair Dataset☆1,254Nov 30, 2022Updated 3 years ago
- [ICLR 2025 Spotlight] OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text☆427May 5, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆282Jun 25, 2024Updated 2 years ago
- Scaling Data-Constrained Language Models☆347Jun 28, 2025Updated last year
- Big-Interleaved-Dataset☆59Jan 21, 2023Updated 3 years ago
- 🍃 MINT-1T: A one trillion token multimodal interleaved dataset.☆832Jul 31, 2024Updated 2 years ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆129Nov 25, 2024Updated last year
- 🐟 Code and models for the NeurIPS 2023 paper "Generating Images with Multimodal Language Models".☆470Jan 19, 2024Updated 2 years ago
- An open-source framework for training large multimodal models.☆4,117Aug 31, 2024Updated last year
- MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)☆333Jan 20, 2025Updated last year
- NeurIPS 2025 Spotlight; ICLR2024 Spotlight; CVPR 2024; EMNLP 2024☆1,854Aug 11, 2026Updated 2 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆25Jul 30, 2024Updated 2 years ago
- Emu Series: Generative Multimodal Models from BAAI☆1,779Jan 12, 2026Updated 7 months ago
- [CVPR 2024] CapsFusion: Rethinking Image-Text Data at Scale☆216Feb 27, 2024Updated 2 years ago
- Pipeline for pulling and processing online language model pretraining data from the web☆179Jul 31, 2023Updated 3 years ago
- Open reproduction of MUSE for fast text2image generation.☆358Jun 1, 2024Updated 2 years ago
- Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR 2024 Best Paper]☆239Jan 3, 2026Updated 7 months ago
- [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning☆296Mar 13, 2024Updated 2 years ago
- ☆648Feb 15, 2024Updated 2 years ago
- ImageNet-12k subset of ImageNet-21k (fall11)☆23Jun 13, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Un-*** 50 billions multimodality dataset☆24Sep 14, 2022Updated 3 years ago
- Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training☆139Dec 16, 2025Updated 8 months ago
- Official implementation of SEED-LLaMA (ICLR 2024).☆642Sep 21, 2024Updated last year
- ☆816Jul 8, 2024Updated 2 years ago
- [EMNLP 2023] Once Upon a *Time* in *Graph*: Relative-Time Pretraining for Complex Temporal Reasoning☆17Oct 31, 2023Updated 2 years ago
- ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models☆161Dec 26, 2024Updated last year
- Easily convert common crawl to a dataset of caption and document. Image/text Audio/text Video/text, ...☆321Dec 9, 2023Updated 2 years ago
- Aligning LMMs with Factually Augmented RLHF☆399Nov 1, 2023Updated 2 years ago
- ☆28Oct 18, 2022Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Pix2Seq codebase: multi-tasks with generative modeling (autoregressive and diffusion)☆945Nov 7, 2023Updated 2 years ago
- OpenOrca-KO dataset을 활용하여 llama2를 fine-tuning한 Korean-OpenOrca☆18Nov 1, 2023Updated 2 years ago
- Multimodal-GPT☆1,512Jun 4, 2023Updated 3 years ago
- M4 experiment logbook☆59Aug 21, 2023Updated 3 years ago
- Experiments and data for the paper "When and why vision-language models behave like bags-of-words, and what to do about it?" Oral @ ICLR …☆295Jun 7, 2023Updated 3 years ago
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆311Sep 11, 2024Updated last year
- Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.☆426Jul 14, 2025Updated last year