allenai / mmc4
MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.
☆928Updated last month
Alternatives and similar repositories for mmc4:
Users that are interested in mmc4 are comparing it to the libraries listed below
- [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"☆520Updated last year
- 🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".☆482Updated last year
- [NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333☆1,103Updated last year
- Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch☆1,240Updated 2 years ago
- [NeurIPS 22] [AAAI 24] Recurrent Transformer-based long-context architecture.☆762Updated 6 months ago
- LOMO: LOw-Memory Optimization☆985Updated 10 months ago
- ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Expert…☆1,428Updated last month
- [NIPS2023] RRHF & Wombat☆806Updated last year
- Code for fine-tuning Platypus fam LLMs using LoRA☆629Updated last year
- DataComp: In search of the next generation of multimodal datasets☆703Updated last week
- LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions☆820Updated 2 years ago
- A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.☆807Updated 10 months ago
- ☆904Updated last year
- Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".☆658Updated 7 months ago
- This is the official repository for the LENS (Large Language Models Enhanced to See) system.☆352Updated last year
- Salesforce open-source LLMs with 8k sequence length.☆717Updated 3 months ago
- Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch☆641Updated 4 months ago
- Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"☆864Updated 4 months ago
- OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.☆557Updated last year
- Inference code for Persimmon-8B☆415Updated last year
- [TLLM'23] PandaGPT: One Model To Instruction-Follow Them All☆784Updated last year
- [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition☆630Updated 9 months ago
- Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"☆266Updated 10 months ago
- GPT4Tools is an intelligent system that can automatically decide, control, and utilize different visual foundation models, allowing the u…☆772Updated last year
- Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"☆1,060Updated last year
- ☆458Updated last year
- Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".☆1,129Updated last year
- An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal …☆360Updated last year
- An Open-source Toolkit for LLM Development☆2,774Updated 3 months ago
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆739Updated last year