haoliuhl / language-quantized-autoencodersLinks
Language Quantized AutoEncoders
☆107Updated 2 years ago
Alternatives and similar repositories for language-quantized-autoencoders
Users that are interested in language-quantized-autoencoders are comparing it to the libraries listed below
Sorting:
- Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch☆88Updated last year
- ☆59Updated last year
- Matryoshka Multimodal Models☆107Updated 4 months ago
- The official code for paper "EasyGen: Easing Multimodal Generation with a Bidirectional Conditional Diffusion Model and LLMs"☆73Updated 6 months ago
- ChatBridge, an approach to learning a unified multimodal model to interpret, correlate, and reason about various modalities without rely…☆51Updated last year
- PyTorch implementation of LIMoE☆53Updated last year
- Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"☆78Updated last year
- ☆118Updated 2 years ago
- Toolkit for Elevater Benchmark☆72Updated last year
- https://arxiv.org/abs/2209.15162☆50Updated 2 years ago
- ☆97Updated 2 years ago
- Source code for the paper "Prefix Language Models are Unified Modal Learners"☆42Updated 2 years ago
- Online Adaptation of Language Models with a Memory of Amortized Contexts (NeurIPS 2024)☆63Updated 10 months ago
- Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.☆33Updated last year
- [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning☆86Updated last year
- Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning☆156Updated 2 years ago
- ☆128Updated 2 years ago
- ☆51Updated last year
- Compress conventional Vision-Language Pre-training data☆51Updated last year
- This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…☆78Updated 3 months ago
- Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers☆92Updated last year
- ☆48Updated last year
- [NeurIPS 2023] A faithful benchmark for vision-language compositionality☆79Updated last year
- ☆54Updated 2 years ago
- [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models☆77Updated this week
- Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models☆44Updated 11 months ago
- MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning☆134Updated last year
- code for "Multitask Vision-Language Prompt Tuning" https://arxiv.org/abs/2211.11720☆56Updated 11 months ago
- ☆74Updated 11 months ago
- Repository for the paper: dense and aligned captions (dac) promote compositional reasoning in vl models☆27Updated last year