haoliuhl / language-quantized-autoencoders
Language Quantized AutoEncoders
☆95Updated last year
Alternatives and similar repositories for language-quantized-autoencoders:
Users that are interested in language-quantized-autoencoders are comparing it to the libraries listed below
- ☆117Updated last year
- https://arxiv.org/abs/2209.15162☆48Updated last year
- Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch☆88Updated last year
- Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"☆65Updated 11 months ago
- Patching open-vocabulary models by interpolating weights☆91Updated last year
- Code for the paper "Hyperbolic Image-Text Representations", Desai et al, ICML 2023☆146Updated last year
- ☆67Updated 6 months ago
- ☆78Updated last year
- ☆47Updated last year
- This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…☆112Updated 6 months ago
- ☆51Updated last year
- Implementation of Bitune: Bidirectional Instruction-Tuning☆16Updated 7 months ago
- Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning☆143Updated 2 years ago
- ☆127Updated 2 years ago
- [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning☆78Updated 8 months ago
- DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆71Updated last month
- Matryoshka Multimodal Models☆90Updated last month
- Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".☆38Updated 10 months ago
- Implementation of Discrete Key / Value Bottleneck, in Pytorch☆87Updated last year
- Holistic evaluation of multimodal foundation models☆42Updated 5 months ago
- ChatBridge, an approach to learning a unified multimodal model to interpret, correlate, and reason about various modalities without rely…☆49Updated last year
- Code for the paper titled "CiT Curation in Training for Effective Vision-Language Data".☆78Updated 2 years ago
- Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)☆54Updated last year
- Release of ImageNet-Captions☆45Updated last year
- code for "Multitask Vision-Language Prompt Tuning" https://arxiv.org/abs/2211.11720☆55Updated 7 months ago
- Command-line tool for downloading and extending the RedCaps dataset.☆46Updated last year
- M4 experiment logbook☆56Updated last year
- Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight☆37Updated last year
- The official code for paper "EasyGen: Easing Multimodal Generation with a Bidirectional Conditional Diffusion Model and LLMs"☆73Updated last month
- Official repo for StableLLAVA☆94Updated last year