haoliuhl / language-quantized-autoencoders
Language Quantized AutoEncoders
☆102Updated 2 years ago
Alternatives and similar repositories for language-quantized-autoencoders:
Users that are interested in language-quantized-autoencoders are comparing it to the libraries listed below
- ☆127Updated 2 years ago
- Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch☆88Updated last year
- https://arxiv.org/abs/2209.15162☆49Updated 2 years ago
- Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"☆71Updated last year
- ☆91Updated last year
- PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"☆38Updated last year
- The official code for paper "EasyGen: Easing Multimodal Generation with a Bidirectional Conditional Diffusion Model and LLMs"☆73Updated 4 months ago
- [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning☆80Updated 10 months ago
- ☆117Updated 2 years ago
- Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models☆43Updated 9 months ago
- Touchstone: Evaluating Vision-Language Models by Language Models☆82Updated last year
- ☆48Updated last year
- Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.☆32Updated last year
- Holistic evaluation of multimodal foundation models☆43Updated 7 months ago
- ☆49Updated last year
- Online Adaptation of Language Models with a Memory of Amortized Contexts (NeurIPS 2024)☆63Updated 7 months ago
- ☆126Updated last year
- Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning☆148Updated 2 years ago
- Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch☆270Updated 11 months ago
- Patching open-vocabulary models by interpolating weights☆91Updated last year
- This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…☆115Updated 8 months ago
- M4 experiment logbook☆57Updated last year
- ☆71Updated 8 months ago
- [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning☆31Updated last year
- [ICLR 2023] Official implementation of Transnormer in our ICLR 2023 paper - Toeplitz Neural Network for Sequence Modeling☆79Updated 11 months ago
- Randomized Positional Encodings Boost Length Generalization of Transformers☆80Updated last year
- ChatBridge, an approach to learning a unified multimodal model to interpret, correlate, and reason about various modalities without rely…☆50Updated last year
- Toolkit for Elevater Benchmark☆70Updated last year
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆97Updated last year
- Source code for the paper "Prefix Language Models are Unified Modal Learners"☆43Updated last year