haoliuhl / language-quantized-autoencoders
Language Quantized AutoEncoders
☆94Updated last year
Related projects ⓘ
Alternatives and complementary repositories for language-quantized-autoencoders
- Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch☆88Updated 10 months ago
- Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"☆63Updated 9 months ago
- Implementation of Discrete Key / Value Bottleneck, in Pytorch☆87Updated last year
- ☆75Updated last year
- Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch☆243Updated 6 months ago
- ☆64Updated 4 months ago
- [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning☆72Updated 6 months ago
- Model Stock: All we need is just a few fine-tuned models☆89Updated last month
- Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts☆108Updated 3 weeks ago
- M4 experiment logbook☆56Updated last year
- Implementation of Infini-Transformer in Pytorch☆104Updated last month
- Matryoshka Multimodal Models☆81Updated last month
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆95Updated last year
- DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆56Updated 2 weeks ago
- PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"☆36Updated last year
- Patching open-vocabulary models by interpolating weights☆90Updated last year
- Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.☆32Updated last year
- VLM Evaluation: Benchmark for VLMs, spanning text generation tasks from VQA to Captioning☆86Updated last month
- Holistic evaluation of multimodal foundation models☆41Updated 3 months ago
- Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning☆124Updated 2 years ago
- Code and data for the benchmark "Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Lan…☆34Updated 4 months ago
- Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".☆42Updated 2 weeks ago
- Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models☆41Updated 4 months ago
- ☆77Updated 3 months ago
- Enhancing Large Vision Language Models with Self-Training on Image Comprehension.☆57Updated 5 months ago
- Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch☆97Updated last year
- This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…☆107Updated 4 months ago
- ☆65Updated 8 months ago
- Online Adaptation of Language Models with a Memory of Amortized Contexts (NeurIPS 2024)☆53Updated 3 months ago
- ☆45Updated last year