inFaaa / Multimodal-Roadmap-for-freshman
本项目用于Multimodal领域新手的学习路线，包括该领域的经典论文，项目及课程。旨在希望学习者在一定的时间内达到对这个领域有较为深刻的认知，能够自己进行的独立研究。
☆15Updated 9 months ago
Alternatives and similar repositories for Multimodal-Roadmap-for-freshman:
Users that are interested in Multimodal-Roadmap-for-freshman are comparing it to the libraries listed below
- GPT as a Monte Carlo Language Tree: A Probabilistic Perspective☆30Updated this week
- 【COLING 2025🔥】Code for the paper "Is Parameter Collision Hindering Continual Learning in LLMs?".☆31Updated last month
- GPT-4V(ision) as A Social Media Analysis Engine☆31Updated 3 weeks ago
- The official code of the paper "PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction".☆50Updated last week
- ☆25Updated 6 months ago
- ☆97Updated last month
- LLMBind: A Unified Modality-Task Integration Framework☆17Updated 7 months ago
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models☆109Updated 8 months ago
- official impelmentation of Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Input☆61Updated 4 months ago
- This is the official PyTorch implementation of "ZipAR: Accelerating Auto-regressive Image Generation through Spatial Locality"☆43Updated this week
- A paper list about Token Merge, Reduce, Resample, Drop for MLLMs.☆17Updated this week
- [Neurips 24' D&B] Official Dataloader and Evaluation Scripts for LongVideoBench.☆83Updated 5 months ago
- Code release for VTW (AAAI 2025)☆28Updated last month
- MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models☆58Updated 4 months ago
- [EMNLP 2024 Findings🔥] Official implementation of "LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Infe…☆88Updated 2 months ago
- ☆24Updated 8 months ago
- [NAACL 2024] LaDiC: Are Diffusion Models Really Inferior to Autoregressive Counterparts for Image-to-text Generation?☆37Updated 7 months ago
- VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models☆40Updated 6 months ago
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆56Updated 3 months ago
- ☆36Updated 2 weeks ago
- The official pytorch implement of "Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Context Sparsifi…☆15Updated last month
- [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'☆136Updated this week
- The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…☆67Updated last month
- code for "Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization"☆51Updated 4 months ago
- Official implement of MIA-DPO☆49Updated 2 months ago
- [NeurIPS 2024] Visual Perception by Large Language Model’s Weights☆35Updated 3 months ago
- Liquid: Language Models are Scalable Multi-modal Generators☆60Updated last month
- Empowering Unified MLLM with Multi-granular Visual Generation☆114Updated this week
- Repo for paper "T2Vid: Translating Long Text into Multi-Image is the Catalyst for Video-LLMs"☆48Updated last month
- 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".☆222Updated 2 weeks ago