patrick-tssn / Awesome-Colorful-LLM
Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics, Fundamental Sciences such as Mathematics, and Ominous.
☆107Updated last week
Related projects: ⓘ
- [ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain☆98Updated 6 months ago
- Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)☆92Updated 2 months ago
- ☆53Updated 7 months ago
- Official code for Paper "Mantis: Multi-Image Instruction Tuning"☆158Updated last week
- Touchstone: Evaluating Vision-Language Models by Language Models☆75Updated 8 months ago
- ☆70Updated 6 months ago
- The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.☆64Updated 2 weeks ago
- An benchmark for evaluating the capabilities of large vision-language models (LVLMs)☆32Updated 10 months ago
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆218Updated last week
- LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation☆121Updated 10 months ago
- A RLHF Infrastructure for Vision-Language Models☆86Updated 3 months ago
- [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning☆244Updated 6 months ago
- Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"☆143Updated 2 weeks ago
- Towards Large Multimodal Models as Visual Foundation Agents☆87Updated 3 weeks ago
- The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆166Updated 5 months ago
- MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)☆252Updated 3 weeks ago
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆239Updated 2 months ago
- Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models☆52Updated 2 months ago
- This is the official implementation of the paper "Needle In A Multimodal Haystack"☆72Updated 2 months ago
- Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"☆103Updated last month
- [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge☆114Updated 2 months ago
- ☆110Updated 4 months ago
- InstructionGPT-4☆35Updated 8 months ago
- ChatBridge, an approach to learning a unified multimodal model to interpret, correlate, and reason about various modalities without rely…☆46Updated last year
- Long Context Transfer from Language to Vision☆293Updated 3 weeks ago
- CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs☆66Updated last month
- ControlLLM: Augment Language Models with Tools by Searching on Graphs☆184Updated 2 months ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆75Updated 3 weeks ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆36Updated 2 months ago
- ☆65Updated last year