vincentlux / Awesome-Multimodal-LLMLinks
Reading list for Multimodal Large Language Models
☆68Updated 2 years ago
Alternatives and similar repositories for Awesome-Multimodal-LLM
Users that are interested in Awesome-Multimodal-LLM are comparing it to the libraries listed below
Sorting:
- MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning☆135Updated 2 years ago
- Touchstone: Evaluating Vision-Language Models by Language Models☆83Updated last year
- Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics,…☆123Updated 4 months ago
- [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs☆126Updated 5 months ago
- A curated list of the papers, repositories, tutorials, and anythings related to the large language models for tools☆68Updated 2 years ago
- MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria☆71Updated 11 months ago
- Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)☆166Updated last year
- ☆65Updated last year
- An Easy-to-use Hallucination Detection Framework for LLMs.☆62Updated last year
- Official Code of IdealGPT☆35Updated last year
- Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models☆44Updated last year
- ☆50Updated last year
- Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models☆90Updated last year
- 🦩 Visual Instruction Tuning with Polite Flamingo - training multi-modal LLMs to be both clever and polite! (AAAI-24 Oral)☆64Updated last year
- The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.☆98Updated 4 months ago
- mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating☆98Updated last year
- ☆91Updated last year
- 😎 curated list of awesome LMM hallucinations papers, methods & resources.☆149Updated last year
- FaithScore: Fine-grained Evaluations of Hallucinations in Large Vision-Language Models☆30Updated 6 months ago
- An benchmark for evaluating the capabilities of large vision-language models (LVLMs)☆45Updated last year
- Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"☆68Updated 3 years ago
- ☆100Updated last year
- [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning☆88Updated last year
- InstructionGPT-4☆41Updated last year
- ☆48Updated last year
- An LLM-free Multi-dimensional Benchmark for Multi-modal Hallucination Evaluation☆132Updated last year
- [NeurIPS 2024] A comprehensive benchmark for evaluating critique ability of LLMs☆46Updated 10 months ago
- This repository is maintained to release dataset and models for multimodal puzzle reasoning.☆104Updated 7 months ago
- ☆74Updated last year
- ☆40Updated 2 years ago