ZhangYiqun018 / Multimodel-DialogLinks
自己阅读的多模态对话系统论文(及部分笔记)汇总
☆23Updated 2 years ago
Alternatives and similar repositories for Multimodel-Dialog
Users that are interested in Multimodel-Dialog are comparing it to the libraries listed below
Sorting:
- ☆84Updated last year
- ☆59Updated last year
- [SIGIR'24] The official implementation code of MOELoRA.☆185Updated last year
- An benchmark for evaluating the capabilities of large vision-language models (LVLMs)☆46Updated 2 years ago
- This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-vi…☆116Updated 5 months ago
- MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)☆44Updated 5 months ago
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆137Updated last year
- mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating☆98Updated last year
- Official repo for "AlignGPT: Multi-modal Large Language Models with Adaptive Alignment Capability"☆34Updated last year
- ☆87Updated last year
- Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)☆169Updated last year
- Codebase for ACL 2023 paper "Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models' Memori…☆52Updated 2 years ago
- Code and model for AAAI 2024: UMIE: Unified Multimodal Information Extraction with Instruction Tuning☆44Updated last year
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆33Updated 9 months ago
- Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics,…☆124Updated 6 months ago
- A Self-Training Framework for Vision-Language Reasoning☆87Updated 10 months ago
- A RLHF Infrastructure for Vision-Language Models☆187Updated last year
- ☆168Updated last year
- An Arena-style Automated Evaluation Benchmark for Detailed Captioning☆56Updated 6 months ago
- Official repository of MMDU dataset☆98Updated last year
- ☆27Updated last year
- [ICML'2024] Can AI Assistants Know What They Don't Know?☆84Updated last year
- Offical Repository of "AtomThink: Multimodal Slow Thinking with Atomic Step Reasoning"☆57Updated 2 weeks ago
- Paper, dataset and code list for multimodal dialogue.☆22Updated 11 months ago
- [ICLR 2025] ChartMimic: Evaluating LMM’s Cross-Modal Reasoning Capability via Chart-to-Code Generation☆126Updated 5 months ago
- [NeurIPS 2024] MATH-Vision dataset and code to measure multimodal mathematical reasoning capabilities.☆123Updated 6 months ago
- [MM 2025] CMM-Math: A Chinese Multimodal Math Dataset To Evaluate and Enhance the Mathematics Reasoning of Large Multimodal Models☆48Updated last year
- (ICLR'25) A Comprehensive Framework for Developing and Evaluating Multimodal Role-Playing Agents☆89Updated 10 months ago
- This is the official repository for Retrieval Augmented Visual Question Answering☆242Updated 11 months ago
- Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)☆55Updated last year