ChenDelong1999 / polite-flamingo
𦩠Visual Instruction Tuning with Polite Flamingo - training multi-modal LLMs to be both clever and polite! (AAAI-24 Oral)
β63Updated last year
Alternatives and similar repositories for polite-flamingo:
Users that are interested in polite-flamingo are comparing it to the libraries listed below
- β59Updated last year
- MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuningβ135Updated last year
- β89Updated last year
- Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Modelsβ37Updated last year
- β94Updated last year
- Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Modelsβ43Updated 8 months ago
- β132Updated last year
- [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''β78Updated 10 months ago
- Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".β58Updated last year
- (ACL'2023) MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioningβ35Updated 6 months ago
- Touchstone: Evaluating Vision-Language Models by Language Modelsβ82Updated last year
- β28Updated 3 months ago
- A collection of visual instruction tuning datasets.β76Updated 11 months ago
- SVIT: Scaling up Visual Instruction Tuningβ164Updated 8 months ago
- β65Updated 2 months ago
- The official GitHub page for ''What Makes for Good Visual Instructions? Synthesizing Complex Visual Reasoning Instructions for Visual Insβ¦β18Updated last year
- The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".β32Updated last year
- [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language modelβ33Updated 3 months ago
- β138Updated 3 months ago
- Source code for EMNLP 2022 paper βPEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Modelsββ48Updated 2 years ago
- [CVPR-2023] The official dataset of Advancing Visual Grounding with Scene Knowledge: Benchmark and Method.β29Updated last year
- LAVIS - A One-stop Library for Language-Vision Intelligenceβ47Updated 6 months ago
- VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMsβ37Updated 4 months ago
- [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversationβ47Updated last year
- [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Modelsβ141Updated 9 months ago
- Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimizationβ81Updated last year
- ChatBridge, an approach to learning a unified multimodal model to interpret, correlate, and reason about various modalities without relyβ¦β50Updated last year
- VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)β26Updated 7 months ago
- [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"β53Updated last year
- MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteriaβ63Updated 4 months ago