weiji-Feng / Image2PoemLinks
A project that can generate ancient poems based on pictures, including CLIP, T5, GPT2 models
☆22Updated 7 months ago
Alternatives and similar repositories for Image2Poem
Users that are interested in Image2Poem are comparing it to the libraries listed below
Sorting:
- 该项目旨在通过输入文本描述来检索与之相匹配的图片。☆42Updated 2 years ago
- 基于ClipCap的看图说话Image Caption模型☆315Updated 3 years ago
- Building a VLM model starts from the basic module.☆18Updated last year
- [MIR-2023-Survey] A continuously updated paper list for multi-modal pre-trained big models☆289Updated 2 months ago
- Research Code for Multimodal-Cognition Team in Ant Group☆167Updated 3 months ago
- 主要记录大语言大模型(LLMs) 算法(应用)工程师多模态相关知识☆246Updated last year
- Visual Instruction Tuning for Qwen2 Base Model☆38Updated last year
- [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge☆153Updated last month
- 对llava官方代码的一些学习笔记☆29Updated last year
- mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections. (EMNLP 2022)☆96Updated 2 years ago
- This is the first released survey paper on hallucinations of large vision-language models (LVLMs). To keep track of this field and contin…☆78Updated last year
- ☆57Updated last year
- Official implementation of "Open-Vocabulary Multi-Label Classification via Multi-Modal Knowledge Transfer".☆129Updated 11 months ago
- The official code for NeurIPS 2024 paper: Harmonizing Visual Text Comprehension and Generation☆130Updated 10 months ago
- 多模态 MM +Chat 合集☆276Updated last month
- ☆72Updated 5 months ago
- Towards Efficient and Effective Text-to-Video Retrieval with Coarse-to-Fine Visual Representation Learning☆19Updated 7 months ago
- ☆50Updated 2 years ago
- 自己阅读的多模态对话系统论文(及部分笔记)汇总☆23Updated 2 years ago
- SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation☆122Updated last year
- [CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allo…☆375Updated last year
- The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.☆42Updated last year
- This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-vi…☆115Updated 3 months ago
- [ACM MM25] The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"☆92Updated 2 months ago
- InstructionGPT-4☆41Updated last year
- transformers结构的中文OFA模型☆135Updated 2 years ago
- Code for paper: Visual Signal Enhancement for Object Hallucination Mitigation in Multimodal Large language Models☆33Updated 9 months ago
- TaiSu(太素)--a large-scale Chinese multimodal dataset(亿级大规模中文视觉语言预训练数据集)☆191Updated last year
- This is the official repository for Retrieval Augmented Visual Question Answering☆238Updated 9 months ago
- This project aims to collect and collate various datasets for multimodal large model training, including but not limited to pre-training …☆57Updated 5 months ago