weiji-Feng / Image2Poem
A project that can generate ancient poems based on pictures, including CLIP, T5, GPT2 models
☆21Updated last month
Alternatives and similar repositories for Image2Poem:
Users that are interested in Image2Poem are comparing it to the libraries listed below
- 基于ClipCap的看图说话Image Caption模型☆296Updated 2 years ago
- 对llava官方代码的一些学习笔记☆18Updated 5 months ago
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆266Updated 6 months ago
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models☆306Updated last month
- [CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allo…☆322Updated 6 months ago
- 主要记录大语言大模型(LLMs) 算法(应用)工程师多模态相关知识☆153Updated 10 months ago
- Official repository of MMDU dataset☆86Updated 5 months ago
- The official implementation of RAR☆82Updated 11 months ago
- [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge☆132Updated 8 months ago
- 多模态 MM +Chat 合集☆247Updated last month
- Research Code for Multimodal-Cognition Team in Ant Group☆138Updated 8 months ago
- finetune stable diffusion with Dreambooth、LoRA、ControlNet☆55Updated last year
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆116Updated 4 months ago
- Building a VLM model starts from the basic module.☆13Updated 11 months ago
- ☆41Updated 8 months ago
- ☆64Updated 9 months ago
- ☆60Updated this week
- DeepSpeed教程 & 示例注释 & 学习笔记 (大模型高效训练)☆151Updated last year
- [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs☆107Updated 4 months ago
- TaiSu(太素)--a large-scale Chinese multimodal dataset(亿级大规模中文视觉语言预训练数据集)☆179Updated last year
- 一些大语言模型和多模态模型的应用,主要包括Rag,小模型,Agent,跨模态搜索,OCR等等☆156Updated 4 months ago
- Visual Instruction Tuning for Qwen2 Base Model☆26Updated 8 months ago
- [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning☆272Updated last year
- This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-vi…☆102Updated 5 months ago
- The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆199Updated 11 months ago
- ☆61Updated last year
- 训练一个对中文支持更好的LLaVA模型,并开源训练代码和数据。☆53Updated 6 months ago
- 模式识别课设代码:图文生成(CLIP+DALLE+BriVL)☆21Updated last year
- 本仓库是关于大模型面试中常见面试试题和面试经验的整理。这里收集了各类与大模型相关的面试题目,并提供详细的解答和分析。本仓库由上海交大交影社区维护☆88Updated 6 months ago