yangjianxin1 / ClipCap-Chinese
基于ClipCap的看图说话Image Caption模型
☆271Updated 2 years ago
Related projects: ⓘ
- 中文CLIP预训练模型☆382Updated last year
- Bridging Vision and Language Model☆279Updated last year
- transformers结构的中文OFA模型☆119Updated last year
- Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.☆164Updated last year
- ☆159Updated this week
- VLE: Vision-Language Encoder (VLE: 视觉-语言多模态预训练模型)☆178Updated last year
- Cross-lingual image captioning☆82Updated 2 years ago
- 支持中英文双语视觉-文本对话的开源可商用多模态模型。☆349Updated 11 months ago
- [AAAI2021] The code of “Similarity Reasoning and Filtration for Image-Text Matching”☆214Updated 5 months ago
- ☆155Updated 10 months ago
- Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks☆279Updated 8 months ago
- Search photos on Unsplash based on OpenAI's CLIP model, support search with joint image+text queries and attention visualization.☆206Updated 3 years ago
- 图像中文描述+视觉注意力☆182Updated 4 years ago
- Enriching MS-COCO with Chinese sentences and tags for cross-lingual multimedia tasks☆178Updated last year
- X-VLM: Multi-Grained Vision Language Pre-Training (ICML 2022)☆441Updated last year
- Implementation of CVPR 2023 paper "Prompting Large Language Models with Answer Heuristics for Knowledge-based Visual Question Answering".☆263Updated last year
- TaiSu（太素）--a large-scale Chinese multimodal dataset（亿级大规模中文视觉语言预训练数据集）☆172Updated 10 months ago
- mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)☆216Updated last year
- 一个多模态内容理解算法框架，其中包含数据处理、预训练模型、常见模型以及模型加速等模块。☆303Updated 2 years ago
- An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"☆845Updated 5 months ago
- 这是一个基于Pytorch平台、Transformer框架实现的视频描述生成 (Video Captioning) 深度学习模型。 视频描述生成任务指的是：输入一个视频，输出一句描述整个视频内容的文字（前提是视频较短且可以用一句话来描述）。本repo主要目的是帮助视力障碍…☆78Updated 2 years ago
- ☆56Updated last year
- A project that can generate ancient poems based on pictures, including CLIP, T5, GPT2 models☆17Updated last year
- A Chinese Open-Domain Dialogue System☆310Updated last year
- [MIR-2023-Survey] A continuously updated paper list for multi-modal pre-trained big models☆278Updated 2 weeks ago
- Research Code for Multimodal-Cognition Team in Ant Group☆111Updated 2 months ago
- Implementation of our CVPR2022 paper, Negative-Aware Attention Framework for Image-Text Matching.☆107Updated last year
- code for TCL: Vision-Language Pre-Training with Triple Contrastive Learning, CVPR 2022☆260Updated 2 years ago
- 多模态 MM +Chat 合集☆187Updated 2 weeks ago