taishan1994 / MiniClipLinks
动手训练一个简单的CLIP模型,加深对CLIP的理解。
☆11Updated 2 weeks ago
Alternatives and similar repositories for MiniClip
Users that are interested in MiniClip are comparing it to the libraries listed below
Sorting:
- 多模态 MM +Chat 合集☆268Updated 2 weeks ago
- ☆179Updated last year
- Research Code for Multimodal-Cognition Team in Ant Group☆147Updated 2 weeks ago
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆123Updated 6 months ago
- Building a VLM model starts from the basic module.☆16Updated last year
- 计算机视觉课程设计-基于Chinese-CLIP的图文检索系统☆66Updated last year
- LLM Tokenizer with BPE algorithm☆31Updated last year
- 一些大语言模型和多模态模型的应用,主要包括小模型,Agent,跨模态搜索,OCR、RAG、ChatBot等等☆176Updated this week
- ☆25Updated 9 months ago
- This project aims to collect and collate various datasets for multimodal large model training, including but not limited to pre-training …☆47Updated last month
- 【ArXiv】PDF-Wukong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Sampling☆117Updated 7 months ago
- 主要记录大语言大模型(LLMs) 算法(应用)工程师多模态相关知识☆198Updated last year
- 训练一个对中文支持更好的LLaVA模型,并开源训练代码和数据。☆60Updated 9 months ago
- New generation of CLIP with fine grained discrimination capability, ICML2025☆158Updated 2 weeks ago
- Build a simple basic multimodal large model from scratch. 从零搭建一个 简单的基础多模态大模型🤖☆40Updated 11 months ago
- Pytorch分布式训练框架☆80Updated this week
- Pytorch DDP Traning Demo☆23Updated 7 months ago
- 对llava官方代码的一些学习笔记☆25Updated 7 months ago
- README.md☆48Updated last year
- OpenMMLab Semantic Segmentation Toolbox and Benchmark.☆55Updated 2 years ago
- Experiments with LAVIS library to perform image2text and text2image retrieval with BLIP and BLIP2 models☆14Updated last year
- 从零到一实现了一个多模态大模型,并命名为Reyes(睿视),R:睿,eyes:眼。Reyes的参数量为8B,视觉编码器使用的是InternViT-300M-448px-V2_5,语言模型侧使用的是Qwen2.5-7B-Instruct,Reyes也通过一个两层MLP投影层连…☆13Updated 3 months ago
- Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resources☆218Updated 3 weeks ago
- 该仓库主要记录 大模型(LLMs) 算法工程师相关的面试题与我写的答案☆24Updated last year
- Turning a CLIP Model into a Scene Text Detector (CVPR2023) | Turning a CLIP Model into a Scene Text Spotter (TPAMI)☆194Updated 11 months ago
- GroundVLP: Harnessing Zero-shot Visual Grounding from Vision-Language Pre-training and Open-Vocabulary Object Detection (AAAI 2024)☆67Updated last year
- [NeurIPS2023] Parameter-efficient Tuning of Large-scale Multimodal Foundation Model☆86Updated last year
- 这是一个DiT-pytorch的代码,主要用于学习DiT结构。☆77Updated last year
- Official repo of Griffon series including v1(ECCV 2024), v2, and G☆217Updated last week
- [AAAI 2024] TagCLIP: A Local-to-Global Framework to Enhance Open-Vocabulary Multi-Label Classification of CLIP Without Training☆91Updated last year