RustamyF / clip-multimodal-ml
☆57Updated last year
Alternatives and similar repositories for clip-multimodal-ml:
Users that are interested in clip-multimodal-ml are comparing it to the libraries listed below
- Implementation and evaluation of multimodal RAG with text and image inputs for industrial applications☆38Updated 3 months ago
- ☆19Updated last year
- A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.☆89Updated 2 months ago
- Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.☆58Updated 8 months ago
- ☆137Updated 9 months ago
- An open-source implementaion for fine-tuning Llama3.2-Vision series by Meta.☆136Updated last week
- Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …☆60Updated 3 months ago
- a curated list of the role of small models in the LLM era☆91Updated 5 months ago
- E5-V: Universal Embeddings with Multimodal Large Language Models☆233Updated 2 months ago
- This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…☆71Updated last year
- Playground for Transformers☆48Updated last year
- Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)☆130Updated 5 months ago
- Code for paper "Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapters" CVPR2024☆190Updated 3 months ago
- LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.☆475Updated last month
- A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision,…☆262Updated last week
- Research Code for Multimodal-Cognition Team in Ant Group☆138Updated 7 months ago
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Feature Pyramid via Hierarchical Window Transformer☆367Updated last month
- [CVPR 2024] Official Code for the Paper "Compositional Chain-of-Thought Prompting for Large Multimodal Models"☆109Updated 8 months ago
- The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.☆82Updated last month
- CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts☆143Updated 8 months ago
- [NeurIPS2023] Parameter-efficient Tuning of Large-scale Multimodal Foundation Model☆85Updated last year
- InstructionGPT-4☆39Updated last year
- This is implementation of finetuning BLIP model for Visual Question Answering☆60Updated last year
- Quick exploration into fine tuning florence 2☆302Updated 5 months ago
- A curated list of Large Language Model with RAG☆79Updated last year
- [CVPR 2025] The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive…☆230Updated last month
- The code of the paper "NExT-Chat: An LMM for Chat, Detection and Segmentation".☆236Updated last year
- official code for "Fox: Focus Anywhere for Fine-grained Multi-page Document Understanding"☆139Updated 9 months ago
- This is the official repository for Retrieval Augmented Visual Question Answering☆206Updated 2 months ago