RustamyF / clip-multimodal-mlLinks
☆65Updated last year
Alternatives and similar repositories for clip-multimodal-ml
Users that are interested in clip-multimodal-ml are comparing it to the libraries listed below
Sorting:
- ☆20Updated last year
- Implementation and evaluation of multimodal RAG with text and image inputs for industrial applications☆62Updated 10 months ago
- An open-source implementaion for fine-tuning Llama3.2-Vision series by Meta.☆170Updated last week
- A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.☆96Updated 9 months ago
- Playground for Transformers☆53Updated last year
- ☆30Updated last year
- This is implementation of finetuning BLIP model for Visual Question Answering☆83Updated last year
- ☆43Updated 2 months ago
- Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.☆58Updated last year
- LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.☆546Updated 2 months ago
- FInetuning CLIP for Few Shot Learning☆45Updated 3 years ago
- Fine-tuning Qwen2.5-VL for vision-language tasks | Optimized for Vision understanding | LoRA & PEFT support.☆123Updated 7 months ago
- ☆48Updated 5 months ago
- Research Code for Multimodal-Cognition Team in Ant Group☆165Updated 2 months ago
- The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.☆97Updated 3 months ago
- Composition of Multimodal Language Models From Scratch☆15Updated last year
- InstructionGPT-4☆41Updated last year
- Experiments with LAVIS library to perform image2text and text2image retrieval with BLIP and BLIP2 models☆15Updated last year
- This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…☆80Updated 3 months ago
- Building a VLM model starts from the basic module.☆18Updated last year
- ☆141Updated last year
- This is the official repository for Retrieval Augmented Visual Question Answering☆237Updated 9 months ago
- ☆369Updated 7 months ago
- A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision,…☆334Updated 6 months ago
- Quick exploration into fine tuning florence 2☆330Updated last year
- Parameter-Efficient Fine-Tuning for Foundation Models☆93Updated 5 months ago
- Multilingual Medicine: Model, Dataset, Benchmark, Code☆194Updated 11 months ago
- [NeurIPS2023] Parameter-efficient Tuning of Large-scale Multimodal Foundation Model☆89Updated last year
- Florence-2☆70Updated 7 months ago
- ☆27Updated 2 months ago