RustamyF / clip-multimodal-mlLinks
☆63Updated last year
Alternatives and similar repositories for clip-multimodal-ml
Users that are interested in clip-multimodal-ml are comparing it to the libraries listed below
Sorting:
- An open-source implementaion for fine-tuning Llama3.2-Vision series by Meta.☆163Updated 2 months ago
- Implementation and evaluation of multimodal RAG with text and image inputs for industrial applications☆55Updated 8 months ago
- ☆20Updated last year
- A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.☆94Updated 7 months ago
- This is implementation of finetuning BLIP model for Visual Question Answering☆77Updated last year
- The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.☆93Updated last month
- This is the official repository for Retrieval Augmented Visual Question Answering☆231Updated 7 months ago
- Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.☆59Updated last year
- A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision,…☆312Updated 5 months ago
- InstructionGPT-4☆39Updated last year
- This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…☆77Updated last month
- Parameter-Efficient Fine-Tuning for Foundation Models☆77Updated 3 months ago
- This project aims to collect and collate various datasets for multimodal large model training, including but not limited to pre-training …☆51Updated 2 months ago
- ☆142Updated last year
- Playground for Transformers☆51Updated last year
- ☆48Updated 3 months ago
- Research Code for Multimodal-Cognition Team in Ant Group☆159Updated 2 weeks ago
- Research Trends in LLM-guided Multimodal Learning.☆357Updated last year
- ☆366Updated 5 months ago
- MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphs☆196Updated last month
- This project is a collection of fine-tuning scripts to help researchers fine-tune Qwen 2 VL on HuggingFace datasets.☆73Updated last week
- Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning☆197Updated last year
- Fine-tuning Qwen2.5-VL for vision-language tasks | Optimized for Vision understanding | LoRA & PEFT support.☆101Updated 5 months ago
- a family of highly capabale yet efficient large multimodal models☆185Updated 11 months ago
- ☆28Updated 11 months ago
- CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts☆151Updated last year
- Multilingual Medicine: Model, Dataset, Benchmark, Code☆192Updated 9 months ago
- The code of the paper "NExT-Chat: An LMM for Chat, Detection and Segmentation".☆246Updated last year
- [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"☆522Updated last year
- 📚 Text Classification with LoRA (Low-Rank Adaptation) of Language Models - Efficiently fine-tune large language models for text classifi…☆52Updated last year