Alternatives and similar repositories for clip-multimodal-ml

Users that are interested in clip-multimodal-ml are comparing it to the libraries listed below

• 2U1 / Llama3.2-Vision-Finetune
  An open-source implementaion for fine-tuning Llama3.2-Vision series by Meta.
  ☆173Updated 2 months ago
• dino-chiio / blip-vqa-finetune
  This is implementation of finetuning BLIP model for Visual Question Answering
  ☆83Updated 2 years ago
• riedlerm / multimodal_rag_for_industry
  Implementation and evaluation of multimodal RAG with text and image inputs for industrial applications
  ☆65Updated last year
• GaiZhenbiao / Phi3V-Finetuning
  Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.
  ☆58Updated last year
• zhangfaen / finetune-InternVL2
  ☆31Updated last year
• Montinger / Transformer-Workbench
  Playground for Transformers
  ☆53Updated 2 years ago
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆97Updated last year
• matthewchung74 / qwen_2_5_3B_GRPO_medical_thinking
  ☆47Updated 8 months ago
• marslanm / Multimodality-Representation-Learning
  This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…
  ☆82Updated 6 months ago
• mishra-18 / ML-Models
  ☆48Updated 6 months ago
• nadsoft-opensource / RAG-with-open-source-multi-modal
  ☆20Updated 2 years ago
• sandy1990418 / Finetune-Qwen2.5-VL
  Fine-tuning Qwen2.5-VL for vision-language tasks | Optimized for Vision understanding | LoRA & PEFT support.
  ☆145Updated 11 months ago
• MAGIC-AI4Med / MMedLM
  [Nature Communications] The official codes for "Towards Building Multilingual Language Model for Medicine"
  ☆273Updated 8 months ago
• fshnkarimi / Fine-tuning-an-LLM-using-LoRA
  📚 Text Classification with LoRA (Low-Rank Adaptation) of Language Models - Efficiently fine-tune large language models for text classifi…
  ☆55Updated 2 years ago
• alexander-moore / vlm
  Composition of Multimodal Language Models From Scratch
  ☆15Updated last year
• XuRui314 / GLM4v-Finetune
  Support finetuning GLM4v with zero2
  ☆15Updated last year
• LinWeizheDragon / Retrieval-Augmented-Visual-Question-Answering
  This is the official repository for Retrieval Augmented Visual Question Answering
  ☆243Updated last year
• xinyanghuang7 / Basic-Visual-Language-Model
  Build a simple basic multimodal large model from scratch. 从零搭建一个简单的基础多模态大模型🤖
  ☆47Updated last year
• enrico310786 / image_text_retrieval_BLIP_BLIP2
  Experiments with LAVIS library to perform image2text and text2image retrieval with BLIP and BLIP2 models
  ☆15Updated 2 years ago
• zhangfaen / finetune-Qwen2-VL
  ☆385Updated 11 months ago
• LinWeizheDragon / FLMR
  The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.
  ☆104Updated 7 months ago
• FreedomIntelligence / Apollo
  Multilingual Medicine: Model, Dataset, Benchmark, Code
  ☆197Updated last year
• NExT-ChatV / NExT-Chat
  The code of the paper "NExT-Chat: An LMM for Chat, Detection and Segmentation".
  ☆253Updated last year
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆252Updated last year
• UCSC-VLAA / MedReason
  MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphs
  ☆249Updated 6 months ago
• williamliujl / Qilin-Med-VL
  The first Chinese medical large vision-language model designed to integrate the analysis of textual and visual data
  ☆64Updated 2 years ago
• rbiswasfc / llm-detect-ai
  1st Place Solution for LLM - Detect AI Generated Text Kaggle Competition
  ☆209Updated last year
• OpenGVLab / Multi-Modality-Arena
  Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing imag…
  ☆553Updated last year
• YixiangCh / MRD-RAG
  ☆27Updated 6 months ago
• BUAADreamer / Chinese-LLaVA-Med
  中文医学多模态大模型 Large Chinese Language-and-Vision Assistant for BioMedicine
  ☆100Updated last year