bdytx5 / finetune_LLaVA

Related projects ⓘ

Alternatives and complementary repositories for finetune_LLaVA

• 2U1 / Llama3.2-Vision-Finetune
  An open-source implementaion for fine-tuning Llama3.2-Vision series by Meta.
  ☆84Updated 2 weeks ago
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆162Updated 6 months ago
• ECOFRI / CXR_LLaVA
  ☆26Updated 5 months ago
• richard-peng-xia / MMed-RAG
  [arXiv'24 & NeurIPSW'24] MMed-RAG: Versatile Multimodal RAG System for Medical Vision Language Models
  ☆56Updated last month
• bhimrazy / chat-with-phi-3-vision
  Chat with Phi 3.5/3 Vision LLMs. Phi-3.5-vision is a lightweight, state-of-the-art open multimodal model built upon datasets which includ…
  ☆32Updated 2 months ago
• adithya-s-k / YoloGemma
  Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…
  ☆77Updated 5 months ago
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆84Updated 2 months ago
• GaiZhenbiao / Phi3V-Finetuning
  Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.
  ☆54Updated 5 months ago
• nadsoft-opensource / RAG-with-open-source-multi-modal
  ☆17Updated 10 months ago
• shashnkvats / Indofashionclip
  Fine tuning OpenAI's CLIP model on Indian Fashion Dataset
  ☆50Updated last year
• stanfordmlgroup / ManyICL
  ☆128Updated 5 months ago
• Stanford-AIMI / CheXagent
  [Arxiv-2024] CheXagent: Towards a Foundation Model for Chest X-Ray Interpretation
  ☆117Updated 9 months ago
• SamuelSchmidgall / AgentClinic
  Agent benchmark for medical diagnosis
  ☆128Updated last month
• Vision-CAIR / MiniGPT-Med
  Open-sourced code of miniGPT-Med
  ☆82Updated 2 months ago
• standardmodelbio / Llama3-Med
  ☆24Updated last month
• elsevierlabs-os / clip-image-search
  Fine-tuning OpenAI CLIP Model for Image Search on medical images
  ☆74Updated 2 years ago
• AIAnytime / Medical-RAG-using-Meditron-7B-LLM
  Medical RAG QA App using Meditron 7B LLM, Qdrant Vector Database, and PubMedBERT Embedding Model.
  ☆44Updated 11 months ago
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆132Updated last month
• snap-stanford / med-flamingo
  ☆386Updated last year
• camenduru / LLaVA-colab
  ☆209Updated 11 months ago
• capjamesg / sam-gpt4v
  Use Grounding DINO, Segment Anything, and GPT-4V to label images with segmentation masks for use in training smaller, fine-tuned models.
  ☆65Updated 11 months ago
• AIAnytime / Fine-Tuning-Multimodal-LLM
  Fine Tuning Multimodal LLM "Idefics 9B" on Pokemon Go Dataset available on Hugging Face.
  ☆18Updated 10 months ago
• iancovert / locality-alignment
  ☆30Updated last week
• ZhilingYan / GPT4V-Medical-Report
  ☆43Updated last month
• wangermeng2021 / llm-webui
  A Gradio web UI for Large Language Models. Supports LoRA/QLoRA finetuning,RAG(Retrieval-augmented generation) and Chat
  ☆33Updated 11 months ago
• sshh12 / multi_token
  Embed arbitrary modalities (images, audio, documents, etc) into large language models.
  ☆176Updated 7 months ago
• LLaVA-VL / LLaVA-Med-preview
  ☆34Updated last year
• LHBuilder / SA-Segment-Anything
  Vision-oriented multimodal AI
  ☆49Updated 5 months ago
• togethercomputer / Dragonfly
  ☆68Updated last month
• microsoft / LLM2CLIP
  LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.
  ☆275Updated this week