Alternatives and similar repositories for Phi-2-Vision-Language:

Users that are interested in Phi-2-Vision-Language are comparing it to the libraries listed below

• GaiZhenbiao / Phi3V-Finetuning
  Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.
  ☆58Updated 9 months ago
• wjbmattingly / qwen2-vl-finetune-huggingface
  This project is a collection of fine-tuning scripts to help researchers fine-tune Qwen 2 VL on HuggingFace datasets.
  ☆64Updated 6 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 8 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated 11 months ago
• mesolitica / multimodal-LLM
  Multi-Modal Language Modeling with Image, Audio and Text Integration, included multi-images and multi-audio in a single multiturn.
  ☆17Updated last year
• geronimi73 / 3090_shorts
  minimal LLM scripts for 24GB VRAM GPUs. training, inference, whatever
  ☆38Updated last week
• neuralwork / instruct-finetune-mistral
  Fine-tune Mistral 7B to generate fashion style suggestions
  ☆34Updated last year
• ariG23498 / fine-tune-paligemma
  Notebooks for fine tuning pali gemma
  ☆98Updated 2 months ago
• LAGoM-NLP / transtokenizer
  ☆42Updated last month
• AIAnytime / Fine-Tuning-Multimodal-LLM
  Fine Tuning Multimodal LLM "Idefics 9B" on Pokemon Go Dataset available on Hugging Face.
  ☆19Updated last year
• mallik3006 / LLM_fine_tuning_llama3_8b
  Fine-Tuning Llama3-8B LLM in a multi-GPU environment using DeepSpeed
  ☆14Updated 9 months ago
• neulab / Pangea
  This is the repo for the paper "PANGEA: A FULLY OPEN MULTILINGUAL MULTIMODAL LLM FOR 39 LANGUAGES"
  ☆104Updated 3 months ago
• zjohn77 / lightning-mlflow-hf
  Use QLoRA to tune LLM in PyTorch-Lightning w/ Huggingface + MLflow
  ☆60Updated last year
• v-prgmr / mergekit
  Tools for merging pretrained large language models.
  ☆19Updated 9 months ago
• aulukelvin / LoRA_E5
  ☆17Updated 10 months ago
• wolfecameron / lora_instruction_tune
  ☆40Updated 10 months ago
• s-smits / modernbert-finetune
  Fine-tune ModernBERT on a large Dataset with Custom Tokenizer Training
  ☆62Updated last month
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated 3 months ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆57Updated 11 months ago
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆67Updated 6 months ago
• mbzuai-oryx / PALO
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…
  ☆84Updated last month
• adithya-s-k / YoloGemma
  Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…
  ☆80Updated 9 months ago
• huggingface / pixparse
  Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data
  ☆21Updated 7 months ago
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆61Updated 7 months ago
• TIGER-AI-Lab / StructLM
  Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)
  ☆76Updated 5 months ago
• edumunozsala / llama-2-7B-4bit-python-coder
  Fine-tune and quantize Llama-2-like models to generate Python code using QLoRA, Axolot,..
  ☆64Updated last year
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆107Updated last month
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆230Updated 4 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆59Updated last year