togethercomputer / Dragonfly

Related projects: ⓘ

• kongds / E5-V
  E5-V: Universal Embeddings with Multimodal Large Language Models
  ☆148Updated 2 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆76Updated 6 months ago
• EternityYW / Gemini-Commonsense-Evaluation
  Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"
  ☆35Updated 8 months ago
• multimodal-interpretability / maia
  Official implementation of MAIA, A Multimodal Automated Interpretability Agent
  ☆56Updated last month
• CERC-AAI / Robin
  ☆62Updated 5 months ago
• XiaoduoAILab / XmodelVLM
  ☆55Updated 3 months ago
• mbzuai-oryx / PALO
  (WACV 2025) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, Hindi, B…
  ☆77Updated last week
• vis-nlp / ChartGemma
  ☆50Updated 2 months ago
• apple / ml-rpm-bench
  ☆36Updated last month
• huggingface / chug
  Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
  ☆150Updated 5 months ago
• reka-ai / reka-vibe-eval
  Multimodal language model benchmark, featuring challenging examples
  ☆144Updated last month
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆115Updated 2 weeks ago
• anguyen8 / vision-llms-are-blind
  ☆99Updated 3 weeks ago
• gregor-ge / mBLIP
  ☆84Updated 8 months ago
• stanfordmlgroup / ManyICL
  ☆116Updated 3 months ago
• Netflix / videoannotator
  ☆38Updated 4 months ago
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆87Updated 8 months ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆67Updated 3 weeks ago
• prometheus-eval / prometheus-vision
  [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…
  ☆51Updated last week
• voidism / Lookback-Lens
  Official implementation for the paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention M…
  ☆95Updated last month
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆73Updated 6 months ago
• jiasenlu / LL3M
  LL3M: Large Language and Multi-Modal Model in Jax
  ☆62Updated 4 months ago
• huggingface / m4-logs
  M4 experiment logbook
  ☆56Updated last year
• KaiNylund / lm-weights-encode-time
  ☆68Updated last month
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆39Updated 3 weeks ago
• Yushi-Hu / VisualSketchpad
  Codes for Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
  ☆93Updated last month
• UCSC-VLAA / Recap-DataComp-1B
  This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"
  ☆115Updated 3 months ago
• lucidrains / AMIE-pytorch
  Implementation of the general framework for AMIE, from the paper "Towards Conversational Diagnostic AI", out of Google Deepmind
  ☆51Updated this week
• LAGoM-NLP / transtokenizer
  ☆23Updated last month
• naver-ai / model-stock
  Model Stock: All we need is just a few fine-tuned models
  ☆75Updated 5 months ago