Alternatives and similar repositories for PEAK:

Users that are interested in PEAK are comparing it to the libraries listed below

• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆32Updated last year
• yikangshen / MoA
  Mixture of Attention Heads
  ☆41Updated 2 years ago
• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆33Updated 3 months ago
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• TIGER-AI-Lab / VISTA
  This repo contains code for "VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by VIdeo SpatioTemporal Augmentation"
  ☆11Updated last month
• yiren-jian / BLIText
  [NeurIPS 2023] Bootstrapping Vision-Language Learning with Decoupled Language Pre-training
  ☆24Updated last year
• twinkle0331 / LGTM
  [ACL 2023] Code for paper “Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation”(https://arxiv.org/abs/2305.…
  ☆38Updated last year
• gzcch / Bingo
  ☆54Updated 10 months ago
• FreedomIntelligence / TRIM
  We introduce new approach, Token Reduction using CLIP Metric (TRIM), aimed at improving the efficiency of MLLMs without sacrificing their…
  ☆12Updated 2 months ago
• LooperXX / ManagerTower
  Code for ACL 2023 Oral Paper: ManagerTower: Aggregating the Insights of Uni-Modal Experts for Vision-Language Representation Learning
  ☆11Updated last month
• Optimization-AI / fast_clip
  ☆22Updated 4 months ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆35Updated 4 months ago
• lancopku / clip-openness
  [ACL 2023] Delving into the Openness of CLIP
  ☆23Updated 2 years ago
• AllanYangZhou / generative-invariance-transfer
  ☆26Updated 2 years ago
• WOWNICE / ssl-small
  Code implementation for paper "On the Efficacy of Small Self-Supervised Contrastive Models without Distillation Signals".
  ☆16Updated 3 years ago
• mshukor / eP-ALM
  [ICCV23] Official implementation of eP-ALM: Efficient Perceptual Augmentation of Language Models.
  ☆27Updated last year
• lapisrocks / DiscreteAdversarialDistillation
  [NeurIPS 2023] Official repository for "Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models"
  ☆12Updated 8 months ago
• UCSC-VLAA / Sight-Beyond-Text
  [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
  ☆19Updated last year
• archiki / RepARe
  ☆19Updated last year
• xiangyu-mm / EasyGen
  The official code for paper "EasyGen: Easing Multimodal Generation with a Bidirectional Conditional Diffusion Model and LLMs"
  ☆73Updated 3 months ago
• swaggy-TN / EfficientVLM
  EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning (ACL 2023)
  ☆24Updated last year
• tianyi-lab / Mosaic-IT
  Mosaic IT: Enhancing Instruction Tuning with Data Mosaics
  ☆17Updated last week
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated last year
• ggjy / vision_weak_to_strong
  ☆37Updated last year
• OpenGVLab / DiffAgent
  [CVPR 2024] DiffAgent: Fast and Accurate Text-to-Image API Selection with Large Language Model
  ☆17Updated 10 months ago
• maszhongming / ParaKnowTransfer
  Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"
  ☆32Updated 9 months ago
• radarFudan / Curse-of-memory
  Curse-of-memory phenomenon of RNNs in sequence modelling
  ☆19Updated this week