Alternatives and similar repositories for SeTok

Users that are interested in SeTok are comparing it to the libraries listed below

• Dongping-Chen / ISG
  (ICLR 2025 Spotlight) Official code repository for Interleaved Scene Graph.
  ☆27Updated 6 months ago
• haoyu-bu / CAFe
  Code for "CAFe: Unifying Representation and Generation with Contrastive-Autoregressive Finetuning"
  ☆21Updated 4 months ago
• Liuziyu77 / MIA-DPO
  Official implement of MIA-DPO
  ☆62Updated 6 months ago
• Haochen-Wang409 / ross
  [ICLR'25] Reconstructive Visual Instruction Tuning
  ☆101Updated 3 months ago
• Share14 / ShareGemini
  ☆30Updated last year
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• FeipengMa6 / VLoRA
  [NeurIPS 2024] Visual Perception by Large Language Model’s Weights
  ☆45Updated 4 months ago
• HKUST-LongGroup / CoMM
  Official repository for CoMM Dataset
  ☆45Updated 7 months ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆60Updated last year
• xichenpan / Kosmos-G
  Official Implementation of ICLR'24: Kosmos-G: Generating Images in Context with Multimodal Large Language Models
  ☆73Updated last year
• Visual-AI / PruneVid
  The official repository for ACL2025 paper "PruneVid: Visual Token Pruning for Efficient Video Large Language Models".
  ☆50Updated 2 months ago
• TencentARC / Video-Holmes
  Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?
  ☆62Updated 3 weeks ago
• appletea233 / Temporal-R1
  Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency
  ☆47Updated 2 months ago
• showlab / MovieSeq
  [ECCV 2024] Learning Video Context as Interleaved Multimodal Sequences
  ☆40Updated 4 months ago
• PolyU-ChenLab / ETBench
  👾 E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding (NeurIPS 2024)
  ☆60Updated 6 months ago
• linzhiqiu / visual_gpt_score
  VisualGPTScore for visio-linguistic reasoning
  ☆27Updated last year
• yale-nlp / TOMATO
  ☆28Updated 8 months ago
• wuw2019 / LoTLIP
  [NeurIPS 2024] Official PyTorch implementation of LoTLIP: Improving Language-Image Pre-training for Long Text Understanding
  ☆43Updated 6 months ago
• callsys / ControlCap
  [ECCV 2024] ControlCap: Controllable Region-level Captioning
  ☆78Updated 9 months ago
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆48Updated 4 months ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆72Updated 10 months ago
• sterzhang / PVIT
  Official Repository of Personalized Visual Instruct Tuning
  ☆32Updated 5 months ago
• wdrink / OpenTokenizer
  ☆21Updated 6 months ago
• showlab / VideoLISA
  [NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos
  ☆128Updated 7 months ago
• Cooperx521 / ScaleCap
  Official repository of 'ScaleCap: Inference-Time Scalable Image Captioning via Dual-Modality Debiasing’
  ☆52Updated last month
• yaolinli / DeCo
  Code for DeCo: Decoupling token compression from semanchc abstraction in multimodal large language models
  ☆61Updated 3 weeks ago
• dhg-wei / TOPA
  (NeurIPS 2024 Spotlight) TOPA: Extend Large Language Models for Video Understanding via Text-Only Pre-Alignment
  ☆31Updated 10 months ago
• showlab / UniRL
  The code repository of UniRL
  ☆36Updated 2 months ago
• lxtGH / DenseWorld-1M
  Code and dataset link for "DenseWorld-1M: Towards Detailed Dense Grounded Caption in the Real World"
  ☆89Updated last month
• SilentView / LVD-2M
  [NeurIPS 2024 D&B Track] Official Repo for "LVD-2M: A Long-take Video Dataset with Temporally Dense Captions"
  ☆65Updated 9 months ago