本项目用于Multimodal领域新手的学习路线，包括该领域的经典论文，项目及课程。旨在希望学习者在一定的时间内达到对这个领域有较为深刻的认知，能够自己进行的独立研究。
☆49Mar 26, 2024Updated 2 years ago
Alternatives and similar repositories for Multimodal-Roadmap-for-freshman
Users that are interested in Multimodal-Roadmap-for-freshman are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for paper "Rethinking Text-based Protein Understanding: Retrieval or LLM?"☆21Oct 7, 2025Updated 7 months ago
- GPT-4V(ision) as A Social Media Analysis Engine☆39Dec 20, 2024Updated last year
- GPT as a Monte Carlo Language Tree: A Probabilistic Perspective☆46Jan 18, 2025Updated last year
- A Benchmark Platform for Reinforcement Learning Based Dynamic Treatment Regime☆15Dec 7, 2024Updated last year
- Code for PromptNet☆16Jan 29, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [npj Digital Medicine] A multimodal multidomain multilingual medical foundation model for zero shot clinical diagnosis☆18Feb 6, 2025Updated last year
- Unified Multi-modal IAA Baseline and Benchmark☆94Sep 27, 2024Updated last year
- Code for the paper "AsFT: Anchoring Safety During LLM Fune-Tuning Within Narrow Safety Basin".☆36Jul 10, 2025Updated 9 months ago
- 【Nature Computational Science 2025🔥】Deep peak property learning for efficient chiral molecules ECD spectra prediction☆51Jan 12, 2025Updated last year
- [NeurIPS 2024 D&B Spotlight🔥] ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generation☆211Apr 14, 2026Updated 3 weeks ago
- WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation☆193Apr 25, 2026Updated last week
- (TPAMI'2024) ZeroNLG: Aligning and Autoencoding Domains for Zero-Shot Multimodal and Multilingual Natural Language Generation☆22Aug 8, 2024Updated last year
- LLM Reasoning Benchmark & Chain-of-Thoughts Dataset for Chemistry☆51Oct 9, 2025Updated 6 months ago
- One-click use of AlphaFold☆13Jun 20, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Single-image test-time domain adaptation for segmentation models.☆26Apr 16, 2024Updated 2 years ago
- 【COLING 2025🔥】Code for the paper "Is Parameter Collision Hindering Continual Learning in LLMs?".☆38Dec 5, 2024Updated last year
- SafeSora is a human preference dataset designed to support safety alignment research in the text-to-video generation field, aiming to enh…☆34Aug 20, 2024Updated last year
- A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!☆138Dec 31, 2023Updated 2 years ago
- [CVPR'26] UniGame code implementation☆19Apr 21, 2026Updated 2 weeks ago
- Here is the official code for ICASSP 2024 "Optimal ANN-SNN Conversion with Group Neurons".☆14Mar 1, 2024Updated 2 years ago
- [ICCV 2025] VisRL: Intention-Driven Visual Perception via Reinforced Reasoning☆46Nov 8, 2025Updated 5 months ago
- InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discovery (COLING 2025)☆54Dec 2, 2024Updated last year
- ☆11May 24, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [CVPR 2025🔥] Enhancing Video VAE by Wavelet-Driven Energy Flow for Latent Video Diffusion Model☆202May 11, 2025Updated 11 months ago
- ThinkGen: Generalized Thinking for Visual Generation☆53Dec 30, 2025Updated 4 months ago
- This repo is the official implementation of "RecLMIS: Cross-Modal Conditioned Reconstruction for Language-guided Medical Image Segmentati…☆32Jun 19, 2025Updated 10 months ago
- A bug-free and improved implementation of LLaVA-UHD, based on the code from the official repo☆35Aug 12, 2024Updated last year
- [ECCV2022] The PyTorch implementation of paper "Equivariance and Invariance Inductive Bias for Learning from Insufficient Data"☆19Oct 12, 2022Updated 3 years ago
- Official eval code for ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generation☆27Dec 12, 2025Updated 4 months ago
- This is the official implementation of the paper "A Deep Learning Approach for Rational Ligand Generation with Property Control via React…☆20Sep 28, 2024Updated last year
- Official Implementation for "SiLVR : A Simple Language-based Video Reasoning Framework"☆19Jan 18, 2026Updated 3 months ago
- [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding☆49Jan 9, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…☆103Nov 9, 2024Updated last year
- [ICML 2025] X-Transfer Attacks: Towards Super Transferable Adversarial Attacks on CLIP☆44Feb 3, 2026Updated 3 months ago
- ☆32Apr 18, 2025Updated last year
- Official Implementation for CVPR 2023 paper "Divide and Conquer: Answering Questions with Object Factorization and Compositional Reasonin…☆10Jun 16, 2024Updated last year
- FGVC Aircraft dataset by classes folder☆13Nov 7, 2024Updated last year
- FlashSampling: Fast and Memory-Efficient Exact Sampling (https://huggingface.co/papers/2603.15854)☆70Apr 25, 2026Updated last week
- Code for our ICCV 2023 paper "Parametric Information Maximization for Generalized Category Discovery"☆16Jun 17, 2024Updated last year