本项目用于Multimodal领域新手的学习路线，包括该领域的经典论文，项目及课程。旨在希望学习者在一定的时间内达到对这个领域有较为深刻的认知，能够自己进行的独立研究。
☆50Mar 26, 2024Updated 2 years ago
Alternatives and similar repositories for Multimodal-Roadmap-for-freshman
Users that are interested in Multimodal-Roadmap-for-freshman are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for paper "Rethinking Text-based Protein Understanding: Retrieval or LLM?"☆20Oct 7, 2025Updated 8 months ago
- GPT-4V(ision) as A Social Media Analysis Engine☆39Dec 20, 2024Updated last year
- GPT as a Monte Carlo Language Tree: A Probabilistic Perspective☆46Jan 18, 2025Updated last year
- A Benchmark Platform for Reinforcement Learning Based Dynamic Treatment Regime☆15Dec 7, 2024Updated last year
- Code for PromptNet☆16Jan 29, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [npj Digital Medicine] A multimodal multidomain multilingual medical foundation model for zero shot clinical diagnosis☆19Feb 6, 2025Updated last year
- Unified Multi-modal IAA Baseline and Benchmark☆94Sep 27, 2024Updated last year
- Code for the paper "AsFT: Anchoring Safety During LLM Fune-Tuning Within Narrow Safety Basin".☆36Jul 10, 2025Updated 11 months ago
- 【Nature Computational Science 2025🔥】Deep peak property learning for efficient chiral molecules ECD spectra prediction☆51Jan 12, 2025Updated last year
- [NeurIPS 2024 D&B Spotlight🔥] ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generation☆212Apr 14, 2026Updated 2 months ago
- [ICML 2026🔥] WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation☆206Updated this week
- (TPAMI'2024) ZeroNLG: Aligning and Autoencoding Domains for Zero-Shot Multimodal and Multilingual Natural Language Generation☆22Aug 8, 2024Updated last year
- LLM Reasoning Benchmark & Chain-of-Thoughts Dataset for Chemistry☆54Oct 9, 2025Updated 8 months ago
- One-click use of AlphaFold☆13Jun 20, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [EMNLP2024] Benchmark for "Large Language Models Are Poor Clinical Decision-Makers: A Comprehensive Benchmark"☆37May 2, 2026Updated last month
- 【COLING 2025🔥】Code for the paper "Is Parameter Collision Hindering Continual Learning in LLMs?".☆38Dec 5, 2024Updated last year
- SafeSora is a human preference dataset designed to support safety alignment research in the text-to-video generation field, aiming to enh…☆35Aug 20, 2024Updated last year
- Evaluation of generated videos on the FETV benchmark☆10Apr 6, 2025Updated last year
- A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!☆139Dec 31, 2023Updated 2 years ago
- [CVPR'26] UniGame code implementation☆20Apr 21, 2026Updated last month
- Here is the official code for ICASSP 2024 "Optimal ANN-SNN Conversion with Group Neurons".☆14Mar 1, 2024Updated 2 years ago
- [NeurIPS 2022] Code for "Retrieve, Reason, and Refine: Generating Accurate and Faithful Discharge/Patient Instructions"☆37Jul 28, 2024Updated last year
- [ICCV 2025] VisRL: Intention-Driven Visual Perception via Reinforced Reasoning☆46Nov 8, 2025Updated 7 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A Real-World Goal-Step-Image Recipe Dataset☆14May 31, 2025Updated last year
- The official code for "TaxDiff: Taxonomic-Guided Diffusion Model for Protein Sequence Generation"☆75Aug 23, 2024Updated last year
- ☆17Jul 23, 2024Updated last year
- ☆11May 24, 2024Updated 2 years ago
- [CVPR 2025🔥] Enhancing Video VAE by Wavelet-Driven Energy Flow for Latent Video Diffusion Model☆202May 11, 2025Updated last year
- Placeholder☆10Jul 17, 2023Updated 2 years ago
- ThinkGen: Generalized Thinking for Visual Generation☆58Dec 30, 2025Updated 5 months ago
- A bug-free and improved implementation of LLaVA-UHD, based on the code from the official repo☆35Aug 12, 2024Updated last year
- ☆74Mar 18, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- [ECCV2022] The PyTorch implementation of paper "Equivariance and Invariance Inductive Bias for Learning from Insufficient Data"☆19Oct 12, 2022Updated 3 years ago
- Official eval code for ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generation☆26Dec 12, 2025Updated 6 months ago
- This is the official implementation of the paper "A Deep Learning Approach for Rational Ligand Generation with Property Control via React…☆20Sep 28, 2024Updated last year
- Official Implementation for "SiLVR : A Simple Language-based Video Reasoning Framework"☆19Jan 18, 2026Updated 4 months ago
- [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding☆50Jan 9, 2024Updated 2 years ago
- Molecode presents molecules as code and enables LLMs to operate and reason on chemistry directly.☆218Jun 4, 2026Updated last week
- ☆26Jun 5, 2025Updated last year