本项目提供一个从零开始构建多模态大模型（MLLM）的完整实践路径，使用纯 PyTorch 手写 Transformer、Vision Transformer 和 GPT-style LLM，并通过 Connector 融合成可“看图说话”的多模态模型。同时，项目支持基于 SCST 的强化学习微调，实现从监督训练到奖励优化的端到端扩展。
☆36May 12, 2026Updated 5 months ago
Alternatives and similar repositories for MLLM_from_scratch_with_extension
Users that are interested in MLLM_from_scratch_with_extension are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official repo for ”Rethinking Token-Level Policy Optimization for Multimodal Chain-of-Thought“☆29Mar 29, 2026Updated 6 months ago
- Implementation of Motion Artifacts on wearable PPG signals for ambulatory heart rate monitoring☆12Nov 21, 2022Updated 3 years ago
- [MICCAI-STACOM 2022] This repository is the official implementation of "Learning correspondences of cardiac motion from images using biom…☆13Sep 30, 2022Updated 4 years ago
- ☆14Aug 14, 2022Updated 4 years ago
- 毕业设计开源代码 分别实现了抽取式中文文本摘要和生成式中文文本摘要☆18Feb 23, 2026Updated 7 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Official Repo for paper "VLCache: Computing 2% Vision Tokens and Reusing 98% for Vision-Language Inference"☆16Mar 28, 2026Updated 6 months ago
- The Pytorch implemetation of "FeatWalk: Enhancing Few-Shot Classification through Local View Leveraging", AAAI 2024.☆11Mar 4, 2024Updated 2 years ago
- 新手友好的基于 Qwen2 的生成式推荐系统，通过 大模型理解用户偏好生成候选物品，融合 TF-IDF 关键词召回、热门物品召回构建多源策略，平衡相关性与多样性。采用 LightGBM 排序模型精准打分，内置召回率、NDCG 等评估指标量化效果。通过 Flask 封装 API…☆57Dec 6, 2025Updated 10 months ago
- Global 3D Map Construction using RTAB-Map iPhone/iPad app data☆13Jun 15, 2021Updated 5 years ago
- CBLUE2.0-关系抽取模型，基于pytorch☆18Oct 23, 2024Updated last year
- Implementation for Residual Registration Network (R2Net)☆15Aug 4, 2023Updated 3 years ago
- ☆12Jul 19, 2020Updated 6 years ago
- ☆24Feb 16, 2022Updated 4 years ago
- Re-implementation of the paper KinectFusion: Real-Time Dense Surface Mapping and Tracking☆11Jan 3, 2021Updated 5 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- This code is written to participate in the MRBrainS18 competition.☆20Jan 17, 2022Updated 4 years ago
- 天池新闻推荐项目☆70May 17, 2025Updated last year
- ☆11Jun 16, 2020Updated 6 years ago
- 历年EMNLP论文和开源项目合集，包含EMNLP2025、EMNLP2024、EMNLP2023、EMNLP2022、EMNLP2021。☆18Jul 16, 2025Updated last year
- [STACOM-MICCAI 2019] Deep Learning Registration for Cardiac Motion Tracking☆17Jan 30, 2024Updated 2 years ago
- A curated list of zero-shot captioning papers☆24Aug 26, 2023Updated 3 years ago
- 录制Android手机的图像和IMU数据，标定并运行VINS-Mono☆12Mar 4, 2022Updated 4 years ago
- ☆14Feb 28, 2019Updated 7 years ago
- Alpha,deap,数字货币☆14Dec 9, 2020Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆15Jan 31, 2024Updated 2 years ago
- 丁立中的大模型算法工程作品集。聚焦 LLM / VLM 全链路的复现与优化，涵盖：① 预训练与微调（Pretrain / SFT / MoE / 多模态对齐）；② 强化学习对齐（PPO / GRPO / DAPO，含多奖励函数与 GAE）；③ 知识蒸馏（离线 KL 蒸馏、在…☆17May 26, 2026Updated 4 months ago
- verify OrderBook Tick Data Trading Strategy on futures.☆17Mar 21, 2019Updated 7 years ago
- 通过icp解决evo分析轨迹时，SLAM输出的轨迹和gt轨迹无法对齐的问题☆15Apr 3, 2024Updated 2 years ago
- [ICML2026] Reproduce Kimi K1.5/K2 RL algorithm and rollout system☆21Apr 9, 2026Updated 6 months ago
- IJCV 2025☆21Jun 16, 2025Updated last year
- MVS-VIO: Dense Monocular Visual Inertial Odometry with Lightweight MVSNET☆13Apr 21, 2023Updated 3 years ago
- BroadBEV: Collaborative LiDAR-camera Fusion for Broad-sighted Bird's Eye View Map Construction, in 2024 ICRA.☆14May 2, 2024Updated 2 years ago
- 天津大学幻灯片（PPT or Slide）模板，由LaTeX Beamer制作，基于Berlin主题，可用于毕业设计答辩、项目答辩、小组展示等多方面，允许输出优美的数学公式和算法代码。☆22May 29, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This GitHub repo features a project on monocular depth estimation for 3D mapping and path planning in partially known environments using …☆12Apr 25, 2023Updated 3 years ago
- Deep learning cardiac segmentation and motion tracking☆30Nov 12, 2019Updated 6 years ago
- [CVPR2025] The implementation of the paper "OODD: Test-time Out-of-Distribution Detection with Dynamic Dictionary".☆19May 9, 2025Updated last year
- 机构级 A股量化系统 - Hermes 多智能体 + Barra 中性化 + Level2 微结构 + 15 个圈内 tricks 完整实现☆28Aug 4, 2026Updated 2 months ago
- 利用Wind API更新周频与月频因子☆12Sep 3, 2019Updated 7 years ago
- Library that creates a TSDF from a depth image and inserts it into an Octree (Octomap)☆14Jan 15, 2014Updated 12 years ago
- Bird-eye view map construction for a mobile robot based on RGB and point cloud input☆20Aug 5, 2022Updated 4 years ago