woosual / multiModalityFusionForClassification
多模态数据融合：为了完成多模态数据融合，首先利用VGG16网络和cifar10数据集完成多输入网络的分类，在VGG16的基础之上，将前三层特征提取网络作为不同输入的特征提取网络，在中间层进行特征拼接，后面的卷积层用于提取融合特征，最后加上全连接层。该网络稍作修改就能同时提取两张对应的图片作为输入，在特征提取之后进行融合用于分类。
☆80Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for multiModalityFusionForClassification
- 本文采用基于注意力机制的卷积神经神经网络模型来实现对阿尔兹海默症疾病的分类。采用3D卷积对图像进行特征获取，通过在卷积中添加注意力机制，重点关注疾病脑图像中的患病区域，从而提高分类模型的实验精度。☆28Updated 4 years ago
- Implementation of Resnet-50 with and without CBAM in PyTorch v1.8. Implementation tested on Intel Image Classification dataset from https…☆77Updated 2 years ago
- Multimodal Fusion, Multimodal Sentiment Analysis☆20Updated 4 years ago
- 深度学习 注意力机制模块 时间 空间注意力通道☆26Updated last year
- 使用pytorch完成的一个多模态分类任务，文本和图像部分分别使用了bert和resnet提取特征（在config里可以组合多种模型）,在我的小规模数据集上取得了良好的性能（验证集acc96%）☆68Updated last year
- pytorch版—使用resnet50迁移学习实现皮肤病图片的二分类☆119Updated 5 years ago
- 阿尔兹海默症的识别--DataFountain☆40Updated last year
- 基于Swin-transformer训练图像分类并部署web端☆84Updated 2 years ago
- Simple one-dimensional data classification using LSTM, CNN, FC in Pytorch☆21Updated 5 years ago
- ☆32Updated 2 months ago
- fpn_resnet、resnet-se、resnet-cbam☆33Updated 4 years ago
- This is the code for the Paper "Guilherme L. Toledo, Ricardo M. Marcacini: Transfer Learning with Joint Fine-Tuning for Multimodal Sentim…☆15Updated 2 years ago
- AI人工智能、深度学习领域，2024年全网最全即插即用模块，包含各种卷积变种、最新注意力机制、特征融合模块、上下采样模块，持续更新中......☆121Updated this week
- Gluon implementation of channel-attention modules: SE, ECA, GCT☆37Updated 3 years ago
- ☆16Updated last year
- 多模态情感分析——基于BERT+ResNet的多种融合方法☆235Updated 2 years ago
- ☆33Updated 10 months ago
- Swin-Transformer 1D implements☆44Updated 6 months ago
- 融合MRI多模态的图像的不同特征进行脑梗死区分割网络（基于Unet网络更改新的网络）☆13Updated 5 years ago
- Code for UniS-MMC: Multimodal Classification via Unimodality-supervised Multimodal Contrastive Learning (ACL 2023)☆32Updated 5 months ago
- ☆9Updated 4 months ago
- ☆287Updated 3 years ago
- ☆21Updated 3 years ago
- DA-TransUNet: Combining Dual Attention of Position and Channel with Transformer U-net for Medical Image Segmentation☆126Updated last month
- 细粒度图像分类之十二猫分类，对比ResNet和ViT两者模型性能。☆33Updated 2 years ago
- Two-stage Temporal Modelling Framework for Video-based Depression Recognition using Graph Representation☆17Updated 4 months ago
- 商品图像检索、多模态、深度学习☆29Updated 3 years ago
- ResNet50 猫狗数据集训练☆25Updated 3 years ago
- [IEEE TIP 2022] Official implementation of MATR: Multimodal Medical Image Fusion via Multiscale Adaptive Transformer☆69Updated 8 months ago
- 可视化神经网络☆37Updated 2 years ago