woosual / multiModalityFusionForClassification
多模态数据融合:为了完成多模态数据融合,首先利用VGG16网络和cifar10数据集完成多输入网络的分类,在VGG16的基础之上,将前三层特征提取网络作为不同输入的特征提取网络,在中间层进行特征拼接,后面的卷积层用于提取融合特征,最后加上全连接层。该网络稍作修改就能同时提取两张对应的图片作为输入,在特征提取之后进行融合用于分类。
☆88Updated 4 years ago
Alternatives and similar repositories for multiModalityFusionForClassification:
Users that are interested in multiModalityFusionForClassification are comparing it to the libraries listed below
- 本文采用基于注意力机制的卷积神经神经网络模型来实现对阿尔兹海默症疾病的分类。采用3D卷积对图像进行特征获取,通过在卷积中添加注意力机制,重点关注疾病脑图像中的患病区域,从而提高分类模型的实验精度。☆31Updated 4 years ago
- 采用vit实现图像分类☆22Updated last year
- Implementation of Resnet-50 with and without CBAM in PyTorch v1.8. Implementation tested on Intel Image Classification dataset from https…☆87Updated 3 years ago
- 使用pytorch完成的一个多模态分类任务,文本和图像部分分别使用了bert和resnet提取特征(在config里可以组合多种模型),在我的小规模数据集上取得了良好的性能(验证集acc96%)☆77Updated 2 years ago
- 基于Swin-transformer训练图像分类并部署web端☆89Updated 2 years ago
- HiFuse: Hierarchical Multi-Scale Feature Fusion Network for Medical Image Classification☆225Updated 3 months ago
- Code for UniS-MMC: Multimodal Classification via Unimodality-supervised Multimodal Contrastive Learning (ACL 2023)☆34Updated 10 months ago
- Multimodal Fusion, Multimodal Sentiment Analysis☆23Updated 4 years ago
- 基于深度学习卷积神经网络的图像分类的GUI界面☆25Updated 2 years ago
- 阿尔兹海默症的识别--DataFountain☆45Updated 2 years ago
- 可视化神经网络☆38Updated 2 years ago
- 深度学习 注意力机制模块 时间 空间注意力通道☆29Updated last year
- [ACMMM 2020] Code release for "Learning Deep Multimodal Feature Representation with Asymmetric Multi-layer Fusion"☆28Updated 3 years ago
- 细粒度图像分类之十二猫分类,对比ResNet和ViT两者模型性能。☆45Updated 3 years ago
- This repo is about multi-label medical image classification base on CNN and Transformer.☆26Updated 11 months ago
- pytorch版—使用resnet50迁移学习实现皮肤病图片的二分类☆126Updated 5 years ago
- [CVAMD 2021] "End-to-End Learning of Fused Image and Non-Image Feature for Improved Breast Cancer Classification from MRI"☆40Updated last year
- This is a multi-modal fusion method based on VGG16 and FastText for identifying useful information collected from social media platforms.…☆12Updated 3 years ago
- ☆33Updated 7 months ago
- Dual Encoder-based Dynamic-Channel Graph Convolutional Network with Edge Enhancement for Retinal Vessel Segmentation☆18Updated 3 years ago
- 基于PyTorch框架实现的图像分类网络☆79Updated 4 years ago
- The source code for the paper titled "Sentiment Knowledge Enhanced Attention Fusion Network (SKEAFN)".☆24Updated last year
- ☆36Updated last year
- Self-attention、Non-local、SE、SK、CBAM、DANet☆469Updated 3 years ago
- fpn_resnet、resnet-se、resnet-cbam☆33Updated 5 years ago
- ☆14Updated 2 years ago
- This is the code for the Paper "Guilherme L. Toledo, Ricardo M. Marcacini: Transfer Learning with Joint Fine-Tuning for Multimodal Sentim…☆15Updated 2 years ago
- 这是各个主干网络分类模型的源码,可以用于训练自己的分类模型。☆422Updated 2 years ago
- An attention-based Multi-Scale Feature Learning Framework for Multimodal Medical Image Fusion☆32Updated last month
- ResNet50 猫狗数据集训练☆30Updated 3 years ago