woosual / multiModalityFusionForClassificationLinks
多模态数据融合:为了完成多模态数据融合,首先利用VGG16网络和cifar10数据集完成多输入网络的分类,在VGG16的基础之上,将前三层特征提取网络作为不同输入的特征提取网络,在中间层进行特征拼接,后面的卷积层用于提取融合特征,最后加上全连接层。该网络稍作修改就能同时提取两张对应的图片作为输入,在特征提取之后进行融合用于分类。
☆93Updated 4 years ago
Alternatives and similar repositories for multiModalityFusionForClassification
Users that are interested in multiModalityFusionForClassification are comparing it to the libraries listed below
Sorting:
- 使用pytorch完成的一个多模态分类任务,文本和图像部分分别使用了bert和resnet提取特征(在config里可以组合多种模型),在我的小规模数据集上取得了良好的性能(验证集acc96%)☆78Updated 2 years ago
- 本文采用基于注意力机制的卷积神经神经网络模型来实现对阿尔兹海默症疾病的分类。采用3D卷积对图像进行特征获取,通过在卷积中添加注意力机制,重点关注疾病脑图像中的患病区域,从而提高分类模型的实验精度。☆32Updated 5 years ago
- 阿尔兹海默症的识别--DataFountain☆46Updated 2 years ago
- Multimodal Fusion, Multimodal Sentiment Analysis☆23Updated 5 years ago
- This is the code for the Paper "Guilherme L. Toledo, Ricardo M. Marcacini: Transfer Learning with Joint Fine-Tuning for Multimodal Sentim…☆16Updated 2 years ago
- HiFuse: Hierarchical Multi-Scale Feature Fusion Network for Medical Image Classification☆238Updated 5 months ago
- 采用vit实现图像分类☆26Updated last year
- 基于Swin-transformer训练图像分类并部署web端☆93Updated 3 years ago
- Code for UniS-MMC: Multimodal Classification via Unimodality-supervised Multimodal Contrastive Learning (ACL 2023)☆36Updated last year
- 多模态情感分析——基于BERT+ResNet的多种融合方法☆312Updated 2 years ago
- pytorch版—使用resnet50迁移学习实现皮肤病图片的二分类☆125Updated 5 years ago
- Implementation of Resnet-50 with and without CBAM in PyTorch v1.8. Implementation tested on Intel Image Classification dataset from https…☆92Updated 3 years ago
- [ICASSP 2025] Official PyTorch code for training and inference pipeline for DepMamba: Progressive Fusion Mamba for Multimodal Depression …☆62Updated 3 months ago
- This repo is about multi-label medical image classification base on CNN and Transformer.☆26Updated last year
- 深度学习 注意力机制模块 时间 空间注意力通道☆29Updated 2 years ago
- 基于深度学习卷积神经网络的图像分类的GUI界面☆24Updated 2 years ago
- The code for our IEEE ACCESS (2020) paper Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature Fusion.☆121Updated 3 years ago
- Simple one-dimensional data classification using LSTM, CNN, FC in Pytorch☆22Updated 5 years ago
- Codes for the paper 'Automatic sleep staging by a hybrid model based on deep 1D-ResNet-SE and LSTM with single-channel raw EEG signals' h…☆23Updated 2 years ago
- pytorch实现AlexNet,在mnist数据集上实验,用精确率、召回率等指标评估,并绘制PR、ROC曲线☆20Updated 3 years ago
- ☆34Updated 9 months ago
- Two-stage Temporal Modelling Framework for Video-based Depression Recognition using Graph Representation☆25Updated 6 months ago
- ☆16Updated last year
- 商品图像检索、多模态、深度学习☆31Updated 3 years ago
- ☆10Updated 2 years ago
- 多模态融合情感分析☆131Updated 5 years ago
- Bimodal and Unimodal Sentiment Analysis of Internet Memes (Image+Text)☆16Updated 3 years ago
- Attention-Based Acoustic Feature Fusion Network for Depression Detection☆25Updated last week
- This is a multi-modal fusion method based on VGG16 and FastText for identifying useful information collected from social media platforms.…☆14Updated 3 years ago
- depression-detect Predicting depression from AVEC2014 using ResNet18.☆49Updated last year