多模态数据融合：为了完成多模态数据融合，首先利用VGG16网络和cifar10数据集完成多输入网络的分类，在VGG16的基础之上，将前三层特征提取网络作为不同输入的特征提取网络，在中间层进行特征拼接，后面的卷积层用于提取融合特征，最后加上全连接层。该网络稍作修改就能同时提取两张对应的图片作为输入，在特征提取之后进行融合用于分类。
☆103Sep 25, 2020Updated 5 years ago
Alternatives and similar repositories for multiModalityFusionForClassification
Users that are interested in multiModalityFusionForClassification are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 使用pytorch完成的一个多模态分类任务，文本和图像部分分别使用了bert和resnet提取特征（在config里可以组合多种模型）,在我的小规模数据集上取得了良好的性能（验证集acc96%）☆82Mar 25, 2023Updated 3 years ago
- Multimodal classification solution for the SIGIR eCOM using Co-attention and transformer language models☆19Aug 17, 2020Updated 5 years ago
- [ACMMM 2020] Code release for "Learning Deep Multimodal Feature Representation with Asymmetric Multi-layer Fusion"☆28Aug 19, 2021Updated 4 years ago
- 融合MRI多模态的图像的不同特征进行脑梗死区分割网络（基于Unet网络更改新的网络）☆16Jun 20, 2019Updated 7 years ago
- 多模态视频分类模型☆32Nov 23, 2022Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Global-local Multimodal Fusion Driving Behavior Classification Network☆14Feb 2, 2023Updated 3 years ago
- Multimodal short video classification task, integrating video, image, audio and text modes for short video classification☆20Mar 12, 2020Updated 6 years ago
- [CVAMD 2021] "End-to-End Learning of Fused Image and Non-Image Feature for Improved Breast Cancer Classification from MRI"☆43Jul 27, 2023Updated 2 years ago
- ☆15Sep 22, 2021Updated 4 years ago
- Using CNN for classifying 101 different food categories - using VGG16, Alex Net and SVM☆10Jan 6, 2020Updated 6 years ago
- A demo for multi-modal emotion recognition.(多模态情感识别demo)☆91Apr 2, 2024Updated 2 years ago
- This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as mul…☆922Mar 15, 2023Updated 3 years ago
- Multi-modal classifications of digits with image and audio modality. One shot learning with Siamese network is used to predict if the giv…☆16Mar 25, 2023Updated 3 years ago
- A fine multimodality fusion network :)☆10Aug 9, 2021Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Multimodal Speech Recognition for phoneme level prediction using Audio-Visual data from TCDTIMIT dataset implementing RNNs with LSTMs for…☆15Jul 27, 2023Updated 2 years ago
- 1D CNN to do classification☆10Nov 27, 2018Updated 7 years ago
- Abdulhamid97Mousa / Bearing-Fault-Diagnosis-Method-Based-on-Spectrum-Map-Information-Fusion-and-CNNsReproduce Published Article "Bearing Fault Diagnosis Method Based on Spectrum Map Information Fusion and Convolutional Neural Network""☆24Nov 20, 2022Updated 3 years ago
- ☆10Feb 10, 2022Updated 4 years ago
- 使用BERT预训练语言模型获取评论文本的向量表示，通过Bi-GRU网络学习其中的语义特征，分别采用情感权重和注意力机制来为评论向量分配权重，动态调节其对用户特征和产品特征的影响程度，并以加权求和的方式获得用户特征和产品特征，最后利用DeepFM算法对用户特征和产品特征进行深…☆16Mar 28, 2023Updated 3 years ago
- Classification of human emotion using multi-modal models☆12Jun 27, 2020Updated 6 years ago
- Pytorch Implementation of Tensor Fusion Networks for multimodal sentiment analysis.☆193Apr 5, 2020Updated 6 years ago
- Implementation of CVPR 2020 paper "MMTM: Multimodal Transfer Module for CNN Fusion"☆121Jun 16, 2020Updated 6 years ago
- Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"☆80Jun 16, 2021Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Zero-shot fault diagnosis on the Tennessee–Eastman process by attribute fusion transfer. Paper: Attribute fusion transfer for zero-shot f…☆34Oct 12, 2023Updated 2 years ago
- 用Paddle复现论文ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information（ACL2021）☆10Nov 15, 2021Updated 4 years ago
- Using GANs to augment medical imaging data to improve classification accuracy☆12Jan 21, 2018Updated 8 years ago
- Matlab Code for Bispectral Analysis of Signals☆18Feb 25, 2018Updated 8 years ago
- Using GAN to create synthetic and partially synthetic EEG data to augment training sets for motor imagery interaction tasks☆13Aug 27, 2019Updated 6 years ago
- MachineLearningSamples-AerialImageClassification☆18Jun 28, 2019Updated 7 years ago
- ☆16Jun 22, 2023Updated 3 years ago
- TianChi 2018广东工业智造大数据创新大赛——智能算法赛（复赛baseline代码）☆18Nov 6, 2018Updated 7 years ago
- This repository contains the data used for the paper "Entity Recognition at First Sight: Improving NER with Eye Movement Information" by …☆12Jan 22, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Code for "SUGAR: Subgraph Neural Network with Reinforcement Pooling and Self-Supervised Mutual Information Mechanism""☆10Apr 17, 2021Updated 5 years ago
- Automatically segment the vertebra from spinal X-ray images with UNet☆10Oct 3, 2023Updated 2 years ago
- ☆11Apr 10, 2025Updated last year
- Weaved deep aggregation network based on NAS☆16Sep 3, 2021Updated 4 years ago
- Parallel support implementation of "aggregated residual transformations for deep neural networks" using keras☆12Mar 3, 2021Updated 5 years ago
- This repository is the implementation of our paper: Local Correntropy Matrix Representation for Hyperspectral Image Classification, which…☆10Apr 21, 2022Updated 4 years ago
- 首届中国心电智能大赛决赛阶段解决方案-公开版 比赛网址 http://mdi.ids.tsinghua.edu.cn/☆10Aug 21, 2019Updated 6 years ago