多模态数据融合：为了完成多模态数据融合，首先利用VGG16网络和cifar10数据集完成多输入网络的分类，在VGG16的基础之上，将前三层特征提取网络作为不同输入的特征提取网络，在中间层进行特征拼接，后面的卷积层用于提取融合特征，最后加上全连接层。该网络稍作修改就能同时提取两张对应的图片作为输入，在特征提取之后进行融合用于分类。
☆102Sep 25, 2020Updated 5 years ago
Alternatives and similar repositories for multiModalityFusionForClassification
Users that are interested in multiModalityFusionForClassification are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 使用pytorch完成的一个多模态分类任务，文本和图像部分分别使用了bert和resnet提取特征（在config里可以组合多种模型）,在我的小规模数据集上取得了良好的性能（验证集acc96%）☆83Mar 25, 2023Updated 3 years ago
- [ACMMM 2020] Code release for "Learning Deep Multimodal Feature Representation with Asymmetric Multi-layer Fusion"☆28Aug 19, 2021Updated 4 years ago
- Multimodal classification solution for the SIGIR eCOM using Co-attention and transformer language models☆19Aug 17, 2020Updated 5 years ago
- 融合MRI多模态的图像的不同特征进行脑梗死区分割网络（基于Unet网络更改新的网络）☆15Jun 20, 2019Updated 6 years ago
- 多模态视频分类模型☆31Nov 23, 2022Updated 3 years ago
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- Multimodal short video classification task, integrating video, image, audio and text modes for short video classification☆20Mar 12, 2020Updated 6 years ago
- ☆15Sep 22, 2021Updated 4 years ago
- Generalized cross-modal NNs; new audiovisual benchmark (IEEE TNNLS 2019)☆31Apr 13, 2020Updated 6 years ago
- A demo for multi-modal emotion recognition.(多模态情感识别demo)☆91Apr 2, 2024Updated 2 years ago
- This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as mul…☆912Mar 15, 2023Updated 3 years ago
- It is an implementation of research paper with title 'Multimodal deep networks for text and image-based document classification'☆13Jul 31, 2021Updated 4 years ago
- Multimodal speech recognition using lipreading (with CNNs) and audio (using LSTMs). Sensor fusion is done with an attention network.☆69Nov 19, 2022Updated 3 years ago
- The goal of this project is to implement the paper 'Real-Time Grasp Detection Using Convolutional Neural Networks' by Redmon. This …☆18Aug 18, 2020Updated 5 years ago
- Multimodal Speech Recognition for phoneme level prediction using Audio-Visual data from TCDTIMIT dataset implementing RNNs with LSTMs for…☆15Jul 27, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 1D CNN to do classification☆10Nov 27, 2018Updated 7 years ago
- Orientation Attentive Robot Grasp Synthesis☆26Dec 8, 2023Updated 2 years ago
- Abdulhamid97Mousa / Bearing-Fault-Diagnosis-Method-Based-on-Spectrum-Map-Information-Fusion-and-CNNsReproduce Published Article "Bearing Fault Diagnosis Method Based on Spectrum Map Information Fusion and Convolutional Neural Network""☆25Nov 20, 2022Updated 3 years ago
- 商品图像检索、多模态、深度学习☆32Nov 25, 2021Updated 4 years ago
- 使用BERT预训练语言模型获取评论文本的向量表示，通过Bi-GRU网络学习其中的语义特征，分别采用情感权重和注意力机制来为评论向量分配权重，动态调节其对用户特征和产品特征的影响程度，并以加权求和的方式获得用户特征和产品特征，最后利用DeepFM算法对用户特征和产品特征进行深…☆16Mar 28, 2023Updated 3 years ago
- ☆27Aug 2, 2021Updated 4 years ago
- Implementation of CVPR 2020 paper "MMTM: Multimodal Transfer Module for CNN Fusion"☆121Jun 16, 2020Updated 5 years ago
- Pytorch Implementation of Tensor Fusion Networks for multimodal sentiment analysis.☆193Apr 5, 2020Updated 6 years ago
- Multimodal datasets.☆34Jan 26, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The Gearbox Fault Diagnosis dataset consists of vibration data recorded using SpectraQuest’s Gearbox Fault Diagnostics Simulator. The dat…☆43Dec 1, 2025Updated 4 months ago
- ☆11Mar 21, 2022Updated 4 years ago
- Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"☆81Jun 16, 2021Updated 4 years ago
- Zero-shot fault diagnosis on the Tennessee–Eastman process by attribute fusion transfer. Paper: Attribute fusion transfer for zero-shot f…☆34Oct 12, 2023Updated 2 years ago
- Using GANs to augment medical imaging data to improve classification accuracy☆12Jan 21, 2018Updated 8 years ago
- ☆10Feb 10, 2022Updated 4 years ago
- A Pytorch implementation of emotion recognition from videos☆18Sep 15, 2020Updated 5 years ago
- ☆14Mar 17, 2019Updated 7 years ago
- 多模态情感分析——基于BERT+ResNet的多种融合方法☆363Nov 20, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Use CNNs to estimate a grasping point and angle of a given object, so that the robot arm can pick the object.☆30Sep 3, 2021Updated 4 years ago
- Using GAN to create synthetic and partially synthetic EEG data to augment training sets for motor imagery interaction tasks☆13Aug 27, 2019Updated 6 years ago
- ☆10Oct 7, 2021Updated 4 years ago
- SegNet, Unet, and DeepLabV3 for Semantic Segmentation using Keras.☆10Jan 19, 2023Updated 3 years ago
- This is the repository for "Efficient Low-rank Multimodal Fusion with Modality-Specific Factors", Liu and Shen, et. al. ACL 2018☆275May 31, 2020Updated 5 years ago
- Matlab Code for Bispectral Analysis of Signals☆18Feb 25, 2018Updated 8 years ago
- A deep learning-based medical image registration package based on PyTorch.☆21Apr 1, 2026Updated last week