多模态数据融合：为了完成多模态数据融合，首先利用VGG16网络和cifar10数据集完成多输入网络的分类，在VGG16的基础之上，将前三层特征提取网络作为不同输入的特征提取网络，在中间层进行特征拼接，后面的卷积层用于提取融合特征，最后加上全连接层。该网络稍作修改就能同时提取两张对应的图片作为输入，在特征提取之后进行融合用于分类。
☆103Sep 25, 2020Updated 5 years ago
Alternatives and similar repositories for multiModalityFusionForClassification
Users that are interested in multiModalityFusionForClassification are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 使用pytorch完成的一个多模态分类任务，文本和图像部分分别使用了bert和resnet提取特征（在config里可以组合多种模型）,在我的小规模数据集上取得了良好的性能（验证集acc96%）☆82Mar 25, 2023Updated 3 years ago
- [ACMMM 2020] Code release for "Learning Deep Multimodal Feature Representation with Asymmetric Multi-layer Fusion"☆28Aug 19, 2021Updated 4 years ago
- 融合MRI多模态的图像的不同特征进行脑梗死区分割网络（基于Unet网络更改新的网络）☆16Jun 20, 2019Updated 7 years ago
- 多模态视频分类模型☆32Nov 23, 2022Updated 3 years ago
- Attention-based Multimodal Image Feature Fusion Module for Transmission Line Detection☆17Oct 27, 2022Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Multimodal short video classification task, integrating video, image, audio and text modes for short video classification☆20Mar 12, 2020Updated 6 years ago
- EfficientGrasp model based on EfficientPose and EfficientDet to identify robotic grasps.☆10Jul 8, 2021Updated 5 years ago
- Generalized cross-modal NNs; new audiovisual benchmark (IEEE TNNLS 2019)☆31Apr 13, 2020Updated 6 years ago
- A demo for multi-modal emotion recognition.(多模态情感识别demo)☆91Apr 2, 2024Updated 2 years ago
- This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as mul…☆923Mar 15, 2023Updated 3 years ago
- Multi-modal classifications of digits with image and audio modality. One shot learning with Siamese network is used to predict if the giv…☆16Mar 25, 2023Updated 3 years ago
- Multimodal speech recognition using lipreading (with CNNs) and audio (using LSTMs). Sensor fusion is done with an attention network.☆69Nov 19, 2022Updated 3 years ago
- Multimodal Speech Recognition for phoneme level prediction using Audio-Visual data from TCDTIMIT dataset implementing RNNs with LSTMs for…☆15Jul 27, 2023Updated 3 years ago
- Multimodal Fusion, Multimodal Sentiment Analysis☆25Jun 20, 2020Updated 6 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- source code for KBS accepted Paper Multi-modal Robustness Fake News Detection with Mross-Modal and Propagation Network Contrastive Learni…☆10Dec 1, 2024Updated last year
- The goal of this project is to implement the paper 'Real-Time Grasp Detection Using Convolutional Neural Networks' by Redmon. This …☆18Aug 18, 2020Updated 5 years ago
- Abdulhamid97Mousa / Bearing-Fault-Diagnosis-Method-Based-on-Spectrum-Map-Information-Fusion-and-CNNsReproduce Published Article "Bearing Fault Diagnosis Method Based on Spectrum Map Information Fusion and Convolutional Neural Network""☆24Nov 20, 2022Updated 3 years ago
- This is a camera-radar fusion detection framework based on nuscenes dataset.☆11Aug 23, 2021Updated 4 years ago
- 基于改进YOLOv5的轴承表面缺陷测量系统（部署教程＆源码）☆10Dec 3, 2023Updated 2 years ago
- ☆10Feb 10, 2022Updated 4 years ago
- ☆27Aug 2, 2021Updated 5 years ago
- 使用BERT预训练语言模型获取评论文本的向量表示，通过Bi-GRU网络学习其中的语义特征，分别采用情感权重和注意力机制来为评论向量分配权重，动态调节其对用户特征和产品特征的影响程度，并以加权求和的方式获得用户特征和产品特征，最后利用DeepFM算法对用户特征和产品特征进行深…☆16Mar 28, 2023Updated 3 years ago
- Multimodal datasets.☆34Jan 26, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [IEEE BHI 2022] Multimodality Multi-Lead ECG Arrhythmia Classification using Self-Supervised Learning☆44Oct 4, 2024Updated last year
- Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"☆80Jun 16, 2021Updated 5 years ago
- Zero-shot fault diagnosis on the Tennessee–Eastman process by attribute fusion transfer. Paper: Attribute fusion transfer for zero-shot f…☆34Oct 12, 2023Updated 2 years ago
- Dynamic Selective Network for RGB-D Salient Object Detection☆12Jan 22, 2025Updated last year
- 用Paddle复现论文ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information（ACL2021）☆10Nov 15, 2021Updated 4 years ago
- repo for "Decision explanation and feature importance for invertible networks"☆14Nov 13, 2019Updated 6 years ago
- A Pytorch implementation of emotion recognition from videos☆18Sep 15, 2020Updated 5 years ago
- 多模态情感分析——基于BERT+ResNet的多种融合方法☆371Nov 20, 2022Updated 3 years ago
- Siamese Network and Triplet Loss for face recognition in real time☆14Jul 17, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Use CNNs to estimate a grasping point and angle of a given object, so that the robot arm can pick the object.☆30Sep 3, 2021Updated 4 years ago
- A ROS (Robotic Operating System) package for simple object detection and planar pose estimation for objects that requires only an image o…☆27Jan 15, 2024Updated 2 years ago
- The code for the paper "Multimodal Task-driven Dictionary Learning for Image Classification".☆30Nov 14, 2015Updated 10 years ago
- ISPRS第一技术委员会多模态遥感应用算法智能解译大赛-变化检测赛道解决方案☆20Jun 29, 2025Updated last year
- TianChi 2018广东工业智造大数据创新大赛——智能算法赛（复赛baseline代码）☆18Nov 6, 2018Updated 7 years ago
- SegNet, Unet, and DeepLabV3 for Semantic Segmentation using Keras.☆10Jan 19, 2023Updated 3 years ago
- This repository contains the data used for the paper "Entity Recognition at First Sight: Improving NER with Eye Movement Information" by …☆12Jan 22, 2020Updated 6 years ago