多模态数据融合：为了完成多模态数据融合，首先利用VGG16网络和cifar10数据集完成多输入网络的分类，在VGG16的基础之上，将前三层特征提取网络作为不同输入的特征提取网络，在中间层进行特征拼接，后面的卷积层用于提取融合特征，最后加上全连接层。该网络稍作修改就能同时提取两张对应的图片作为输入，在特征提取之后进行融合用于分类。
☆103Sep 25, 2020Updated 6 years ago
Alternatives and similar repositories for multiModalityFusionForClassification
Users that are interested in multiModalityFusionForClassification are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- (2D+3D图像数据)多模态融合分类ResNet☆11Aug 26, 2021Updated 5 years ago
- [ACMMM 2020] Code release for "Learning Deep Multimodal Feature Representation with Asymmetric Multi-layer Fusion"☆28Aug 19, 2021Updated 5 years ago
- 融合MRI多模态的图像的不同特征进行脑梗死区分割网络（基于Unet网络更改新的网络）☆16Jun 20, 2019Updated 7 years ago
- 多模态视频分类模型☆33Nov 23, 2022Updated 3 years ago
- Attention-based Multimodal Image Feature Fusion Module for Transmission Line Detection☆17Oct 27, 2022Updated 4 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Multimodal short video classification task, integrating video, image, audio and text modes for short video classification☆20Mar 12, 2020Updated 6 years ago
- Multimodal speech recognition using lipreading (with CNNs) and audio (using LSTMs). Sensor fusion is done with an attention network.☆69Nov 19, 2022Updated 3 years ago
- A demo for multi-modal emotion recognition.(多模态情感识别demo)☆89Apr 2, 2024Updated 2 years ago
- ☆15Sep 22, 2021Updated 5 years ago
- 多模态融合情感分析☆142May 15, 2020Updated 6 years ago
- ☆14Aug 24, 2018Updated 8 years ago
- A fine multimodality fusion network :)☆10Aug 9, 2021Updated 5 years ago
- 本项目实现了一种基于小波变换（多尺度变换）的红外与可见光图像融合算法。该算法通过在不同尺度上提取图像的多层次信息，有效融合红外图像的热目标信息和可见光图像的细节纹理信息，从而生成包含两种图像优势特征的融合图像。 红外图像能够在夜间或低光环境下显示目标的热信息，而可见光图像…☆28Mar 13, 2025Updated last year
- Multi-modal classifications of digits with image and audio modality. One shot learning with Siamese network is used to predict if the giv…☆17Mar 25, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Multimodal Speech Recognition for phoneme level prediction using Audio-Visual data from TCDTIMIT dataset implementing RNNs with LSTMs for…☆15Jul 27, 2023Updated 3 years ago
- The goal of this project is to implement the paper 'Real-Time Grasp Detection Using Convolutional Neural Networks' by Redmon. This …☆18Aug 18, 2020Updated 6 years ago
- Orientation Attentive Robot Grasp Synthesis☆26Dec 8, 2023Updated 2 years ago
- ☆12Oct 1, 2024Updated 2 years ago
- Emotion analysis on DREAMER dataset using various Deep Learning Techniques☆13Jan 1, 2021Updated 5 years ago
- A multimodal architecture to build multimodal knowledge graphs with flexible multimodal feature extraction and dynamic multimodal concept…☆11May 13, 2023Updated 3 years ago
- This is a camera-radar fusion detection framework based on nuscenes dataset.☆11Aug 23, 2021Updated 5 years ago
- ☆27Aug 2, 2021Updated 5 years ago
- ☆11Feb 10, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [IEEE BHI 2022] Multimodality Multi-Lead ECG Arrhythmia Classification using Self-Supervised Learning☆43Oct 4, 2024Updated 2 years ago
- Implementation of CVPR 2020 paper "MMTM: Multimodal Transfer Module for CNN Fusion"☆123Jun 16, 2020Updated 6 years ago
- Multimodal datasets.☆33Jan 26, 2024Updated 2 years ago
- ☆37Jul 13, 2022Updated 4 years ago
- Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"☆80Jun 16, 2021Updated 5 years ago
- 多模态情感分析——基于BERT+ResNet的多种融合方法☆379Nov 20, 2022Updated 3 years ago
- Computer Vision Final Project. Implementation of Paper "Adversarial Feature Hallucination Networks for Few-Shot Learning".☆11Dec 27, 2020Updated 5 years ago
- ☆10Oct 7, 2021Updated 5 years ago
- Code for "SUGAR: Subgraph Neural Network with Reinforcement Pooling and Self-Supervised Mutual Information Mechanism""☆10Apr 17, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Zero-shot fault diagnosis on the Tennessee–Eastman process by attribute fusion transfer. Paper: Attribute fusion transfer for zero-shot f…☆34Oct 12, 2023Updated 3 years ago
- Keras Functional API for multiple inputs and mixed data☆11Feb 18, 2019Updated 7 years ago
- Source code for our paper accepted for publication at USENIX NSDI 2022☆12Nov 7, 2022Updated 4 years ago
- The objective is to process by generating textual description from an image – based on the objects and actions in the image. Using genera…☆27Dec 17, 2021Updated 4 years ago
- A ROS (Robotic Operating System) package for simple object detection and planar pose estimation for objects that requires only an image o…☆27Jan 15, 2024Updated 2 years ago
- ☆42May 29, 2021Updated 5 years ago
- SegNet, Unet, and DeepLabV3 for Semantic Segmentation using Keras.☆10Jan 19, 2023Updated 3 years ago