Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.
☆73Jun 7, 2021Updated 5 years ago
Alternatives and similar repositories for Multimodal-action-recognition
Users that are interested in Multimodal-action-recognition are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Pytorch implementation of DSR-RL for Video Summarization Task☆12Aug 30, 2021Updated 5 years ago
- ☆109Aug 24, 2022Updated 4 years ago
- Multimodal speech recognition using lipreading (with CNNs) and audio (using LSTMs). Sensor fusion is done with an attention network.☆69Nov 19, 2022Updated 4 years ago
- Chinese BERT classification with tf2.0 and audio classification with mfcc☆14Dec 2, 2020Updated 5 years ago
- Efficient Personalized Speech Enhancement through Self-Supervised Learning☆24Mar 12, 2023Updated 3 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"☆85Feb 25, 2022Updated 4 years ago
- ☆14Mar 29, 2023Updated 3 years ago
- SMS-NLINV: Simultaneous Multi-Slice MRI Using NLINV☆10Aug 13, 2025Updated last year
- (2020) Video Classification Neural Network☆30Feb 18, 2020Updated 6 years ago
- ☆14Aug 13, 2020Updated 6 years ago
- This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as mul…☆923Mar 15, 2023Updated 3 years ago
- Multimodal datasets.☆33Jan 26, 2024Updated 2 years ago
- Emotion analysis on DREAMER dataset using various Deep Learning Techniques☆13Jan 1, 2021Updated 5 years ago
- Foal-Net:Enhancing Modal Fusion by Alignment and Label Matching for Multimodal Emotion Recognition☆11Jan 9, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Codebase for Imperial MSc AI Individual Project - Self-Supervised Learning for Audio Inference☆11May 6, 2023Updated 3 years ago
- Transformer Speech Recognition☆10Apr 10, 2024Updated 2 years ago
- Code for paper "Cross-Modal Global Interaction and Local Alignment for Audio-Visual Speech Recognition"☆18Jun 21, 2023Updated 3 years ago
- ☆25Nov 23, 2021Updated 4 years ago
- Predicting Political Instability and Social Conflicts Using Multimodal Data☆10Jun 6, 2016Updated 10 years ago
- Code for paper "Robust SENSE reconstruction of simultaneous multislice EPI with low-rank enhanced coil sensitivity calibration and slice-…☆12Apr 14, 2024Updated 2 years ago
- Zicx's Notebook.☆10Nov 7, 2025Updated last year
- video summarization lstm-gan pytorch implementation☆27Dec 6, 2019Updated 6 years ago
- Interaction-Aware Trajectory Prediction Method Based on Sparse Spatial-Temporal Transformer for Internet of Vehicles☆12Mar 19, 2026Updated 8 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Unsupervised Film Genre Classification using Spatio-Temporal Contrastive Learning☆32Aug 3, 2023Updated 3 years ago
- acnn for text-independent speaker recognition☆10Feb 8, 2022Updated 4 years ago
- Deep learning-aided muticarrier systems (MC-AE)☆10Dec 8, 2020Updated 5 years ago
- Implementation of "With a Little Help from my Temporal Context: Multimodal Egocentric Action Recognition, BMVC, 2021" in PyTorch☆20Dec 16, 2021Updated 4 years ago
- Official pytorch implementation of I2I translation with low resolution conditioning☆23Sep 2, 2021Updated 5 years ago
- Official PyTorch implementation of paper Leveraging Unimodal Self Supervised Learning for Multimodal Audio-Visual Speech Recognition (ACL…☆69Jul 13, 2022Updated 4 years ago
- Attacks against proposed image encryption schemes☆10Apr 27, 2020Updated 6 years ago
- crawl profiles of Japanese PornStars from Javhoo.com☆13Feb 8, 2020Updated 6 years ago
- Code for the paper: Audio-Visual Model Distillation Using Acoustic Images☆21Mar 24, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- (Competition) 6th -- Scene-Text-Detection-and-Recognition.☆11Jun 14, 2022Updated 4 years ago
- Dataset for the paper "RGBD1K: A Large-scale Dataset and Benchmark for RGB-D Object Tracking".☆22Dec 10, 2025Updated 11 months ago
- ☆12Sep 24, 2026Updated last month
- Self-Supervised Learning by Cross-Modal Audio-Video Clustering (NeurIPS 2020)☆91Oct 24, 2022Updated 4 years ago
- Generation tool for offset-resistant audio adversarial examples against Deepspeech☆10Oct 5, 2020Updated 6 years ago
- PROJETO FINAL - Comunicação por luz visível (VLC):Análise e síntese por simulação utilizando o MATLAB. Autores: Gabrielle Cristina de Sou…☆11Mar 1, 2021Updated 5 years ago
- A python module that implements a simplified low-density parity-check (LDPC) code.☆10Jan 31, 2021Updated 5 years ago
Are these results useful?