Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.
☆73Jun 7, 2021Updated 5 years ago
Alternatives and similar repositories for Multimodal-action-recognition
Users that are interested in Multimodal-action-recognition are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Generalized cross-modal NNs; new audiovisual benchmark (IEEE TNNLS 2019)☆31Apr 13, 2020Updated 6 years ago
- Pytorch implementation of DSR-RL for Video Summarization Task☆12Aug 30, 2021Updated 4 years ago
- Multimodal speech recognition using lipreading (with CNNs) and audio (using LSTMs). Sensor fusion is done with an attention network.☆69Nov 19, 2022Updated 3 years ago
- MMAct Challenge☆13Jun 20, 2021Updated 5 years ago
- Chinese BERT classification with tf2.0 and audio classification with mfcc☆14Dec 2, 2020Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆108Aug 24, 2022Updated 3 years ago
- (2020) Video Classification Neural Network☆30Feb 18, 2020Updated 6 years ago
- A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"☆83Feb 25, 2022Updated 4 years ago
- Emotion analysis on DREAMER dataset using various Deep Learning Techniques☆13Jan 1, 2021Updated 5 years ago
- ☆15Aug 13, 2020Updated 5 years ago
- A search engine implementation using OpenAI's clip model☆10Jun 20, 2021Updated 5 years ago
- Pretraining summarization models using a corpus of nonsense☆13Sep 28, 2021Updated 4 years ago
- Tensorflow implementation of "Hide-and-Seek: Forcing a Network to be Meticulous for Weakly-supervised Object and Action Localization"[ICC…☆13Mar 29, 2019Updated 7 years ago
- A Pytorch implementation of emotion recognition from videos☆18Sep 15, 2020Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as mul…☆922Mar 15, 2023Updated 3 years ago
- ☆26Nov 23, 2021Updated 4 years ago
- Code for paper "Cross-Modal Global Interaction and Local Alignment for Audio-Visual Speech Recognition"☆18Jun 21, 2023Updated 3 years ago
- Deep learning-aided muticarrier systems (MC-AE)☆10Dec 8, 2020Updated 5 years ago
- A re-implementation of the CVPR19 paper Quantization Networks on CIFAR-10, MNIST and ImageNet☆10Aug 9, 2020Updated 5 years ago
- acnn for text-independent speaker recognition☆10Feb 8, 2022Updated 4 years ago
- ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning. In ICCV, 2021.☆64Nov 18, 2021Updated 4 years ago
- FG2021: Cross Attentional AV Fusion for Dimensional Emotion Recognition☆34Nov 29, 2024Updated last year
- A web-based template for hosting systems for real-time music HCI.☆14Jul 6, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Code for the paper: Audio-Visual Model Distillation Using Acoustic Images☆21Mar 24, 2023Updated 3 years ago
- A multimodal UAV assistant dataset.☆11Jun 14, 2021Updated 5 years ago
- An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"☆366Jul 25, 2024Updated 2 years ago
- Hand Gesture Controlled Tello Drone using Python and OpenCV 2021☆12Jun 6, 2022Updated 4 years ago
- ☆15May 10, 2026Updated 2 months ago
- Study into Pointnet and Pointnet++ for possible enhancement☆12Nov 13, 2018Updated 7 years ago
- ☆11Jul 3, 2018Updated 8 years ago
- Video Transformer Network☆41Jun 8, 2021Updated 5 years ago
- PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models.☆62Jun 28, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Simple phoenix setup for padded window management☆13Apr 25, 2018Updated 8 years ago
- Resources for: Cross-Lingual Disaster-related Multi-label Tweet Classification with Manifold Mixup (ACL SRW 2020)☆11Sep 9, 2021Updated 4 years ago
- ☆21Oct 27, 2025Updated 8 months ago
- Code used to run experiments for the ICLR 2023 paper "Computational Language Acquisition with Theory of Mind".☆15Apr 27, 2023Updated 3 years ago
- PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning☆88Jul 7, 2021Updated 5 years ago
- Annotated dataset of quadrotor Eagle for object detection of UAVs☆15Apr 4, 2022Updated 4 years ago
- ☆11Feb 17, 2017Updated 9 years ago