Alternatives and similar repositories for Discriminative-Multi-modality-Speech-Recognition

Users that are interested in Discriminative-Multi-modality-Speech-Recognition are comparing it to the libraries listed below

• xing96 / MIM-lipreading
  Code and model for paper <Mutual Information Maximization for Effective Lip Reading>
  ☆20Updated 4 years ago
• VIPL-Audio-Visual-Speech-Understanding / VIPL-AVSU-Group
  Collection of works from VIPL-AVSU
  ☆44Updated 2 weeks ago
• fuankarion / active-speakers-context
  Code for the Active Speakers in Context Paper (CVPR2020)
  ☆54Updated 4 years ago
• ms-dot-k / Multi-head-Visual-Audio-Memory
  PyTorch implementation of "Distinguishing Homophenes using Multi-Head Visual-Audio Memory" (AAAI2022)
  ☆27Updated last year
• arxrean / LipRead-seq2seq
  An unofficial (PyTorch) implementation for the paper Deep Lip Reading: A comparison of models and an online application.
  ☆10Updated 5 years ago
• LUMIA-Group / Leveraging-Self-Supervised-Learning-for-AVSR
  Official PyTorch implementation of paper Leveraging Unimodal Self Supervised Learning for Multimodal Audio-Visual Speech Recognition (ACL…
  ☆65Updated 2 years ago
• ms-dot-k / Visual-Audio-Memory
  PyTorch implementation of "Multi-modality Associative Bridging through Memory: Speech Sound Recollected from Face Video" (ICCV2021)
  ☆20Updated 3 years ago
• ms-dot-k / LRW_ID
  The speaker-labeled information of LRW dataset, which is the outcome of the paper "Speaker-adaptive Lip Reading with User-dependent Paddi…
  ☆10Updated last year
• zhilangtaosha / SpeakerVerification_AMSoftmax_pytorch
  SE-Resnet+AMSoftmax for Speaker Verification
  ☆47Updated 6 years ago
• NirHeaven / D3D
  The proposed method in LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the Wild
  ☆25Updated 6 years ago
• lilianemomeni / KWS-Net
  Seeing Wake Words: Audio-visual Keyword Spotting
  ☆65Updated 4 years ago
• iariav / End-to-End-VAD
  an Audio-Visual Voice Activity Detection using Deep Learning
  ☆49Updated 6 years ago
• bobchennan / sparse_image_warp_pytorch
  Pytorch implementation of sparse_image_warp and an example of GoogleBrain's SpecAugment is given: A Simple Data Augmentation Method for A…
  ☆23Updated 5 years ago
• SuchismitaSahu1993 / Lipreading-Using-Mutimodal-Speech-Recognition
  Multimodal Speech Recognition for phoneme level prediction using Audio-Visual data from TCDTIMIT dataset implementing RNNs with LSTMs for…
  ☆14Updated last year
• uark-cviu / Right2Talk
  [ICCV'21] The Right to Talk: An Audio-Visual Transformer Approach
  ☆20Updated 3 years ago
• afourast / avobjects
  Implementation for ECCV20 paper "Self-Supervised Learning of audio-visual objects from video"
  ☆113Updated 4 years ago
• tcvrick / audioset-vggish-tensorflow-to-pytorch
  Script for converting the pretrained VGGish model provided with AudioSet from TensorFlow to PyTorch, along with a basic smoke test.
  ☆87Updated 6 years ago
• joonson / voxceleb_unsupervised
  Augmentation adversarial training for self-supervised speaker recognition
  ☆77Updated 3 years ago
• okankop / ASDNet
  Audio-Visual Active Speaker Detection with PyTorch on AVA-ActiveSpeaker dataset
  ☆62Updated 3 years ago
• jingyunx / Deformation-Flow-Based-Two-stream-Network-for-Lip-Reading
  ☆16Updated 3 years ago
• VIPL-Audio-Visual-Speech-Understanding / Lipreading-DenseNet3D
  DenseNet3D Model In "LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the Wild", https://arxiv.org/abs/1810.069…
  ☆118Updated 4 years ago
• clovaai / lookwhostalking
  Look Who’s Talking: Active Speaker Detection in the Wild
  ☆72Updated last year
• tuanchien / asd
  Active Speaker Detection
  ☆19Updated 4 years ago
• YapengTian / CCOL-CVPR21
  Cyclic Co-Learning of Sounding Object Visual Grounding and Sound Separation
  ☆25Updated 3 years ago
• SRA2 / SPELL
  Learning Long-Term Spatial-Temporal Graphs for Active Speaker Detection (ECCV 2022)
  ☆65Updated last year
• georgesterpu / avsr-tf1
  Audio-Visual Speech Recognition using Sequence to Sequence Models
  ☆82Updated 4 years ago
• DanielMengLiu / DeepLip
  deep-learning based audio-visual lip bometrics
  ☆14Updated 2 years ago
• VIPL-Audio-Visual-Speech-Understanding / deep-face-speechreading
  Visual speech recognition with face inputs: code and models for F&G 2020 paper "Can We Read Speech Beyond the Lips? Rethinking RoI Select…
  ☆18Updated 4 years ago
• joannahong / Lip2Wav-pytorch
  a PyTorch implementation of Lip2Wav
  ☆50Updated 2 years ago
• celebrity-audio-collection / videoprocess
  CN-Celeb, a large-scale Chinese celebrities dataset published by Center for Speech and Language Technology (CSLT) at Tsinghua University.
  ☆74Updated 5 years ago