With the aim of building next generation virtual assistants that can handle multimodal inputs and perform multimodal actions, we introduce two new datasets (both in the virtual shopping domain), the annotation schema, the core technical tasks, and the baseline models. The code for the baselines and the datasets will be opensourced.
☆133Oct 21, 2023Updated 2 years ago
Alternatives and similar repositories for simmc
Users that are interested in simmc are comparing it to the libraries listed below
Sorting:
- Code for SIMMC 2.0: A Task-oriented Dialog Dataset for Immersive Multimodal Conversations☆106Nov 12, 2022Updated 3 years ago
- DSTC9 Track 1 - Beyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access☆105Jun 12, 2023Updated 2 years ago
- Code for the paper Multimodal Transformer Networks for End-to-End Video-Grounded Dialogue Systems (ACL19)☆100Oct 17, 2022Updated 3 years ago
- ✨ Official PyTorch Implementation for EMNLP'19 Paper, "Dual Attention Networks for Visual Reference Resolution in Visual Dialog"☆45Mar 19, 2023Updated 2 years ago
- A synthetic dataset of dialogs we authored and annotated for references (pronouns, etc.). This dataset is discussed in the paper "MuDoCo:…☆24Mar 24, 2022Updated 3 years ago
- Repository to generate CLEVR-Dialog: A diagnostic dataset for Visual Dialog☆49Feb 18, 2020Updated 6 years ago
- Data & Code for ACCENTOR: "Adding Chit-Chat to Enhance Task-Oriented Dialogues" (NAACL 2021)☆72Oct 12, 2021Updated 4 years ago
- ☆46Apr 24, 2022Updated 3 years ago
- ☆35Apr 10, 2018Updated 7 years ago
- Baseline implementation for DSTC8 User Response Prediction Challenge☆72Jun 12, 2023Updated 2 years ago
- ☆13Mar 25, 2023Updated 2 years ago
- Code for Navigating Connected Memories with a Task-oriented Dialog System☆17Dec 12, 2022Updated 3 years ago
- [CVPR 2017] AMT chat interface code used to collect the Visual Dialog dataset☆78Jun 10, 2022Updated 3 years ago
- ☆95Jun 1, 2018Updated 7 years ago
- AAAI 2021: "UBAR: Towards Fully End-to-End Task-Oriented Dialog System with GPT-2"☆97Mar 10, 2021Updated 4 years ago
- Please see the readme file as well as our 2019 EMNLP paper linked here -->☆219Apr 24, 2024Updated last year
- GuessWhat?! Baselines☆74Jul 12, 2022Updated 3 years ago
- Visual Coreference Resolution in Visual Dialog using Neural Module Networks☆57Oct 12, 2021Updated 4 years ago
- Transformer model for the Amazon Topical-Chat Corpus. Baselines for DSTC9 Track 3.☆19Jul 9, 2020Updated 5 years ago
- Pytorch implementation of https://arxiv.org/pdf/1909.10470.pdf☆32Aug 23, 2021Updated 4 years ago
- ☆35May 1, 2023Updated 2 years ago
- A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modeling☆23Jul 31, 2021Updated 4 years ago
- ☆10Jul 24, 2019Updated 6 years ago
- Starter code in PyTorch for the Visual Dialog challenge☆189Mar 24, 2023Updated 2 years ago
- DSTC10 Track 2 - Knowledge-grounded Task-oriented Dialogue Modeling on Spoken Conversations☆62Jul 25, 2023Updated 2 years ago
- Evaluating Visual Conversational Agents via Cooperative Human-AI Games☆23Nov 22, 2022Updated 3 years ago
- Dataset for Visually Indicated Sound Generation by Perceptually Optimized Classification☆22Apr 6, 2020Updated 5 years ago
- Dialogue Knowledge Transfer Networks (DiKTNet)☆24Jun 21, 2022Updated 3 years ago
- DSTC8 Track 1 Task 1 End-to-End Multi-Domain Dialog Challenge Result:☆405Apr 11, 2023Updated 2 years ago
- Dataset and documentation for paper on explaining solutions to physical reasoning tasks (ESPRIT))☆21May 1, 2025Updated 10 months ago
- Audio-conditioned video texture generation☆24Sep 16, 2022Updated 3 years ago
- MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems☆68Oct 26, 2021Updated 4 years ago
- Code for paper: Towards Conversational Search and Recommendation: System Ask, User Respond☆41Mar 25, 2021Updated 4 years ago
- Code repo for the ICML 2021 paper "Making Paper Reviewing Robust to Bid Manipulation Attacks".☆10Sep 15, 2021Updated 4 years ago
- replicate the results of rule extract lstm☆16Jun 9, 2017Updated 8 years ago
- natural annotated text-category pairs for text classification☆10Sep 10, 2021Updated 4 years ago
- Accelerate Transformers pipelines using ONNX Runtime.☆10Jun 5, 2020Updated 5 years ago
- Scene Understanding and Modeling Challenge Library☆71Jul 19, 2019Updated 6 years ago
- Grounded conversational dataset for end-to-end conversational AI (official DSTC7 data)☆175Aug 20, 2024Updated last year