With the aim of building next generation virtual assistants that can handle multimodal inputs and perform multimodal actions, we introduce two new datasets (both in the virtual shopping domain), the annotation schema, the core technical tasks, and the baseline models. The code for the baselines and the datasets will be opensourced.
☆133Oct 21, 2023Updated 2 years ago
Alternatives and similar repositories for simmc
Users that are interested in simmc are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for SIMMC 2.0: A Task-oriented Dialog Dataset for Immersive Multimodal Conversations☆108Nov 12, 2022Updated 3 years ago
- DSTC9 Track 1 - Beyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access☆106Jun 12, 2023Updated 3 years ago
- Code for the paper Multimodal Transformer Networks for End-to-End Video-Grounded Dialogue Systems (ACL19)☆100Oct 17, 2022Updated 3 years ago
- A synthetic dataset of dialogs we authored and annotated for references (pronouns, etc.). This dataset is discussed in the paper "MuDoCo:…☆24Mar 24, 2022Updated 4 years ago
- Data & Code for ACCENTOR: "Adding Chit-Chat to Enhance Task-Oriented Dialogues" (NAACL 2021)☆72Oct 12, 2021Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆13Mar 25, 2023Updated 3 years ago
- Code for Navigating Connected Memories with a Task-oriented Dialog System☆18Dec 12, 2022Updated 3 years ago
- Transformer model for the Amazon Topical-Chat Corpus. Baselines for DSTC9 Track 3.☆19Jul 9, 2020Updated 6 years ago
- ✨ Official PyTorch Implementation for EMNLP'19 Paper, "Dual Attention Networks for Visual Reference Resolution in Visual Dialog"☆43Mar 19, 2023Updated 3 years ago
- Pytorch implementation of https://arxiv.org/pdf/1909.10470.pdf☆32Aug 23, 2021Updated 5 years ago
- ☆35Apr 10, 2018Updated 8 years ago
- Visual Coreference Resolution in Visual Dialog using Neural Module Networks☆57Oct 12, 2021Updated 4 years ago
- This repository contains the Pytorch implementation for our SCAI (EMNLP-2018) submission "A Knowledge-Grounded Multimodal Search-Based Co…☆30Jun 4, 2020Updated 6 years ago
- ☆14Aug 30, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆47Apr 24, 2022Updated 4 years ago
- Repository to generate CLEVR-Dialog: A diagnostic dataset for Visual Dialog☆50Feb 18, 2020Updated 6 years ago
- OpenDialKG: Explainable Conversational Reasoning with Attention-based Walks over Knowledge Graphs☆143Oct 12, 2021Updated 4 years ago
- Baseline implementation for DSTC8 User Response Prediction Challenge☆72Jun 12, 2023Updated 3 years ago
- Please see the readme file as well as our 2019 EMNLP paper linked here -->☆222Apr 24, 2024Updated 2 years ago
- [CVPR 2017] AMT chat interface code used to collect the Visual Dialog dataset☆77Jun 10, 2022Updated 4 years ago
- ☆35May 1, 2023Updated 3 years ago
- ☆95Jun 1, 2018Updated 8 years ago
- Implementation for "Large-scale Pretraining for Visual Dialog" https://arxiv.org/abs/1912.02379☆94Mar 31, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Official repository for "SimpleTOD: A Simple Language Model for Task-Oriented Dialogue"☆239May 1, 2025Updated last year
- Models for the Collaborative Drawing (CoDraw) task☆14Jan 15, 2019Updated 7 years ago
- GuessWhat?! Baselines☆75Jul 12, 2022Updated 4 years ago
- Tetra-Tagging: Word-Synchronous Parsing with Linear-Time Inference☆14Jul 6, 2020Updated 6 years ago
- Code for paper: Towards Conversational Search and Recommendation: System Ask, User Respond☆41Mar 25, 2021Updated 5 years ago
- ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems☆466Jun 17, 2024Updated 2 years ago
- PyTorch codebase for zero-shot dialog generation SIGDIAL 2018, It is released by Tiancheng Zhao (Tony) from Dialog Research Center, LTI, …☆132Jan 8, 2019Updated 7 years ago
- Project page for "Visual Grounding in Video for Unsupervised Word Translation" CVPR 2020☆43Apr 26, 2020Updated 6 years ago
- A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modeling☆23Jul 31, 2021Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Code for the paper Non-Autoregressive Dialog State Tracking (ICLR20)☆44Feb 25, 2020Updated 6 years ago
- NLQuAD: A Non-Factoid Long Question Answering Data Set. To be published at EACL2021☆13May 18, 2021Updated 5 years ago
- A Simple but Effective BERT Model for Dialog State Tracking on Resource-Limited Systems☆21Oct 7, 2022Updated 3 years ago
- Dataset and documentation for paper on explaining solutions to physical reasoning tasks (ESPRIT))☆21May 1, 2025Updated last year
- Accompany code to reproduce the baselines of the International Multimodal Sentiment Analysis Challenge (MuSe 2020).☆16Dec 8, 2022Updated 3 years ago
- CoDraw dataset☆96Jan 15, 2019Updated 7 years ago
- Grounded conversational dataset for end-to-end conversational AI (official DSTC7 data)☆175Aug 20, 2024Updated 2 years ago