MovieQA: Understanding Stories in Movies through Question-Answering

被引：338

作者：

Tapaswi, Makarand ^{[1
]}

Zhu, Yukun ^{[3
]}

Stiefelhagen, Rainer ^{[1
]}

Torralba, Antonio ^{[2
]}

Urtasun, Raquel ^{[3
]}

Fidler, Sanja ^{[3
]}

机构：

[1] Karlsruhe Inst Technol, Karlsruhe, Germany

[2] MIT, Cambridge, MA 02139 USA

[3] Univ Toronto, Toronto, ON, Canada

来源：

2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) | 2016年

关键词：

D O I：

10.1109/CVPR.2016.501

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We introduce the MovieQA dataset which aims to evaluate automatic story comprehension from both video and text. The dataset consists of 14,944 questions about 408 movies with high semantic diversity. The questions range from simpler "Who" did "What" to "Whom", to "Why" and "How" certain events occurred. Each question comes with a set of five possible answers; a correct one and four deceiving answers provided by human annotators. Our dataset is unique in that it contains multiple sources of information - video clips, plots, subtitles, scripts, and DVS [32]. We analyze our data through various statistics and methods. We further extend existing QA techniques to show that question-answering with such open-ended semantics is hard. We make this data set public along with an evaluation benchmark to encourage inspiring work in this challenging domain.

引用

页码：4631 / 4640

页数：10

共 50 条

[21] A Framework of Evaluation for Question-Answering Systems
El Ayari, Sarra
Grau, Brigitte
ADVANCES IN INFORMATION RETRIEVAL, PROCEEDINGS, 2009, 5478 : 744 - 748
[22] Question-answering system for combustion kinetics
Pascazio, Laura
Tran, Dan
Rihm, Simon D.
Bai, Jiaru
Mosbach, Sebastian
Akroyd, Jethro
Kraft, Markus
PROCEEDINGS OF THE COMBUSTION INSTITUTE, 2024, 40 (1-4)
[23] SEMANTIC MODELING FOR DEDUCTIVE QUESTION-ANSWERING
BISS, K
CHIEN, RT
STAHL, F
WEISSMAN, SJ
IEEE TRANSACTIONS ON COMPUTERS, 1976, 25 (04) : 358 - 366
[24] Question-Answering System with Linguistic Summarization
To, Nhuan D.
Reformat, Marek Z.
Yager, Ronald R.
IEEE CIS INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS 2021 (FUZZ-IEEE), 2021,
[25] Question-answering systems in knowledge management
Moldovan, D
IEEE INTELLIGENT SYSTEMS, 2001, 16 (06) : 90 - 92
[26] RAPPORT - A Portuguese Question-Answering System
Rodrigues, Ricardo
Gomes, Paulo
PROGRESS IN ARTIFICIAL INTELLIGENCE-BK, 2015, 9273 : 771 - 782
[27] EXPERIMENTS WITH A DEDUCTIVE QUESTION-ANSWERING PROGRAM
SLAGLE, JR
COMMUNICATIONS OF THE ACM, 1965, 8 (12) : 792 - &
[28] Evaluation of Google question-answering quality
Zhao, Yiming
Zhang, Jin
Xia, Xue
Le, Taowen
LIBRARY HI TECH, 2019, 37 (02) : 312 - 328
[29] Gender screening on question-answering communities
Figueroa, Alejandro
Peralta, Billy
Nicolis, Orietta
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 215
[30] Question-Answering for Agricultural Open Data
Kawamura, Takahiro
Ohsuga, Akihiko
TRANSACTIONS ON LARGE-SCALE DATA- AND KNOWLEDGE-CENTERED SYSTEMS XVI, 2014, 8960 : 15 - 28

← 1 2 3 4 5 →