Question Answering Mediated by Visual Clues and Knowledge Graphs

Fabrício F. Faria; Ricardo Usbeck; Alessio Sarullo; Tingting Mu; Andre Freitas

doi:10.1145/3184558.3192318

Question Answering Mediated by Visual Clues and Knowledge Graphs

Fabrício F. Faria
, Ricardo Usbeck
, Alessio Sarullo
, Tingting Mu
, Andre Freitas

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

1 Citation (Scopus)

Abstract

This challenge focuses on the use of semantic representation methods to support Visual Question Answering: given a large image collection, find a set of images matching natural language queries. The task supports advancing the state-of-the-art in Visual Question Answering by focusing on methods which explore the interplay between contemporary machine learning techniques, semantic representation and reasoning mechanisms.

Original language	English
Title of host publication	The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018
Number of pages	3
Publisher	Association for Computing Machinery, Inc
Publication date	23.04.2018
Pages	1937-1939
ISBN (Print)	9781450356404
DOIs	https://doi.org/10.1145/3184558.3192318
Publication status	Published - 23.04.2018
Externally published	Yes
Event	27th International World Wide Web, WWW 2018: Bridging natural and artificial intelligence worldwide - Universität Lyon, Lyon, France Duration: 23.04.2018 → 27.04.2018 https://archives.iw3c2.org/www2018/

Bibliographical note

This work has been supported by the BMVI projects LIMBO (project no. 19F2029C) and OPAL (project no. 19F20284) as well as by the German Federal Ministry of Education and Research (BMBF) within ’KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ’Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456). Furthermore, we would like to thank the annotators Ria Hari Gusmati, Rricha Jalota, Paramjot Kaur, Hussain Abid Syed and Jan Reineke.

Publisher Copyright:
© 2018 IW3C2 (International World Wide Web Conference Committee), published under Creative Commons CC BY 4.0 License.

Research areas and keywords

Gold-standard
Visual Question Answering
Informatics
Business informatics

Access to Document

10.1145/3184558.3192318Licence: CC BY

Cite this

Faria, F. F., Usbeck, R., Sarullo, A., Mu, T., & Freitas, A. (2018). Question Answering Mediated by Visual Clues and Knowledge Graphs. In The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018 (pp. 1937-1939). (The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018; Vol. 2018-January). Association for Computing Machinery, Inc. https://doi.org/10.1145/3184558.3192318

@inbook{a943601f4c3b4976a346e6085e43e76c,

title = "Question Answering Mediated by Visual Clues and Knowledge Graphs",

abstract = "This challenge focuses on the use of semantic representation methods to support Visual Question Answering: given a large image collection, find a set of images matching natural language queries. The task supports advancing the state-of-the-art in Visual Question Answering by focusing on methods which explore the interplay between contemporary machine learning techniques, semantic representation and reasoning mechanisms.",

keywords = "Gold-standard, Visual Question Answering, Informatics, Business informatics",

author = "Faria, \{Fabr{\'i}cio F.\} and Ricardo Usbeck and Alessio Sarullo and Tingting Mu and Andre Freitas",

note = "This work has been supported by the BMVI projects LIMBO (project no. 19F2029C) and OPAL (project no. 19F20284) as well as by the German Federal Ministry of Education and Research (BMBF) within {\textquoteright}KMU-innovativ: Forschung f{\"u}r die zivile Sicherheit{\textquoteright} in particular {\textquoteright}Forschung f{\"u}r die zivile Sicherheit{\textquoteright} and the project SOLIDE (no. 13N14456). Furthermore, we would like to thank the annotators Ria Hari Gusmati, Rricha Jalota, Paramjot Kaur, Hussain Abid Syed and Jan Reineke. Publisher Copyright: {\textcopyright} 2018 IW3C2 (International World Wide Web Conference Committee), published under Creative Commons CC BY 4.0 License.; 27th International World Wide Web, WWW 2018 : Bridging natural and artificial intelligence worldwide ; Conference date: 23-04-2018 Through 27-04-2018",

year = "2018",

month = apr,

day = "23",

doi = "10.1145/3184558.3192318",

language = "English",

isbn = "9781450356404",

series = "The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018",

publisher = "Association for Computing Machinery, Inc",

pages = "1937--1939",

booktitle = "The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018",

address = "United States",

url = "https://archives.iw3c2.org/www2018/",

}

Faria, FF, Usbeck, R, Sarullo, A, Mu, T & Freitas, A 2018, Question Answering Mediated by Visual Clues and Knowledge Graphs. in The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018. The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018, vol. 2018-January, Association for Computing Machinery, Inc, pp. 1937-1939, 27th International World Wide Web, WWW 2018, Lyon, France, 23.04.18. https://doi.org/10.1145/3184558.3192318

Question Answering Mediated by Visual Clues and Knowledge Graphs. / Faria, Fabrício F.; Usbeck, Ricardo; Sarullo, Alessio et al.
The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018. Association for Computing Machinery, Inc, 2018. p. 1937-1939 (The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018; Vol. 2018-January).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

TY - CHAP

T1 - Question Answering Mediated by Visual Clues and Knowledge Graphs

AU - Faria, Fabrício F.

AU - Usbeck, Ricardo

AU - Sarullo, Alessio

AU - Mu, Tingting

AU - Freitas, Andre

N1 - This work has been supported by the BMVI projects LIMBO (project no. 19F2029C) and OPAL (project no. 19F20284) as well as by the German Federal Ministry of Education and Research (BMBF) within ’KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ’Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456). Furthermore, we would like to thank the annotators Ria Hari Gusmati, Rricha Jalota, Paramjot Kaur, Hussain Abid Syed and Jan Reineke. Publisher Copyright: © 2018 IW3C2 (International World Wide Web Conference Committee), published under Creative Commons CC BY 4.0 License.

PY - 2018/4/23

Y1 - 2018/4/23

N2 - This challenge focuses on the use of semantic representation methods to support Visual Question Answering: given a large image collection, find a set of images matching natural language queries. The task supports advancing the state-of-the-art in Visual Question Answering by focusing on methods which explore the interplay between contemporary machine learning techniques, semantic representation and reasoning mechanisms.

AB - This challenge focuses on the use of semantic representation methods to support Visual Question Answering: given a large image collection, find a set of images matching natural language queries. The task supports advancing the state-of-the-art in Visual Question Answering by focusing on methods which explore the interplay between contemporary machine learning techniques, semantic representation and reasoning mechanisms.

KW - Gold-standard

KW - Visual Question Answering

KW - Informatics

KW - Business informatics

UR - https://www.scopus.com/pages/publications/85075418562

UR - https://www.mendeley.com/catalogue/861375f6-0bfa-36d8-96de-69f6a856325e/

U2 - 10.1145/3184558.3192318

DO - 10.1145/3184558.3192318

M3 - Article in conference proceedings

AN - SCOPUS:85075418562

SN - 9781450356404

T3 - The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018

SP - 1937

EP - 1939

BT - The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018

PB - Association for Computing Machinery, Inc

T2 - 27th International World Wide Web, WWW 2018

Y2 - 23 April 2018 through 27 April 2018

ER -

Question Answering Mediated by Visual Clues and Knowledge Graphs

Abstract

Bibliographical note

Research areas and keywords

Access to Document

Fingerprint

Cite this