Question answering over linked data: What is difficult to answer? What affects the F scores?

Muhammad Saleem; Samaneh Nazari Dastjerdi; Ricardo Usbeck; Axel Cyrille Ngonga Ngomo

Question answering over linked data: What is difficult to answer? What affects the F scores?

Muhammad Saleem
, Samaneh Nazari Dastjerdi
, Ricardo Usbeck
, Axel Cyrille Ngonga Ngomo

Publikation: Beiträge in Sammelwerken › Aufsätze in Konferenzbänden › Forschung › Begutachtung

3 Zitate (Scopus)

Abstract

We present a fine-grained analysis of the Question Answering over Linked Data (QALD-6) challenge. We divide the QALD-6 questions into 8 main categories and compare state-of-the-art questions answering (QA) systems over Linked Data against the individual categories. We show the difficulty (in terms of overall F scores of the QA systems) of each category. We show the effect of various natural language and SPARQL features such as the number of triple patterns, number of keywords, the answer size, the type of answers, the effect of aggregate functions, and the SPARQL query forms on the overall F scores of the QA systems.

Originalsprache	Englisch
Titel	Joint Proceedings of BLINK2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3 : Natural Language Interfaces for the Web of Data
Redakteure/-innen	Rcardo Usbeck, Axel-Cyrille Ngonga Ngomo, Jin-Dong Kim, Key-Sun Choi, Philipp Cimiano, Irini Fundulaki, Anastasia Krithara
Band	1932
Herausgeber (Verlag)	Sun Site Central Europe (RWTH Aachen University)
Erscheinungsdatum	2017
Publikationsstatus	Erschienen - 2017
Extern publiziert	Ja
Veranstaltung	Joint BLINK 2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3: Natural Language Interfaces for the Web of Data, BLINK 2017-NLIWoD3 2017 - Vienna, Österreich Dauer: 21.10.2017 → 22.10.2017 https://dblp.org/db/conf/semweb/blink2017.html

Bibliographische Notiz

Funding Information:
This work has been supported by the H2020 project HOBBIT (GA no. 688227) as well as the EuroStars projects DIESEL (no. 01QE1512C) and QAMEL (no. 01QE1549C). This work has also been supported by the German Federal Ministry of Transport and Digital Infrastructure (BMVI) in the projects LIMBO (no. 19F2029I) and OPAL (no. 19F2028A) as well as by the German Federal Ministry of Education and Research (BMBF) within ’KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ’Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456).

Fachgebiete und Schlagwörter

Informatik
Wirtschaftsinformatik

Zugriff auf Dokument

https://nbn-resolving.org/urn:nbn:de:0074-1932-2Lizenz: CC0
https://ceur-ws.org/Vol-1932/paper-02.pdfLizenz: CC0

Dieses zitieren

Saleem, M., Dastjerdi, S. N., Usbeck, R., & Ngomo, A. C. N. (2017). Question answering over linked data: What is difficult to answer? What affects the F scores? in R. Usbeck, A.-C. N. Ngomo, J.-D. Kim, K.-S. Choi, P. Cimiano, I. Fundulaki, & A. Krithara (Hrsg.), Joint Proceedings of BLINK2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3 : Natural Language Interfaces for the Web of Data (Band 1932). (CEUR Workshop Proceedings; Band 1932). Sun Site Central Europe (RWTH Aachen University). https://nbn-resolving.org/urn:nbn:de:0074-1932-2

Saleem, Muhammad ; Dastjerdi, Samaneh Nazari ; Usbeck, Ricardo et al. / Question answering over linked data : What is difficult to answer? What affects the F scores?. Joint Proceedings of BLINK2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3 : Natural Language Interfaces for the Web of Data. Hrsg. / Rcardo Usbeck ; Axel-Cyrille Ngonga Ngomo ; Jin-Dong Kim ; Key-Sun Choi ; Philipp Cimiano ; Irini Fundulaki ; Anastasia Krithara. Band 1932 Sun Site Central Europe (RWTH Aachen University), 2017. (CEUR Workshop Proceedings).

@inbook{7983c0cf61684ab4a1581df856635be3,

title = "Question answering over linked data: What is difficult to answer? What affects the F scores?",

abstract = "We present a fine-grained analysis of the Question Answering over Linked Data (QALD-6) challenge. We divide the QALD-6 questions into 8 main categories and compare state-of-the-art questions answering (QA) systems over Linked Data against the individual categories. We show the difficulty (in terms of overall F scores of the QA systems) of each category. We show the effect of various natural language and SPARQL features such as the number of triple patterns, number of keywords, the answer size, the type of answers, the effect of aggregate functions, and the SPARQL query forms on the overall F scores of the QA systems.",

keywords = "Informatics, Business informatics",

author = "Muhammad Saleem and Dastjerdi, \{Samaneh Nazari\} and Ricardo Usbeck and Ngomo, \{Axel Cyrille Ngonga\}",

note = "Funding Information: This work has been supported by the H2020 project HOBBIT (GA no. 688227) as well as the EuroStars projects DIESEL (no. 01QE1512C) and QAMEL (no. 01QE1549C). This work has also been supported by the German Federal Ministry of Transport and Digital Infrastructure (BMVI) in the projects LIMBO (no. 19F2029I) and OPAL (no. 19F2028A) as well as by the German Federal Ministry of Education and Research (BMBF) within {\textquoteright}KMU-innovativ: Forschung f{\"u}r die zivile Sicherheit{\textquoteright} in particular {\textquoteright}Forschung f{\"u}r die zivile Sicherheit{\textquoteright} and the project SOLIDE (no. 13N14456).; Joint BLINK 2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3: Natural Language Interfaces for the Web of Data, BLINK 2017-NLIWoD3 2017 ; Conference date: 21-10-2017 Through 22-10-2017",

year = "2017",

language = "English",

volume = "1932",

series = "CEUR Workshop Proceedings",

publisher = "Sun Site Central Europe (RWTH Aachen University)",

editor = "Rcardo Usbeck and Ngomo, \{Axel-Cyrille Ngonga\} and Jin-Dong Kim and Key-Sun Choi and Philipp Cimiano and Irini Fundulaki and Anastasia Krithara",

booktitle = "Joint Proceedings of BLINK2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3",

address = "Germany",

url = "https://dblp.org/db/conf/semweb/blink2017.html",

}

Saleem, M, Dastjerdi, SN, Usbeck, R & Ngomo, ACN 2017, Question answering over linked data: What is difficult to answer? What affects the F scores? in R Usbeck, A-CN Ngomo, J-D Kim, K-S Choi, P Cimiano, I Fundulaki & A Krithara (Hrsg.), Joint Proceedings of BLINK2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3 : Natural Language Interfaces for the Web of Data. Bd. 1932, CEUR Workshop Proceedings, Bd. 1932, Sun Site Central Europe (RWTH Aachen University), Joint BLINK 2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3: Natural Language Interfaces for the Web of Data, BLINK 2017-NLIWoD3 2017, Vienna, Österreich, 21.10.17. <https://nbn-resolving.org/urn:nbn:de:0074-1932-2>

Question answering over linked data: What is difficult to answer? What affects the F scores? / Saleem, Muhammad; Dastjerdi, Samaneh Nazari; Usbeck, Ricardo et al.
Joint Proceedings of BLINK2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3 : Natural Language Interfaces for the Web of Data. Hrsg. / Rcardo Usbeck; Axel-Cyrille Ngonga Ngomo; Jin-Dong Kim; Key-Sun Choi; Philipp Cimiano; Irini Fundulaki; Anastasia Krithara. Band 1932 Sun Site Central Europe (RWTH Aachen University), 2017. (CEUR Workshop Proceedings; Band 1932).

Publikation: Beiträge in Sammelwerken › Aufsätze in Konferenzbänden › Forschung › Begutachtung

TY - CHAP

T1 - Question answering over linked data

T2 - Joint BLINK 2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3: Natural Language Interfaces for the Web of Data, BLINK 2017-NLIWoD3 2017

AU - Saleem, Muhammad

AU - Dastjerdi, Samaneh Nazari

AU - Usbeck, Ricardo

AU - Ngomo, Axel Cyrille Ngonga

N1 - Funding Information: This work has been supported by the H2020 project HOBBIT (GA no. 688227) as well as the EuroStars projects DIESEL (no. 01QE1512C) and QAMEL (no. 01QE1549C). This work has also been supported by the German Federal Ministry of Transport and Digital Infrastructure (BMVI) in the projects LIMBO (no. 19F2029I) and OPAL (no. 19F2028A) as well as by the German Federal Ministry of Education and Research (BMBF) within ’KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ’Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456).

PY - 2017

Y1 - 2017

N2 - We present a fine-grained analysis of the Question Answering over Linked Data (QALD-6) challenge. We divide the QALD-6 questions into 8 main categories and compare state-of-the-art questions answering (QA) systems over Linked Data against the individual categories. We show the difficulty (in terms of overall F scores of the QA systems) of each category. We show the effect of various natural language and SPARQL features such as the number of triple patterns, number of keywords, the answer size, the type of answers, the effect of aggregate functions, and the SPARQL query forms on the overall F scores of the QA systems.

AB - We present a fine-grained analysis of the Question Answering over Linked Data (QALD-6) challenge. We divide the QALD-6 questions into 8 main categories and compare state-of-the-art questions answering (QA) systems over Linked Data against the individual categories. We show the difficulty (in terms of overall F scores of the QA systems) of each category. We show the effect of various natural language and SPARQL features such as the number of triple patterns, number of keywords, the answer size, the type of answers, the effect of aggregate functions, and the SPARQL query forms on the overall F scores of the QA systems.

KW - Informatics

KW - Business informatics

UR - https://www.scopus.com/pages/publications/85031005596

M3 - Article in conference proceedings

AN - SCOPUS:85031005596

VL - 1932

T3 - CEUR Workshop Proceedings

BT - Joint Proceedings of BLINK2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3

A2 - Usbeck, Rcardo

A2 - Ngomo, Axel-Cyrille Ngonga

A2 - Kim, Jin-Dong

A2 - Choi, Key-Sun

A2 - Cimiano, Philipp

A2 - Fundulaki, Irini

A2 - Krithara, Anastasia

PB - Sun Site Central Europe (RWTH Aachen University)

Y2 - 21 October 2017 through 22 October 2017

ER -

Saleem M, Dastjerdi SN, Usbeck R, Ngomo ACN. Question answering over linked data: What is difficult to answer? What affects the F scores? in Usbeck R, Ngomo ACN, Kim JD, Choi KS, Cimiano P, Fundulaki I, Krithara A, Hrsg., Joint Proceedings of BLINK2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3 : Natural Language Interfaces for the Web of Data. Band 1932. Sun Site Central Europe (RWTH Aachen University). 2017. (CEUR Workshop Proceedings).

Question answering over linked data: What is difficult to answer? What affects the F scores?

Abstract

Bibliographische Notiz

Fachgebiete und Schlagwörter

Zugriff auf Dokument

Fingerprint

Dieses zitieren