An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot

Rricha Jalota; Priyansh Trivedi; Gaurav Maheshwari; Axel Cyrille Ngonga Ngomo; Ricardo Usbeck

doi:10.1007/978-3-030-39540-7_2

An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot

Rricha Jalota^*
, Priyansh Trivedi
, Gaurav Maheshwari
, Axel Cyrille Ngonga Ngomo
, Ricardo Usbeck

^*Korrespondierende/r Autor/-in für diese Arbeit

Publikation: Beiträge in Sammelwerken › Aufsätze in Konferenzbänden › Forschung › Begutachtung

2 Zitate (Scopus)

Abstract

As chatbots are gaining popularity for simplifying access to information and community interaction, it is essential to examine whether these agents are serving their intended purpose and catering to the needs of their users. Therefore, we present an approach to perform an ex-post-facto analysis over the logs of knowledge base-driven dialogue systems. Using the DBpedia Chatbot as our case study, we inspect three aspects of the interactions, (i) user queries and feedback, (ii) the bot’s response to these queries, and (iii) the overall flow of the conversations. We discuss key implications based on our findings. All the source code used for the analysis can be found at https://github.com/dice-group/DBpedia-Chatlog-Analysis.

Originalsprache	Englisch
Titel	Chatbot Research and Design : 3rd International Workshop, CONVERSATIONS 2019
Redakteure/-innen	Asbjørn Følstad, Theo Araujo, Symeon Papadopoulos, Effie Lai-Chong Law, Ole-Christoffer Granmo, Ewa Luger, Petter Bae Brandtzaeg
Seitenumfang	15
Herausgeber (Verlag)	Springer Verlag
Erscheinungsdatum	2020
Seiten	19-33
ISBN (Print)	978-3-030-39539-1
ISBN (elektronisch)	978-3-030-39540-7
DOIs	https://doi.org/10.1007/978-3-030-39540-7_2
Publikationsstatus	Erschienen - 2020
Extern publiziert	Ja
Veranstaltung	3rd International Workshop on Chatbot Research and Design, CONVERSATIONS 2019 - Universität Amsterdam, Amsterdam, Niederlande Dauer: 19.11.2019 → 20.11.2019 http://www.digicomlab.eu/events/past-events/conversations-2019-workshop/ https://conversations2019.wordpress.com/program/

Bibliographische Notiz

Funding Information:
Acknowledgments. This work has been supported by the Federal Ministry of Transport and Digital Infrastructure (BMVI) in the OPAL research project (grant no. 19F2028A) and LIMBO (no. 19F2029I) as well as by the German Federal Ministry of Education and Research (BMBF) within ‘KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ‘Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456).

Publisher Copyright:
© 2020, Springer Nature Switzerland AG.

Fachgebiete und Schlagwörter

Informatik
Wirtschaftsinformatik

Zugriff auf Dokument

10.1007/978-3-030-39540-7_2

Dieses zitieren

Jalota, R., Trivedi, P., Maheshwari, G., Ngonga Ngomo, A. C., & Usbeck, R. (2020). An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot. in A. Følstad, T. Araujo, S. Papadopoulos, E. L.-C. Law, O.-C. Granmo, E. Luger, & P. B. Brandtzaeg (Hrsg.), Chatbot Research and Design: 3rd International Workshop, CONVERSATIONS 2019 (S. 19-33). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 11970 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-39540-7_2

Jalota, Rricha ; Trivedi, Priyansh ; Maheshwari, Gaurav et al. / An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot. Chatbot Research and Design: 3rd International Workshop, CONVERSATIONS 2019. Hrsg. / Asbjørn Følstad ; Theo Araujo ; Symeon Papadopoulos ; Effie Lai-Chong Law ; Ole-Christoffer Granmo ; Ewa Luger ; Petter Bae Brandtzaeg. Springer Verlag, 2020. S. 19-33 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inbook{465f0589e0a3417ba0bb71aa35d292f1,

title = "An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot",

abstract = "As chatbots are gaining popularity for simplifying access to information and community interaction, it is essential to examine whether these agents are serving their intended purpose and catering to the needs of their users. Therefore, we present an approach to perform an ex-post-facto analysis over the logs of knowledge base-driven dialogue systems. Using the DBpedia Chatbot as our case study, we inspect three aspects of the interactions, (i) user queries and feedback, (ii) the bot{\textquoteright}s response to these queries, and (iii) the overall flow of the conversations. We discuss key implications based on our findings. All the source code used for the analysis can be found at https://github.com/dice-group/DBpedia-Chatlog-Analysis.",

keywords = "Conversational AI, Empirical study, Intent clustering, Knowledge graph, Knowledge-driven chatbot, Informatics, Business informatics",

author = "Rricha Jalota and Priyansh Trivedi and Gaurav Maheshwari and \{Ngonga Ngomo\}, \{Axel Cyrille\} and Ricardo Usbeck",

note = "This work has been supported by the Federal Ministry of Transport and Digital Infrastructure (BMVI) in the OPAL research project (grant no. 19F2028A) and LIMBO (no. 19F2029I) as well as by the German Federal Ministry of Education and Research (BMBF) within {\textquoteleft}KMU-innovativ: Forschung f{\"u}r die zivile Sicherheit{\textquoteright} in particular {\textquoteleft}Forschung f{\"u}r die zivile Sicherheit{\textquoteright} and the project SOLIDE (no. 13N14456). Publisher Copyright: {\textcopyright} 2020, Springer Nature Switzerland AG.; 3rd International Workshop on Chatbot Research and Design, CONVERSATIONS 2019 ; Conference date: 19-11-2019 Through 20-11-2019",

year = "2020",

doi = "10.1007/978-3-030-39540-7\_2",

language = "English",

isbn = "978-3-030-39539-1",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "19--33",

editor = "Asbj{\o}rn F{\o}lstad and Theo Araujo and Symeon Papadopoulos and Law, \{Effie Lai-Chong\} and Ole-Christoffer Granmo and Ewa Luger and Brandtzaeg, \{Petter Bae\}",

booktitle = "Chatbot Research and Design",

address = "Germany",

url = "http://www.digicomlab.eu/events/past-events/conversations-2019-workshop/, https://conversations2019.wordpress.com/program/",

}

Jalota, R, Trivedi, P, Maheshwari, G, Ngonga Ngomo, AC & Usbeck, R 2020, An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot. in A Følstad, T Araujo, S Papadopoulos, EL-C Law, O-C Granmo, E Luger & PB Brandtzaeg (Hrsg.), Chatbot Research and Design: 3rd International Workshop, CONVERSATIONS 2019. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Bd. 11970 LNCS, Springer Verlag, S. 19-33, 3rd International Workshop on Chatbot Research and Design, CONVERSATIONS 2019, Amsterdam, Niederlande, 19.11.19. https://doi.org/10.1007/978-3-030-39540-7_2

An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot. / Jalota, Rricha; Trivedi, Priyansh; Maheshwari, Gaurav et al.
Chatbot Research and Design: 3rd International Workshop, CONVERSATIONS 2019. Hrsg. / Asbjørn Følstad; Theo Araujo; Symeon Papadopoulos; Effie Lai-Chong Law; Ole-Christoffer Granmo; Ewa Luger; Petter Bae Brandtzaeg. Springer Verlag, 2020. S. 19-33 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 11970 LNCS).

Publikation: Beiträge in Sammelwerken › Aufsätze in Konferenzbänden › Forschung › Begutachtung

TY - CHAP

T1 - An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot

AU - Jalota, Rricha

AU - Trivedi, Priyansh

AU - Maheshwari, Gaurav

AU - Ngonga Ngomo, Axel Cyrille

AU - Usbeck, Ricardo

N1 - This work has been supported by the Federal Ministry of Transport and Digital Infrastructure (BMVI) in the OPAL research project (grant no. 19F2028A) and LIMBO (no. 19F2029I) as well as by the German Federal Ministry of Education and Research (BMBF) within ‘KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ‘Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456). Publisher Copyright: © 2020, Springer Nature Switzerland AG.

PY - 2020

Y1 - 2020

N2 - As chatbots are gaining popularity for simplifying access to information and community interaction, it is essential to examine whether these agents are serving their intended purpose and catering to the needs of their users. Therefore, we present an approach to perform an ex-post-facto analysis over the logs of knowledge base-driven dialogue systems. Using the DBpedia Chatbot as our case study, we inspect three aspects of the interactions, (i) user queries and feedback, (ii) the bot’s response to these queries, and (iii) the overall flow of the conversations. We discuss key implications based on our findings. All the source code used for the analysis can be found at https://github.com/dice-group/DBpedia-Chatlog-Analysis.

AB - As chatbots are gaining popularity for simplifying access to information and community interaction, it is essential to examine whether these agents are serving their intended purpose and catering to the needs of their users. Therefore, we present an approach to perform an ex-post-facto analysis over the logs of knowledge base-driven dialogue systems. Using the DBpedia Chatbot as our case study, we inspect three aspects of the interactions, (i) user queries and feedback, (ii) the bot’s response to these queries, and (iii) the overall flow of the conversations. We discuss key implications based on our findings. All the source code used for the analysis can be found at https://github.com/dice-group/DBpedia-Chatlog-Analysis.

KW - Conversational AI

KW - Empirical study

KW - Intent clustering

KW - Knowledge graph

KW - Knowledge-driven chatbot

KW - Informatics

KW - Business informatics

UR - https://www.scopus.com/pages/publications/85079089976

U2 - 10.1007/978-3-030-39540-7_2

DO - 10.1007/978-3-030-39540-7_2

M3 - Article in conference proceedings

AN - SCOPUS:85079089976

SN - 978-3-030-39539-1

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 19

EP - 33

BT - Chatbot Research and Design

A2 - Følstad, Asbjørn

A2 - Araujo, Theo

A2 - Papadopoulos, Symeon

A2 - Law, Effie Lai-Chong

A2 - Granmo, Ole-Christoffer

A2 - Luger, Ewa

A2 - Brandtzaeg, Petter Bae

PB - Springer Verlag

T2 - 3rd International Workshop on Chatbot Research and Design, CONVERSATIONS 2019

Y2 - 19 November 2019 through 20 November 2019

ER -

Jalota R, Trivedi P, Maheshwari G, Ngonga Ngomo AC, Usbeck R. An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot. in Følstad A, Araujo T, Papadopoulos S, Law ELC, Granmo OC, Luger E, Brandtzaeg PB, Hrsg., Chatbot Research and Design: 3rd International Workshop, CONVERSATIONS 2019. Springer Verlag. 2020. S. 19-33. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-39540-7_2

An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot

Abstract

Bibliographische Notiz

Fachgebiete und Schlagwörter

Zugriff auf Dokument

Fingerprint

Dieses zitieren