Skip to main navigation Skip to search Skip to main content

STaRQ-Agent-Investigating Generalization in Knowledge Graph Question Answering via a Multi-Agent Collaborative Framework

Research output: Journal contributionsJournal articlesResearchpeer-review

Abstract

Generalization to different Knowledge Graphs (KGs) is a core challenge of Knowledge Graph Question Answering (KGQA). Current models struggle to adapt to unseen KGs due to their underlying heterogeneity. Most approaches depend on data-hungry methods, such as supervised fine-tuning and KG-specific few-shot demonstrations. These systems are limited in cross-KG generalization, and may exhibit hallucination problems, especially in low-resource or domain-specific scenarios. This paper presents STaRQ-Agent, an LLM-based multi-agent collaborative framework for the KGQA generalization problem. It comprises a core agent for SPARQL query generation, accompanied by three supportive agents for schema selection, template generation, and query refinement. This collaborative framework helps mitigate hallucination problems inherent in LLMs. STaRQ-Agent was evaluated on LC-QuAD 1.0, QALD-9, MetaQA, and MatKGQA datasets in few-shot and zero-shot settings. Experimental results demonstrate strong overall generalization across diverse KGs, without requiring high-quality annotated data, re-training, or fine-tuning. Specially, on LC-QuAD 1.0, QALD-9, and MetaQA, few-shot STaRQ-Agent outperforms the strongest baseline by 5.1%, 4.3%, and 0.7%, while zero-shot STaRQ-Agent shows only modest F1 drops of 8.7%, 12.3%, and 10.8%. Moreover, the state-of-the-art results on MatKGQA show its robust out-of-distribution generalization to novel KGs in low-resource specific domains.

Original languageEnglish
JournalIEEE Access
Volume14
Pages (from-to)59158-59170
Number of pages13
ISSN2169-3536
DOIs
Publication statusPublished - 2026

Bibliographical note

Publisher Copyright:
© 2026 The Authors.

Research areas and keywords

  • generalizability
  • KGQA
  • Knowledge graphs
  • question answering
  • Informatics

ASJC Scopus Subject Areas

  • General Computer Science
  • General Materials Science
  • General Engineering
  • Materials Science(all)
  • Engineering(all)
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'STaRQ-Agent-Investigating Generalization in Knowledge Graph Question Answering via a Multi-Agent Collaborative Framework'. Together they form a unique fingerprint.

Cite this