Intelligence assessment with computer simulations

Stephan Kröner; Jan L. Plass; Detlev Leutner

doi:10.1016/j.intell.2005.03.002

Intelligence assessment with computer simulations

Stephan Kröner^*
, Jan L. Plass
, Detlev Leutner

^*Corresponding author for this work

Research output: Journal contributions › Journal articles › Research › peer-review

99 Citations (Scopus)

Abstract

It has been suggested that computer simulations may be used for intelligence assessment. This study investigates what relationships exist between intelligence and computer-simulated tasks that mimic real-world problem-solving behavior, and discusses design requirements that simulations have to meet in order to be suitable for intelligence assessment. One hundred one participants took a test of inductive reasoning (BIS-K) and used the simulation MultiFlux [Kröner, S. (2001). Intelligenzdiagnostik per Computersimulation [Intelligence Assessment via computer simulation]. Münster: Waxmann.] designed to reduce the uncontrolled influence of prior knowledge, provide an evaluation-free exploration phase, and incorporate measures that are based on a theoretical model of simulation performance. Reliabilities of MultiFlux simulation performance scores were above .90, and the correlation of MultiFlux scores with BIS-K intelligence was, with r = .65 (adjusted r = .75), comparable to typical correlations among traditional intelligence tests. SEM analyses favored our theoretical performance model with three latent MultiFlux variables over a model with a single factor.

Original language	English
Journal	Intelligence
Volume	33
Issue number	4
Pages (from-to)	347-368
Number of pages	22
ISSN	0160-2896
DOIs	https://doi.org/10.1016/j.intell.2005.03.002
Publication status	Published - 01.07.2005
Externally published	Yes

Bibliographical note

This work was supported by the Klaus Tschira Stiftung gGmbH, Heidelberg, Germany. We would like to thank Markus Bühner of München University for his assistance in the data analysis for this article.

Research areas and keywords

Psychology

ASJC Scopus Subject Areas

Arts and Humanities (miscellaneous)
Developmental and Educational Psychology
Experimental and Cognitive Psychology

Access to Document

10.1016/j.intell.2005.03.002

Cite this

@article{19249ec624a240abb0c0fa5d78e2fcb9,

title = "Intelligence assessment with computer simulations",

abstract = "It has been suggested that computer simulations may be used for intelligence assessment. This study investigates what relationships exist between intelligence and computer-simulated tasks that mimic real-world problem-solving behavior, and discusses design requirements that simulations have to meet in order to be suitable for intelligence assessment. One hundred one participants took a test of inductive reasoning (BIS-K) and used the simulation MultiFlux [Kr{\"o}ner, S. (2001). Intelligenzdiagnostik per Computersimulation [Intelligence Assessment via computer simulation]. M{\"u}nster: Waxmann.] designed to reduce the uncontrolled influence of prior knowledge, provide an evaluation-free exploration phase, and incorporate measures that are based on a theoretical model of simulation performance. Reliabilities of MultiFlux simulation performance scores were above .90, and the correlation of MultiFlux scores with BIS-K intelligence was, with r = .65 (adjusted r = .75), comparable to typical correlations among traditional intelligence tests. SEM analyses favored our theoretical performance model with three latent MultiFlux variables over a model with a single factor.",

keywords = "Psychology",

author = "Stephan Kr{\"o}ner and Plass, \{Jan L.\} and Detlev Leutner",

note = "This work was supported by the Klaus Tschira Stiftung gGmbH, Heidelberg, Germany. We would like to thank Markus B{\"u}hner of M{\"u}nchen University for his assistance in the data analysis for this article. ",

year = "2005",

month = jul,

day = "1",

doi = "10.1016/j.intell.2005.03.002",

language = "English",

volume = "33",

pages = "347--368",

journal = "Intelligence",

issn = "0160-2896",

publisher = "Elsevier Ltd",

number = "4",

}

TY - JOUR

T1 - Intelligence assessment with computer simulations

AU - Kröner, Stephan

AU - Plass, Jan L.

AU - Leutner, Detlev

N1 - This work was supported by the Klaus Tschira Stiftung gGmbH, Heidelberg, Germany. We would like to thank Markus Bühner of München University for his assistance in the data analysis for this article.

PY - 2005/7/1

Y1 - 2005/7/1

N2 - It has been suggested that computer simulations may be used for intelligence assessment. This study investigates what relationships exist between intelligence and computer-simulated tasks that mimic real-world problem-solving behavior, and discusses design requirements that simulations have to meet in order to be suitable for intelligence assessment. One hundred one participants took a test of inductive reasoning (BIS-K) and used the simulation MultiFlux [Kröner, S. (2001). Intelligenzdiagnostik per Computersimulation [Intelligence Assessment via computer simulation]. Münster: Waxmann.] designed to reduce the uncontrolled influence of prior knowledge, provide an evaluation-free exploration phase, and incorporate measures that are based on a theoretical model of simulation performance. Reliabilities of MultiFlux simulation performance scores were above .90, and the correlation of MultiFlux scores with BIS-K intelligence was, with r = .65 (adjusted r = .75), comparable to typical correlations among traditional intelligence tests. SEM analyses favored our theoretical performance model with three latent MultiFlux variables over a model with a single factor.

AB - It has been suggested that computer simulations may be used for intelligence assessment. This study investigates what relationships exist between intelligence and computer-simulated tasks that mimic real-world problem-solving behavior, and discusses design requirements that simulations have to meet in order to be suitable for intelligence assessment. One hundred one participants took a test of inductive reasoning (BIS-K) and used the simulation MultiFlux [Kröner, S. (2001). Intelligenzdiagnostik per Computersimulation [Intelligence Assessment via computer simulation]. Münster: Waxmann.] designed to reduce the uncontrolled influence of prior knowledge, provide an evaluation-free exploration phase, and incorporate measures that are based on a theoretical model of simulation performance. Reliabilities of MultiFlux simulation performance scores were above .90, and the correlation of MultiFlux scores with BIS-K intelligence was, with r = .65 (adjusted r = .75), comparable to typical correlations among traditional intelligence tests. SEM analyses favored our theoretical performance model with three latent MultiFlux variables over a model with a single factor.

KW - Psychology

UR - https://www.scopus.com/pages/publications/20444486217

UR - https://www.mendeley.com/catalogue/f4e2dbc5-cc83-3bd8-bacd-ac5b8da58683/

U2 - 10.1016/j.intell.2005.03.002

DO - 10.1016/j.intell.2005.03.002

M3 - Journal articles

AN - SCOPUS:20444486217

SN - 0160-2896

VL - 33

SP - 347

EP - 368

JO - Intelligence

JF - Intelligence

IS - 4

ER -

Intelligence assessment with computer simulations

Abstract

Bibliographical note

Research areas and keywords

ASJC Scopus Subject Areas

Access to Document

Fingerprint

Cite this