Situational judgment tests: A review of recent research

• Main Authors: LIEVENS, Filip, PEETERS, Helga, SCHOLLAERT, Eveline
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2008
• Subjects: Selection; interpersonal skills; human resourcing; aptitude tests; competences; Human Resources Management; Organizational Behavior and Theory
• Online Access: https://ink.library.smu.edu.sg/lkcsb_research/5678; https://ink.library.smu.edu.sg/context/lkcsb_research/article/6677/viewcontent/sjtreview.pdf
• Institution: Singapore Management University

Purpose - The purpose of this paper is to give an empirically-based review of the strengths and weaknesses of situational judgment tests (SJTs).Design/methodology/approach - The features, history, and development of SJTs are discussed. Next, a computerized search (from 1990-2007) is conducted to retrieve empirical studies related to SJTs. The effectiveness of SJTs is discussed in terms of reliability, criterion-related validity, incremental validity, construct-related validity, utility, adverse impact, applicant perceptions, fakability, and susceptibility to practice and coaching effects.Findings - Strengths of SJTs are that they show criterion-related validity and incremental validity above cognitive ability and personality tests. SJTs have also less adverse impact towards minorities (especially if the cognitive loading of the SJT is low). Furthermore, applicant reactions towards SJTs are positive and SJTs enable to test large applicant groups at once (through the Internet). In terms of weaknesses, SJTs might be prone to faking, practice, and coaching effects. There is also debate about what constructs are measured by SJTs.Research limitations/implications - Five avenues for future research are discussed: construct-related validity of SJTs, utility of SJTs vis-a-vis other predictors, impact of SJT features on validity and adverse impact, examination of alternative stimulus and response formats, and cross-cultural transportability of SJTs.Practical implications - Practitioners receive evidence-based information about the features, development, and strengths and weaknesses of SJTs.Originality/value - Apart from the USA, SJTs have not made strong inroads in selection practice in Europe and other parts of the world. This evidence-based paper might highlight the value of SJTs.