The chemistry between us: Illuminating complementarity patterns in interpersonal role play assessment via moment-to-moment analyses

In assessment and selection, organizations often include interpersonal interactions because they provide insights into candidates’ interpersonal skills. These skills are then typically assessed via one-shot, retrospective assessor ratings. Unfortunately, the assessment of interpersonal skills at suc...

Full description

Saved in:
Bibliographic Details
Main Authors: HERDE, Christoph N., Filip LIEVENS
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2024
Subjects:
Online Access:https://ink.library.smu.edu.sg/lkcsb_research/7273
https://ink.library.smu.edu.sg/context/lkcsb_research/article/8272/viewcontent/chemistry_between_us.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English
id sg-smu-ink.lkcsb_research-8272
record_format dspace
spelling sg-smu-ink.lkcsb_research-82722024-05-21T03:33:06Z The chemistry between us: Illuminating complementarity patterns in interpersonal role play assessment via moment-to-moment analyses HERDE, Christoph N. Filip LIEVENS, In assessment and selection, organizations often include interpersonal interactions because they provide insights into candidates’ interpersonal skills. These skills are then typically assessed via one-shot, retrospective assessor ratings. Unfortunately, the assessment of interpersonal skills at such a trait-like level fails to capture the richness of how the interaction unfolds at the behavioral exchange level within a role-play assessment. This study uses the lens of interpersonal complementarity theory to advance our understanding of interpersonal dynamics in role-play assessment and their effects on assessor ratings. Ninety-six MBA students participated in four different flash role-plays as part of diagnosing their strengths and weaknesses. Apart from gathering assessor ratings and criterion measures, coders also conducted a fine-grained examination of how the behavior of the two interaction partners (i.e., MBA students and roleplayers) unfolded at the moment-to-moment level via the Continuous Assessment of Interpersonal Dynamics (CAID) measurement tool. In all role-plays, candidates consistently showed mutual adaptations in line with complementarity principles: Affiliative behavior led to affiliative behavior, whereas dominant behavior resulted in docile, following behavior and vice versa. For affiliation, mutual influence also occurred in that both interaction partners’ temporal trends in affiliation were entrained over time. Complementarity patterns were significantly related to ratings of in situ (role-playing) assessors but not to ratings of ex situ (remote) assessors. The effect of complementarity on validity was mixed. Overall, this study highlights the importance of going beyond overall ratings to capture behavioral contingencies such as complementarity patterns in interpersonal role-play assessment. 2024-04-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/lkcsb_research/7273 info:doi/10.1037/apl0001160 https://ink.library.smu.edu.sg/context/lkcsb_research/article/8272/viewcontent/chemistry_between_us.pdf http://creativecommons.org/licenses/by-nc-sa/4.0/ Research Collection Lee Kong Chian School Of Business eng Institutional Knowledge at Singapore Management University Interpersonal complementarity theory assessment center role plays continuous rating assessments asynchronous video formats Applied Behavior Analysis Industrial and Organizational Psychology Organizational Behavior and Theory
institution Singapore Management University
building SMU Libraries
continent Asia
country Singapore
Singapore
content_provider SMU Libraries
collection InK@SMU
language English
topic Interpersonal complementarity theory
assessment center
role plays
continuous rating assessments
asynchronous video formats
Applied Behavior Analysis
Industrial and Organizational Psychology
Organizational Behavior and Theory
spellingShingle Interpersonal complementarity theory
assessment center
role plays
continuous rating assessments
asynchronous video formats
Applied Behavior Analysis
Industrial and Organizational Psychology
Organizational Behavior and Theory
HERDE, Christoph N.
Filip LIEVENS,
The chemistry between us: Illuminating complementarity patterns in interpersonal role play assessment via moment-to-moment analyses
description In assessment and selection, organizations often include interpersonal interactions because they provide insights into candidates’ interpersonal skills. These skills are then typically assessed via one-shot, retrospective assessor ratings. Unfortunately, the assessment of interpersonal skills at such a trait-like level fails to capture the richness of how the interaction unfolds at the behavioral exchange level within a role-play assessment. This study uses the lens of interpersonal complementarity theory to advance our understanding of interpersonal dynamics in role-play assessment and their effects on assessor ratings. Ninety-six MBA students participated in four different flash role-plays as part of diagnosing their strengths and weaknesses. Apart from gathering assessor ratings and criterion measures, coders also conducted a fine-grained examination of how the behavior of the two interaction partners (i.e., MBA students and roleplayers) unfolded at the moment-to-moment level via the Continuous Assessment of Interpersonal Dynamics (CAID) measurement tool. In all role-plays, candidates consistently showed mutual adaptations in line with complementarity principles: Affiliative behavior led to affiliative behavior, whereas dominant behavior resulted in docile, following behavior and vice versa. For affiliation, mutual influence also occurred in that both interaction partners’ temporal trends in affiliation were entrained over time. Complementarity patterns were significantly related to ratings of in situ (role-playing) assessors but not to ratings of ex situ (remote) assessors. The effect of complementarity on validity was mixed. Overall, this study highlights the importance of going beyond overall ratings to capture behavioral contingencies such as complementarity patterns in interpersonal role-play assessment.
format text
author HERDE, Christoph N.
Filip LIEVENS,
author_facet HERDE, Christoph N.
Filip LIEVENS,
author_sort HERDE, Christoph N.
title The chemistry between us: Illuminating complementarity patterns in interpersonal role play assessment via moment-to-moment analyses
title_short The chemistry between us: Illuminating complementarity patterns in interpersonal role play assessment via moment-to-moment analyses
title_full The chemistry between us: Illuminating complementarity patterns in interpersonal role play assessment via moment-to-moment analyses
title_fullStr The chemistry between us: Illuminating complementarity patterns in interpersonal role play assessment via moment-to-moment analyses
title_full_unstemmed The chemistry between us: Illuminating complementarity patterns in interpersonal role play assessment via moment-to-moment analyses
title_sort chemistry between us: illuminating complementarity patterns in interpersonal role play assessment via moment-to-moment analyses
publisher Institutional Knowledge at Singapore Management University
publishDate 2024
url https://ink.library.smu.edu.sg/lkcsb_research/7273
https://ink.library.smu.edu.sg/context/lkcsb_research/article/8272/viewcontent/chemistry_between_us.pdf
_version_ 1814047514842628096