Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range
This paper systematically revisits prior meta-analytic conclusions about the criterion-related validity of personnel selection procedures, and particularly the effect of range restriction corrections on those validity estimates. Corrections for range restriction in meta-analyses of predictor–criteri...
Saved in:
Main Authors: | , , , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2022
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/lkcsb_research/6894 https://ink.library.smu.edu.sg/context/lkcsb_research/article/7893/viewcontent/OvercorrectingRangeRestriction_av.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.lkcsb_research-7893 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.lkcsb_research-78932024-02-08T05:03:50Z Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range SACKETT, Paul R. ZHANG, Charlene BERRY, Christopher M. LIEVENS, Filip This paper systematically revisits prior meta-analytic conclusions about the criterion-related validity of personnel selection procedures, and particularly the effect of range restriction corrections on those validity estimates. Corrections for range restriction in meta-analyses of predictor–criterion relationships in personnel selection contexts typically involve the use of an artifact distribution. After outlining and critiquing five approaches that have commonly been used to create and apply range restriction artifact distributions, we conclude that each has significant issues that often result in substantial overcorrection and that therefore the validity of many selection procedures for predicting job performance has been substantially overestimated. Revisiting prior meta-analytic conclusions produces revised validity estimates. Key findings are that most of the same selection procedures that ranked high in prior summaries remain high in rank, but with mean validity estimates reduced by .10–.20 points. Structured interviews emerged as the top-ranked selection procedure. We also pair validity estimates with information about mean Black–White subgroup differences per selection procedure, providing information about validity–diversity tradeoffs. We conclude that our selection procedures remain useful, but selection predictor–criterion relationships are considerably lower than previously thought. 2022-11-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/lkcsb_research/6894 info:doi/10.1037/apl0000994 https://ink.library.smu.edu.sg/context/lkcsb_research/article/7893/viewcontent/OvercorrectingRangeRestriction_av.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection Lee Kong Chian School Of Business eng Institutional Knowledge at Singapore Management University selection procedures validity meta-analysis range restriction artifact distribution Industrial and Organizational Psychology Organizational Behavior and Theory |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
selection procedures validity meta-analysis range restriction artifact distribution Industrial and Organizational Psychology Organizational Behavior and Theory |
spellingShingle |
selection procedures validity meta-analysis range restriction artifact distribution Industrial and Organizational Psychology Organizational Behavior and Theory SACKETT, Paul R. ZHANG, Charlene BERRY, Christopher M. LIEVENS, Filip Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range |
description |
This paper systematically revisits prior meta-analytic conclusions about the criterion-related validity of personnel selection procedures, and particularly the effect of range restriction corrections on those validity estimates. Corrections for range restriction in meta-analyses of predictor–criterion relationships in personnel selection contexts typically involve the use of an artifact distribution. After outlining and critiquing five approaches that have commonly been used to create and apply range restriction artifact distributions, we conclude that each has significant issues that often result in substantial overcorrection and that therefore the validity of many selection procedures for predicting job performance has been substantially overestimated. Revisiting prior meta-analytic conclusions produces revised validity estimates. Key findings are that most of the same selection procedures that ranked high in prior summaries remain high in rank, but with mean validity estimates reduced by .10–.20 points. Structured interviews emerged as the top-ranked selection procedure. We also pair validity estimates with information about mean Black–White subgroup differences per selection procedure, providing information about validity–diversity tradeoffs. We conclude that our selection procedures remain useful, but selection predictor–criterion relationships are considerably lower than previously thought. |
format |
text |
author |
SACKETT, Paul R. ZHANG, Charlene BERRY, Christopher M. LIEVENS, Filip |
author_facet |
SACKETT, Paul R. ZHANG, Charlene BERRY, Christopher M. LIEVENS, Filip |
author_sort |
SACKETT, Paul R. |
title |
Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range |
title_short |
Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range |
title_full |
Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range |
title_fullStr |
Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range |
title_full_unstemmed |
Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range |
title_sort |
revisiting meta-analytic estimates of validity in personnel selection: addressing systematic overcorrection for restriction of range |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2022 |
url |
https://ink.library.smu.edu.sg/lkcsb_research/6894 https://ink.library.smu.edu.sg/context/lkcsb_research/article/7893/viewcontent/OvercorrectingRangeRestriction_av.pdf |
_version_ |
1794549508753850368 |