Insights from an updated personnel selection meta-analytic matrix: Revisiting general mental ability tests’ role in the validity-diversity trade-Off

General mental ability (GMA) tests have long been at the heart of the validity–diversity trade-off, with conventional wisdom being that reducing their weight in personnel selection can improve adverse impact, but that this results in steep costs to criterion-related validity. However, Sackett et al....

Full description

Saved in:
Bibliographic Details
Main Authors: BERRY, Christopher M., LIEVENS, Filip, ZHANG, Charlene, SACKETT, Paul R.
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2024
Subjects:
Online Access:https://ink.library.smu.edu.sg/lkcsb_research/7568
https://ink.library.smu.edu.sg/context/lkcsb_research/article/8567/viewcontent/UpdatedGMA_av.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English
id sg-smu-ink.lkcsb_research-8567
record_format dspace
spelling sg-smu-ink.lkcsb_research-85672024-09-21T16:28:43Z Insights from an updated personnel selection meta-analytic matrix: Revisiting general mental ability tests’ role in the validity-diversity trade-Off BERRY, Christopher M. LIEVENS, Filip ZHANG, Charlene SACKETT, Paul R. General mental ability (GMA) tests have long been at the heart of the validity–diversity trade-off, with conventional wisdom being that reducing their weight in personnel selection can improve adverse impact, but that this results in steep costs to criterion-related validity. However, Sackett et al. (2022) revealed that the criterion-related validity of GMA tests has been considerably overestimated due to inappropriate range restriction corrections. Thus, we revisit the role of GMA tests in the validity-diversity trade-off using an updated meta-analytic correlation matrix of the relationships six selection methods (biodata, GMA tests, conscientiousness tests, structured interviews, integrity tests, and situational judgment tests) have with job performance, along with their Black–White mean differences. Our results lead to the conclusion that excluding GMA tests generally has little to no effect on validity, but substantially decreases adverse impact. Contrary to popular belief, GMA tests are not a driving factor in the validity-diversity trade-off. This does not fully resolve the validity-diversity trade-off, though: Our results show there is still some validity reduction required to get to an adverse impact ratio of .80, although the validity reduction is less than previously thought. Instead, it shows that the validity–diversity trade-off conversation should shift from the role of GMA tests to that of other selection methods. The present study also addresses which selection methods now emerge as most valid and whether composites of selection methods can result in validities similar to those expected prior to Sackett et al. (2022). 2024-01-01T08:00:00Z text application/pdf https://ink.library.smu.edu.sg/lkcsb_research/7568 info:doi/10.1037/apl0001203 https://ink.library.smu.edu.sg/context/lkcsb_research/article/8567/viewcontent/UpdatedGMA_av.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection Lee Kong Chian School Of Business eng Institutional Knowledge at Singapore Management University general mental ability tests meta-analytic correlation matrix personnel selection validity-diversity trade-off Human Resources Management Organizational Behavior and Theory
institution Singapore Management University
building SMU Libraries
continent Asia
country Singapore
Singapore
content_provider SMU Libraries
collection InK@SMU
language English
topic general mental ability tests
meta-analytic correlation matrix
personnel selection
validity-diversity trade-off
Human Resources Management
Organizational Behavior and Theory
spellingShingle general mental ability tests
meta-analytic correlation matrix
personnel selection
validity-diversity trade-off
Human Resources Management
Organizational Behavior and Theory
BERRY, Christopher M.
LIEVENS, Filip
ZHANG, Charlene
SACKETT, Paul R.
Insights from an updated personnel selection meta-analytic matrix: Revisiting general mental ability tests’ role in the validity-diversity trade-Off
description General mental ability (GMA) tests have long been at the heart of the validity–diversity trade-off, with conventional wisdom being that reducing their weight in personnel selection can improve adverse impact, but that this results in steep costs to criterion-related validity. However, Sackett et al. (2022) revealed that the criterion-related validity of GMA tests has been considerably overestimated due to inappropriate range restriction corrections. Thus, we revisit the role of GMA tests in the validity-diversity trade-off using an updated meta-analytic correlation matrix of the relationships six selection methods (biodata, GMA tests, conscientiousness tests, structured interviews, integrity tests, and situational judgment tests) have with job performance, along with their Black–White mean differences. Our results lead to the conclusion that excluding GMA tests generally has little to no effect on validity, but substantially decreases adverse impact. Contrary to popular belief, GMA tests are not a driving factor in the validity-diversity trade-off. This does not fully resolve the validity-diversity trade-off, though: Our results show there is still some validity reduction required to get to an adverse impact ratio of .80, although the validity reduction is less than previously thought. Instead, it shows that the validity–diversity trade-off conversation should shift from the role of GMA tests to that of other selection methods. The present study also addresses which selection methods now emerge as most valid and whether composites of selection methods can result in validities similar to those expected prior to Sackett et al. (2022).
format text
author BERRY, Christopher M.
LIEVENS, Filip
ZHANG, Charlene
SACKETT, Paul R.
author_facet BERRY, Christopher M.
LIEVENS, Filip
ZHANG, Charlene
SACKETT, Paul R.
author_sort BERRY, Christopher M.
title Insights from an updated personnel selection meta-analytic matrix: Revisiting general mental ability tests’ role in the validity-diversity trade-Off
title_short Insights from an updated personnel selection meta-analytic matrix: Revisiting general mental ability tests’ role in the validity-diversity trade-Off
title_full Insights from an updated personnel selection meta-analytic matrix: Revisiting general mental ability tests’ role in the validity-diversity trade-Off
title_fullStr Insights from an updated personnel selection meta-analytic matrix: Revisiting general mental ability tests’ role in the validity-diversity trade-Off
title_full_unstemmed Insights from an updated personnel selection meta-analytic matrix: Revisiting general mental ability tests’ role in the validity-diversity trade-Off
title_sort insights from an updated personnel selection meta-analytic matrix: revisiting general mental ability tests’ role in the validity-diversity trade-off
publisher Institutional Knowledge at Singapore Management University
publishDate 2024
url https://ink.library.smu.edu.sg/lkcsb_research/7568
https://ink.library.smu.edu.sg/context/lkcsb_research/article/8567/viewcontent/UpdatedGMA_av.pdf
_version_ 1814047866273923072