Does the use of alternative predictor methods reduce subgroup differences? It depends on the construct

AbstractUsing a barebones metaanalysis, the present study examined the effectiveness of the use of commonly considered alternative predictor methods as a means to reduce subgroup differences (i.e., the methodchange approach), taking into account the constructs assessed. With a focus on assessment centers, interviews, situational judgment tests, and work samples as alternative methods, the results indicated that consonant with the construct/method distinction, the effectiveness of a method in reducing subgroup differences is a function of the constructs assessed. Specifically, there are larger WhiteAfrican American subgroup differences that favor Whites for cognitive constructs on paperandpencil tests compared to the alternative methods; and most notably, the opposite result was obtained for noncognitive constructs such that, compared to paperandpencil assessments, substantially larger WhiteAfrican American subgroup differences were observed for alternative methods. A similar pattern of results was obtained for WhiteHispanic comparisons, albeit based on a smaller number of data points. In summary, the study's results indicate that the ubiquitously asserted effectiveness of the methodchange approach for reducing subgroup differences is overstated, with said effectiveness depending on the construct assessed.

Arthur, Winfred Jr||Keiser, Nathanael L||Atoba, Olabisi A||Cho, Inchul||Edwards, Bryan D

Overview