The Magnitude and Extent of Cheating and Response Distortion Effects on Unproctored Internet-Based Tests of Cognitive Ability and Personality
Academic Article
Overview
Research
Identity
Additional Document Info
View All
Overview
abstract
The use of unproctored internetbased testing (UIT) for employee selection is quite widespread. Although this mode of testing has advantages over onsite testing, researchers and practitioners continue to be concerned about potential malfeasance (e.g., cheating and response distortion) under highstakes conditions. Therefore, the primary objective of the present study was to investigate the magnitude and extent of high and lowstakes retest effects on the scores of a UIT speeded cognitive ability test and two UIT personality measures. These data permitted inferences about the magnitude and extent of malfeasant responding. The study objectives were accomplished by implementing two withinsubjects design studies (Study 1N=296; Study 2N=318) in which test takers first completed the tests as job applicants (highstakes) or incumbents (lowstakes) then as research participants (lowstakes). For the speeded cognitive ability measure, the pattern of test score differences was more consonant with a psychometric practice effect than a malfeasance explanation. This result is likely due to the speeded nature of the test. And for the UIT personality measures, the pattern of higher highstakes scores compared with lower lowstakes scores is similar to those reported for proctored tests in the extant literature. Thus, our results indicate that the use of a UIT administration does not uniquely threaten personality measures in terms of elevated scores under highstakes testing that are higher than those observed for proctored tests in the extant literature.
