"Meet the New Boss. Same as the Old Boss:" A Commentary on Williams, Wormith, Bonta, and Sitarenios (2017) Academic Article

abstract

• 2017 International Association of Forensic Mental Health Services. This commentary on Williams et al. (2017) focuses on an additional and equally important issue not addressed in their critique: inter-rater reliability --particularly reliability in field settings. A growing body of evidence indicates that risk assessment instruments administered in applied (and especially adversarial) contexts may be considerably less stable across examiners than what typically is reported in well-controlled, peer-reviewed journal publications. Because reliability constrains validity, effect sizes from such published research may overestimate predictive validity in real-world contexts. Although validity evidence is important, field reliability remains the boss when considering how well an assessment procedure will perform in applied settings.

authors

• Edens, John

published proceedings

• INTERNATIONAL JOURNAL OF FORENSIC MENTAL HEALTH

author list (cited authors)

• Edens, J. F., & Kelley, S. E.

citation count

• 21

complete list of authors

• Edens, John F||Kelley, Shannon E

publication date

• January 2017

publisher

• Taylor & Francis  Publisher

published in

• International Journal of Forensic Mental Health  Journal

keywords

• Field Studies
• Inter-rater Reliability
• Predictive Validity
• Risk Assessment
• Violence Risk

Digital Object Identifier (DOI)

• 10.1080/14999013.2016.1268221

start page

• 23

end page

• 27

volume

• 16

issue

• 1