Blake K; Kutcher M; Murphy J; Wakefield S; Mann Karen. Dalhousie University, Nova Scotia, Canada
Introduction: The structured communication adolescent guide (SCAG) is a tool for adolescent patients to provide feedback to medical students on their psychosocial interviewing1. The SCAG has undergone rigorous psychometric evaluation and as a result has been modified over the last 5 years2.
Purpose: To determine the inter-rater reliability of the SCAG with trained male and female adolescent raters.
Method: Adolescents (4 male, 4 female) were trained to use the SCAG until 80% agreement was achieved. The adolescents each viewed 38-videotaped interviews, 40 minutes in length. The interview was an adolescent female standardized patient (SP) being seen for attention deficit disorder requiring a repeat prescription. The interviewers were medical students, residents, GPs or pediatricians.
Analysis: To assess inter-rater reliability, interclass correlation coefficients were calculated for each of the 29 checklist items as well as for the 4 General Ratings sections of the SCAG.
|SCAG Section||N = Number of Items||Mean ICC Value||Standard Deviation||Maximum, Range|
|General Ratings||4||0.756||0.756||0.942, 0.315|
Conclusion: This study adds to the psychometric properties of the SCAG supporting a higher reliability within a population of male and female adolescent scorers who have been trained to use the SCAG. This instrument can be used reliably in a medical school setting for adolescents to score our medical students.