Abstract
Objective: The construct validity of checklist and global process scores for an objective structured clinical examination (OSCE) in psychiatry was assessed. Multiple regression analysis was used to predict psychiatry OSCE scores from the clinical skills examination, an obstetrics/gynecology (OB/GYN) OSCE, and the National Board of Medical Examiners (NBME) psychiatry subject examination. Methods: Archival data from two successive classes of third-year medical students (1999–2000, N=142; 2000–2001, N= 144) were aggregated and analyzed. Results: The pattern and magnitude of convergence and discrimination were indicative of adequate construct validity for both the psychiatry checklist scores and the global process score. Clinical skills examination scores for history taking, interpersonal skills, and physical examination were related to psychiatry OSCE scores that reflected the same skill set. Construct validity was fairly higher for the global process rating. Conclusion: Evidence of construct validity of a psychiatry OSCE was obtained from multiple measures of performance, including the clinical skills examination. Findings lend support to the continued use of checklist and global process evaluations as part of OSCEs in psychiatry.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Hodges B, Regehr G, Hanson M, McNaughton N: Validation of an objective structured clinical examination in psychiatry. Acad Med 1998; 73: 910–912
Reznick RK, Regehr G, Yee G, Rothman A, Blackmore D, Dauphinee D: Process-rating forms versus task-specific checklists in an OSCE for medical licensure. Acad Med 1998; 73: S97–S99
Hodges B, Regehr G, Hanson M, McNaughton N: An objective structured clinical examination for evaluating psychiatric clinical clerks. Acad Med 1997; 72: 715–721
Regehr G, Freeman R, Hodges B, Russell L: Assessing the generalizability of OSCE measures across content domains. Acad Med 1999; 74: 1320–1322
Regehr G, MacRae H, Reznick RK, Szalay D: Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med 1998; 73: 993–997
Hodges B, Regehr G, McNaughton N, Tiberius R, Hanson M: OSCE checklists do not capture increasing levels of expertise. Acad Med 1999; 74: 1129–1134
Hodges B, McNaughton N, Regehr G, Tiberius R, Hanson M: The challenge of creating new OSCE measures to capture the characteristics of expertise. Med Educ 2002; 36: 742–748
Cohen R, Rothman AI, Ross J, Poldre P: Validating an objective structured clinical examination (OSCE) as a method for selecting foreign medical graduates for a pre-internship program. Acad Med 1991; 66: S67–S69
Anastasi A: Psychological Testing, 5th ed. New York, Macmillan, 1982
Webster G: Final Report of the Patient Satisfaction Questionnaire Project. Philadelphia, American Board of Internal Medicine, 1989
National Board of Medical Examiners: Subject Examination Program Information Guide, 9th ed. Philadelphia, NBME, 2000
United States Medical Licensing Examination: An analysis of U.S. student field trial and international medical graduate certification testing results for the proposed USMLE Clinical Skills Examination. Available at www.usmle.org. Accessed May 23, 2003
Merrick HW, Nowacek G, Boyer J, Robertson J: Comparison of the Objective Structured Clinical Examination with the performance of third-year medical students in surgery. Am J Surg 2000; 179: 286–288
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Park, R.S., Chibnall, J.T., Blaskiewicz, R.J. et al. Construct Validity of an Objective Structured Clinical Examination (OSCE) in Psychiatry: Associations With the Clinical Skills Examination and Other Indicators. Acad Psychiatry 28, 122–128 (2004). https://doi.org/10.1176/appi.ap.28.2.122
Published:
Issue Date:
DOI: https://doi.org/10.1176/appi.ap.28.2.122