Skip to main content
SpringerLink
Log in

The Relationship between Checklist Scores on a Communication OSCE and Analogue Patients’ Perceptions of Communication

  • Published:
Advances in Health Sciences Education Aims and scope Submit manuscript

Abstract

Many efforts to teach and evaluate physician–patient communication are based on two assumptions: first, that communication can be conceptualized as consisting of specific observable behaviors, and second, that physicians who exhibit certain behaviors are more effective in communicating with patients. These assumptions are usually implicit, and are seldom tested. The purpose of this study was to investigate whether specific communication behaviors are positively related to patients’ perceptions of effective communication. Trained raters used a checklist to record the presence or absence of specific communication behaviors in 100 encounters in a communication Objective Structured Clinical Examination (OSCE). Lay volunteers served as analogue patients and rated communication during each encounter. Correlations between checklist scores and analogue patients’ ratings were not significantly different from zero for four of five OSCE cases studied. Within each case, certain communication behaviors did appear to be related to patients’ ratings, but the critical behaviors were not consistent across cases. We conclude that scores from OSCE communication checklists may not predict patients’ perceptions of communication. Determinants of patient perceptions of physician communication may be more subtle, more complex, and more case-specific than we were able to capture with the current checklist.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • American Board of Internal Medicine (1989). Final report on the patient satisfaction questionnaire project. Philadelphia: Webster, G.D., MD

  • K.D. Bertakis D. Roter S.M. Putnam (1991) ArticleTitleThe relationship of physician medical interview style to patient satisfaction The Journal of Family Practice 32 175–181 Occurrence Handle1:STN:280:By6C3MnivVY%3D Occurrence Handle1990046

    CAS  PubMed  Google Scholar 

  • A.V. Blue A.W. Chessman G.E. Gilbert AG Mainous SuffixIII. (2000) ArticleTitleResponding to patients’ emotions: important for standardized patient satisfaction Family Medicine 32 326–330 Occurrence Handle1:STN:280:DC%2BD3c3otVejuw%3D%3D Occurrence Handle10820674

    CAS  PubMed  Google Scholar 

  • J.R. Boulet D.W. McKinley G.P. Whelan R.K. Hambleton (2003) ArticleTitleQuality assurance methods for performance-based assessments Advances in Health Sciences Education: Theory and Practice. 8 IssueID1 27–47 Occurrence Handle10.1023/A:1022639521218

    Article  Google Scholar 

  • C.A. Brailovsky Grand’Maiso P. (2000) ArticleTitleUsing evidence to improve evaluation: A Comprehensive Psychometric Assessment of a SP-Based OSCE Licensing Examination Advances in Health Sciences Education: Theory and Practice. 5 IssueID3 207–219 Occurrence Handle10.1023/A:1009869328173

    Article  Google Scholar 

  • C. Brazeau L. Boyd J. Crosson (2002) ArticleTitleChanging an existing OSCE to a teaching tool: The making of a teaching OSCE Academic Medicine. 77 IssueID9 932 Occurrence Handle10.1097/00001888-200209000-00036 Occurrence Handle12228103

    Article  PubMed  Google Scholar 

  • R.L. Brennan (2001) Generalizability Theory Springer-Verlag New York

    Google Scholar 

  • M.C. Duerson L.J. Romrell C.B. Stevens (2000) ArticleTitleImpacting faculty teaching and student performance: Nine years’ experience with the Objective Structured Clinical Examination Teaching and Learning in Medicine 12 IssueID4 176–182 Occurrence Handle10.1207/S15328015TLM1204_3 Occurrence Handle1:STN:280:DC%2BD3M7ntlehsg%3D%3D Occurrence Handle11273366

    Article  CAS  PubMed  Google Scholar 

  • M. Friedlich H. MacRae I. Oandasan D. Tannenbaum H. Batty R. Reznick et al. (2001) ArticleTitleStructured assessment of minor surgical skills (SAMSS) for family medicine residents Academic Medicine 76 1241–1246 Occurrence Handle1:STN:280:DC%2BD3MjgtFCgsQ%3D%3D Occurrence Handle11739051

    CAS  PubMed  Google Scholar 

  • P. Grand’Maison C.A. Brailovsky J. Lescop (1996) ArticleTitleContent validity of the Quebec licensing examination (OSCE) assessed by practising physicians Canadian Family Physician 42 254–259 Occurrence Handle1:STN:280:ByiA28rnsVM%3D Occurrence Handle9222574

    CAS  PubMed  Google Scholar 

  • J. Hall D. Roter N. Katz (1988) ArticleTitleMeta-analysis of correlates of provider behavior Medical Care 26 657–672 Occurrence Handle1:STN:280:BieB2srltlE%3D Occurrence Handle3292851

    CAS  PubMed  Google Scholar 

  • B. Hodges G. Regehr N. McNaughton R. Tiberius M. Hanson (1999) ArticleTitleOSCE checklists do not capture increasing levels of expertise Academic Medicine 74 1129–1134 Occurrence Handle1:STN:280:DC%2BD3c%2Fgs1Oiug%3D%3D Occurrence Handle10536636

    CAS  PubMed  Google Scholar 

  • B. Hodges J. Turnbull R. Cohen A. Bienenstock G. Norman (1996) ArticleTitleEvaluating communication skills in the OSCE format: Reliability and generalizability Medical Education 30 38–43 Occurrence Handle1:STN:280:BymB1Mjgs1Y%3D Occurrence Handle8736187

    CAS  PubMed  Google Scholar 

  • A. Hull S. Hodder B. Berger D. Ginsberg N. Lindheim J. Quan et al. (1995) ArticleTitleValidity of three clinical performance assessments of internal medicine clerks Academic Medicine 70 IssueID6 517–522 Occurrence Handle1:STN:280:ByqA3crpt1Y%3D Occurrence Handle7786372

    CAS  PubMed  Google Scholar 

  • M.J. Kahn W.W. Merrill D.S. Anderson H.M. Szerlip (2001) ArticleTitleResidency program director evaluations do not correlate with performance on a required 4th-year objective structured clinical examination Teaching and Learning in Medicine 13 IssueID1 9–12 Occurrence Handle10.1207/S15328015TLM1301_3 Occurrence Handle1:STN:280:DC%2BD3M7ntlegtA%3D%3D Occurrence Handle11273382

    Article  CAS  PubMed  Google Scholar 

  • W. Levinson D.L. Roter J.P. Mullooly V.T. Dull R.M. Frankel (1997) ArticleTitlePhysician–patient communication The relationship with malpractice claims among primary care physicians and surgeons. Journal of the American Medical Association 277 IssueID7 553–559 Occurrence Handle1:STN:280:ByiC1cvjs1Q%3D

    CAS  Google Scholar 

  • G. Makoul (2001) ArticleTitleThe SEGUE framework for teaching and assessing communication skills Patient Education and Counseling 45 23–34 Occurrence Handle10.1016/S0738-3991(01)00136-7 Occurrence Handle1:STN:280:DC%2BD3Mrls1Wjug%3D%3D Occurrence Handle11602365

    Article  CAS  PubMed  Google Scholar 

  • I.G. Martin B. Jolly (2002) ArticleTitlePredictive validity and estimated cut score of an objective structured clinical examination (OSCE) used as an assessment of clinical skills at the end of the first clinical year Medical Education. 36 IssueID5 418–425 Occurrence Handle10.1046/j.1365-2923.2002.01207.x Occurrence Handle12028391

    Article  PubMed  Google Scholar 

  • B. McKinstry (2002) ArticleTitleDo patients wish to be involved in decision making in the consultation? A cross sectional survey with video vignettes British Medical Journal 321 867–871

    Google Scholar 

  • I. Ockene J. Hebert J. Ockene G. Saperia R. Nicolosi P. Merriam et al. (1999) ArticleTitleEffect of physician-delivered nutrition counseling training and an office-support program on saturated fat intake, weight, and serum lipid measurements in a hyperlipidemic population: Worcester-area trial for counseling in hyperlipidemia (WATCH) Archives of Internal Medicine 159 725–731 Occurrence Handle10.1001/archinte.159.7.725 Occurrence Handle1:STN:280:DyaK1M3jtlWhsw%3D%3D Occurrence Handle10218753

    Article  CAS  PubMed  Google Scholar 

  • J.K. Ockene J. Kristeller R.J. Goldberg T.L. Amick P.S. Pekow D. Hosmer et al. (1991) ArticleTitleIncreasing the efficacy of physician-delivered smoking intervention: A randomized clinical trial Journal of General Internal Medicine 6 1–8 Occurrence Handle1:STN:280:By6C2Mvpt1E%3D Occurrence Handle1999742

    CAS  PubMed  Google Scholar 

  • J.K. Ockene A. Adams T.G. Hurley E.V. Wheeler J.R. Hebert (1999) ArticleTitleBrief physician- and nurse practitioner-delivered counseling for high-risk drinkers: Does it work? Archives of Internal Medicine 159 2198–2205 Occurrence Handle10.1001/archinte.159.18.2198 Occurrence Handle1:STN:280:DyaK1MvlsVChsw%3D%3D Occurrence Handle10527297

    Article  CAS  PubMed  Google Scholar 

  • L.M.L. Ong J.C.J.M. Dehaes A.M. Hoos F.B. Lammes (1995) ArticleTitleDoctor–patient communication – a review of the literature Social Science & Medicine 40 IssueID7 903–18

    Google Scholar 

  • G. Regehr H. MacRae R.K. Reznick D. Szalay (1998) ArticleTitleComparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination Academic Medicine 73 IssueID9 993–997 Occurrence Handle1:STN:280:DyaK1cvjtFalug%3D%3D Occurrence Handle9759104

    CAS  PubMed  Google Scholar 

  • R. Reznick S. Smee A. Rothman A. Chalmers D. Swanson L. Dufresne et al. (1992) ArticleTitleAn objective structured clinical examination for the licentiate: Report of the pilot project of the Medical Council of Canada Academic Medicine 67 487–494 Occurrence Handle1:STN:280:By2A28%2FhtVw%3D Occurrence Handle1497774

    CAS  PubMed  Google Scholar 

  • C.A. Roberts M.S. Aruguette (2000) ArticleTitleTask and socioemotional behaviors of physicians: A test of reciprocity and social interaction theories in analogue physician–patient encounters Social Science & Medicine 50 300–315

    Google Scholar 

  • C. Roberts V. Wass R. Jones S. Sarangi A. Gillett (2003) ArticleTitleA discourse analysis study of ’good’ and ’poor’ communication in an OSCE: A proposed new framework for teaching students Medical Education 37 IssueID3 192–201 Occurrence Handle10.1046/j.1365-2923.2003.01443.x Occurrence Handle12603757

    Article  PubMed  Google Scholar 

  • D.L. Roter J.A. Hall N.R. Katz (1987) ArticleTitleRelation between physicians’ behaviors and analogue patients’ satisfaction, recall, and impressions Medical Care 25 437–451 Occurrence Handle1:STN:280:BieD1M3ps10%3D Occurrence Handle3695654

    CAS  PubMed  Google Scholar 

  • J. Silverman S. Kurtz J. Draper (1998) Skills for Communicating with Patients Oxon UK

    Google Scholar 

  • P.A. Singer A. Robb R. Choen G. Norman J. Turnbull (1994) ArticleTitleEvaluation of a mutlicenter ethics objective structured clinical examination Journal of General Internal Medicine 9 690–692 Occurrence Handle1:STN:280:ByqC1c3itlQ%3D Occurrence Handle7876952

    CAS  PubMed  Google Scholar 

  • M. Stewart (1995) ArticleTitleEffective physician–patient communication and health outcomes: A review of the literature Canadian Medical Association Journal 152 1423–1433 Occurrence Handle1:STN:280:ByqB2crpsFw%3D Occurrence Handle7728691

    CAS  PubMed  Google Scholar 

  • M. Stewart J. Brown H. Boon J. Galajda L. Meredith M. Sangster (1999) ArticleTitleEvidence on doctor – patient communication Cancer Prevention & Control 3 25–30

    Google Scholar 

  • R.L. Street (1992) ArticleTitleAnalyzing communication in medical consultations: Do behavioral measures correspond to patients perceptions Medical Care 30 976–988 Occurrence Handle1434961

    PubMed  Google Scholar 

  • R. Tamblyn M. Abrahamowicz B. Schnarch JA. Colliver A. Benaroya L. Snell (1994) ArticleTitleCan standardized patients predict real-patient satisfaction with the doctor–patient relationship? Teaching and Learning in Medicine. 6 36–44

    Google Scholar 

  • P. Tombleson R.A. Fox J.A. Dacre (2000) ArticleTitleDefining the content for the objective structured clinical examination component of the professional and linguistic assessments board examination: Development of a blueprint Medical Education 34 IssueID7 566–572 Occurrence Handle10.1046/j.1365-2923.2000.00553.x Occurrence Handle1:STN:280:DC%2BD3czpvVSjuw%3D%3D Occurrence Handle10886640

    Article  CAS  PubMed  Google Scholar 

  • J. Dalen ParticleVan E. Kerkhofs B.W. Knippenberg-Berg ParticleVan Van Den H.A. Hout ParticleVan Den A.J. Scherpbier C.P. Vleuten ParticleVan der (2002) ArticleTitleLongitudinal and concentrated communication skills programmes: Two Dutch medical schools compared Advances in Health Sciences Education: Theory and Practice. 7 IssueID1 29–40 Occurrence Handle10.1023/A:1014576900127

    Article  Google Scholar 

  • M. Wensing C. Vleuten ParticleVan der R. Grol A. Felling (1997) ArticleTitleThe reliability of patients judgements of care in general practice: How many questions and patients are needed? Quality Health Care 6 80–85 Occurrence Handle1:STN:280:ByiH3c3htVY%3D

    CAS  Google Scholar 

  • T. Wilkinson D. Newble C. Frampton (2001) ArticleTitleStandard setting in an objective structured clinical examination: Use of global ratings of borderline performance to determine the passing score Medical Education 35 1043–1049 Occurrence Handle1:STN:280:DC%2BD3Mnlt1KktA%3D%3D Occurrence Handle11703640

    CAS  PubMed  Google Scholar 

  • P. Willson J.R. McNamara (1982) ArticleTitleHow perceptions of a simulated physician–patient interaction influence intended satisfaction and compliance Social Science & Medicine. 16 1699–1704

    Google Scholar 

  • J.O. Woolliscroft J.D. Howell B.P. Patel D.B. Swanson (1994) ArticleTitleResident–patient interactions: The humanistic qualities of internal medicine residents assessed by patients, attending physicians, program supervisors, and nurses Academic Medicine. 69 216–224 Occurrence Handle1:STN:280:ByuC1czjs1Y%3D Occurrence Handle8135980

    CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Meyers Primary Care Institute, USA

    Kathleen M. Mazor

  2. Fallon Foundation, USA

    Kathleen M. Mazor

  3. University of Massachusetts Medical School, Worcester, MA

    Kathleen M. Mazor, Judith K. Ockene, Michele M. Carlin & Mark E. Quirk

  4. University of Miami, Coral Gables, FL

    H. Jane Rogers

Authors
  1. Kathleen M. Mazor
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Judith K. Ockene
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. H. Jane Rogers
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Michele M. Carlin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mark E. Quirk
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kathleen M. Mazor.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Mazor, K.M., Ockene, J.K., Rogers, H.J. et al. The Relationship between Checklist Scores on a Communication OSCE and Analogue Patients’ Perceptions of Communication. Adv Health Sci Educ Theory Pract 10, 37–51 (2005). https://doi.org/10.1007/s10459-004-1790-2

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10459-004-1790-2

Keywords

Search

Navigation