Abstract
Objective: To improve compliance with computer-generated reminders to perform fecal occult blood testing (FOBT), mammography, and cervical Papanicolaou (Pap) testing.
Design: Six-month prospective, randomized, controlled trial.
Setting: Academic primary care general internal medicine practice.
Subjects: Thirty-one general internal medicine faculty, 145 residents, and 5,407 patients with scheduled visits who were eligible for any of the three cancer screening protocols.
Intervention: Primary care teams of internal medicine residents and faculty received either routine computer reminders (control) or the same reminders to which they were required to circle one of four responses: 1) “done/order today,” 2) “not applicable to this patient,” 3) “patient refused,” or 4) “next visit.”
Results: Intervention physicians complied more frequently than control physicians with all reminders combined (46% vs 38%, respectively, p=0.002) and separately with reminders for FOBT (61% vs 49%, p=0.0007) and mammography (54% vs 47%, p=0.036) but not cervical Pap testing (21% vs 18%, p=0.2). Intervention residents responded significantly more often than control residents to all reminders together and separately to reminders for FOBT and mammography but not Pap testing. There was no significant difference between intervention and control faculty, but the compliance rate for control faculty was significantly higher than the rate for control residents for all reminders together and separately for FOBT but not mammography or Pap testing. The intervention’s effect was greatest for patients ≥70 years old, with significant results for all tests, together and singly, for residents but not faculty. Intervention physicians felt that the reminders were not applicable 21% of the time (due to inadequate data in patients’ electronic medical records) and stated that their patients refused 10% of the time.
Conclusions: Requiring physicians to respond to computer-generated reminders improved their compliance with preventive care protocols, especially for elderly patients for whom control physicians’ compliance was the lowest. However, 100% compliance with cancer screening reminders will be unattainable due to incomplete data and patient refusal.
Similar content being viewed by others
References
McDonald CJ, Hui SL, Smith DM, Tierney WM, et al. Reminders to physicians from an introspective computer medical record. A two-year randomized trial. Ann Intern Med. 1984;100:130–8.
Woo B, Woo B, Cook EF, Weisberg M, Goldman L. Screening procedures in the asymptomatic adult: comparison of physicians’ recommendations, patients’ desires, published guidelines, and actual practice. JAMA. 1985;254:1480–4.
Barnett GO, Winickoff RN. Quality assurance and computer-based patient records. Am J Public Health. 1990;80:527–8
Buff KR, Kaufman L, Thomas JP (eds). Handbook of Perception and Human Performance. Vol. II, Cognitive Processes and Performance. New York: John Wiley, 1986.
Frame PS, Kowulich BA, Llewellyn AM. Improving physician compliance with a Health Maintenance Protocol. J Fam Pract. 1984;19:341–4.
Cohen DI, Littenberg B, Wetzel C, Neuhauser DB. Improving physician compliance with preventive care guidelines. Med Care. 1982;20:1040–5.
Cheney C, Ramsdell JW. Effect of medical records’ checklist on implementation of periodic health measures. Am J Med. 1987;83:129–36.
Tierney WM, Hui SL, McDonald CJ. Delayed feedback of physician performance versus immediate reminders to perform preventive care: effects on physician compliance. Med Care. 1986;24:659–66.
McDonald CJ. Action-Oriented Decision in Ambulatory Medicine. Chicago: Year Book, 1981.
Tierney WM, Miller ME, Hui SL, McDonald CJ. Practice randomization and clinical research: the Indiana experience. Med Care. 1991;29(suppl):JS57-JS64.
McDonald CJ, Blevins L, Tierney WM, Martin DK. The Regenstrief Medical Records. MD Comput. 1988;5:34–47.
Canadian Task Force on the Periodic Health Examination. The periodic health examination. Can Med Assoc J. 1979;121:1193–254.
Canadian Task Force on the Periodic Health Examination. The periodic health examination 2. 1985 update. Can Med Assoc J. 1985;134:724–9.
Breslow L, Somers AR. The lifetime Health Monitoring program: a practical approach to preventive medicine. N Eng J Med. 1977;296:601–8.
American Cancer Society. Guidelines for the cancer-related check-up, recommendations, and rationale. CA Cancer J Clin. 1985;35:199.
American Cancer Society. Change in American Cancer Society check-up guidelines for detection of cervical cancer. CA Cancer J Clin. 1988;38:127–8.
Love RR, Rodnick JE, McPhee SJ. Community models for cancer prevention and detection. CA Cancer J Clin. 1988;62:1815–20.
Tierney WM, Miller ME, McDonald CJ. The effect on test ordering of informing physicians of the charges for outpatient diagnostic tests. N Engl J Med. 1990;233:1499–504.
Litzelman DK, Dittus RS, Dame MA, Tierney WM. Barriers to preventive care. Clin Res. 1990;38:717A.
Tierney WM, McDonald CJ, Martin DK, Hui SL, Rogers MP. Computerized display of past test results: effects on outpatient testing. Ann Intern Med. 1987;107:569–74.
Kleinman J. Proportions with extraneous variance: single and independent samples. J Am Stat Assoc. 1973;68:46–54.
Dittus RS, Tierney WM. Scheduling follow-up office visits: physician variability. Clin Res. 1987;35:738A.
Turner BJ, Day SC, Borenstein B. A controlled trial to improve delivery of preventive care: physician or patient reminders? J Gen Intern Med. 1989;4:403–9.
Shapiro S. Screening for early detection of cancer and heart disease. Bull N Y Acad Med. 1975;51(1):80–95.
Mandelblatt J, Gopaul I, Wistreich M. Gynecological care of elderly women. Another look at Papanicolaou smear testing. JAMA. 1986;256:367–71.
Massachusetts Department of Public Health. Pap testing—are we screening the wrong women? N Engl J Med. 1976;294:223.
Hayward RA, Shapiro MF, Freeman HC, Corey CR. Who gets screened for cervical and breast cancer? Results from a new national survey. Arch Intern Med. 1988;148:1177–81.
Celentano DD, Shapiro S, Weisman C. Cancer preventive screening behavior among elderly women. Prev Med. 1982;11:454–63.
Margolis KL, Lofgren RP, Korn JE. Organizational strategies to improve influenza vaccine delivery. A standing order in a general medicine clinic. Arch Intern Med. 1988;148:2205–7.
Nichol KL, Korn JE, Margolis KL, et al. Achieving the national health objective for influenza immunization: success of an institution-wide vaccination program. Am J Med. 1990;89:156–60.
McPhee SJ, Bird JA, Fordham D, Rodnick JE, Osborn EH. Promoting cancer prevention activities by primary care physicians. Results of a randomized, controlled trial. JAMA. 1991;266:538–44.
Author information
Authors and Affiliations
Additional information
Received from the Regenstrief Institute for Health Care, the Department of Medicine of the Indiana University School of Medicine, and the Richard L. Roudebush Veterans Administration Medical Center, Indianapolis, Indiana.
Supported by grant number D28-PE55990 from the Health Research Service Administration and grants number HS-04996 and HS-05626 from the Agency for Health Care Policy and Research.
Rights and permissions
About this article
Cite this article
Litzelman, D.K., Dittus, R.S., Miller, M.E. et al. Requiring physicians to respond to computerized reminders improves their compliance with preventive care protocols. J Gen Intern Med 8, 311–317 (1993). https://doi.org/10.1007/BF02600144
Issue Date:
DOI: https://doi.org/10.1007/BF02600144