Abstract
One approach to improving the quality of care for severe mental illnesses (SMI) such as schizophrenia is through the improvement of provider competencies; the attitudes, knowledge, and skills needed to deliver high-quality care. This paper describes a new instrument designed to measure such a set of competencies. A total of 341 providers of services to clients with SMI at 38 clinics within 5 publicly financed treatment organizations in 2 western states were asked to complete a paper-and-pencil survey including the new Competency Assessment Instrument (CAI: 15 scales, each assessing a particular provider competency), and additional measures used to establish validity (Recovery Attitude Questionnaire—7, Client Optimism Scale). Seventy-nine percent (N =269) responded at baseline, 83% (N =282) responded at 2 weeks. Ninety-seven percent of baseline respondents completed the survey at 2 weeks. Most CAI scales have good internal consistency (Cronbach's αs = .52–.93), test–retest reliability (scales ranged from .42 to .78), and validity, and should be useful in efforts to improve care.
Similar content being viewed by others
References
American Nurses Association. (1997). Position statements: Psychiatric mental health nursing and managed care. Kansas City: Author.
American Psychiatric Association. (1994). Practice guidelines for the treatment of clients with bipolar disorder. American Journal of Psychiatry, 151, S1-S36.
American Psychiatric Association. (1995). Practice guideline for psychiatric evaluation of adults. American Journal of Psychiatry, 152, 63-80.
American Psychiatric Association. (1997). Practice guideline for the treatment of clients with schizophrenia. American Journal of Psychiatry, 154, 1-63.
Amodeo, M., & Fassler, I. (2000). Social workers and substance-abusing clients: caseload composition and competency self-ratings. American Journal of Drug and Alcohol Abuse, 26(4), 629-641.
Blumenthal, D., Gokhale, M., Campbell, E. G., & Weissman, J. S. (2001). Preparedness for clinical practice: Reports of graduating residents at academic health centers. JAMA, 286(9), 1027-1034.
Borkin, J. R., Steffen, J. J., Ensfield, L. B., Krzton, K., Wishnick, H., Wilder, K., et al. (2000). Recovery attitudes questionnaire: Development and evaluation. Psychiatric Rehabilitation Journal, 24(2), 95-102.
Carling, P., & Curtis, L. (1993). Training standards for staff who work with serious mental illnesses in public mental health services. Vermont: Vermont Department of Mental Health and Mental Retardation.
Carraccio, C., & Englander, R. (2000). The objective structured clinical examination: A step in the direction of competency-based evaluation. Archives of Pediatric and Adolescent Medicine, 154(7), 736-741.
Catell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1, 245-276.
The Center for Mental Health Services Managed Care Initiative. (1998). Co-occurring psychiatric and substance disorders in managed care systems: Standards of care, practice guidelines, workforce competencies, and training curricula. Rockville, MD: Author.
Corrigan, P. W., McCracken, S. G., Edwards, M., Kommana, S., & Simpatico, T. (1997). Staff training to improve implementation and impact of behavioral rehabilitation programs. Psychiatric Services, 48(10), 1336-1338.
Coursey, R. D., Curtis, L., Marsh, D. T., Campbell, J., Harding, C., Spaniol, L., et al. (2000a). Competencies for direct service staff who work with adults with severe mental illnesses in outpatient public mental health/managed care services. Psychiatric Rehabilitation Journal, 23(4), 370-377.
Coursey, R. D., Curtis, L., Marsh, D. T., Campbell, J., Harding, C., Spaniol, L., et al. (2000b). Competencies for direct service staff who work with adults with severe mental illnesses: Specific knowledge, attitudes, skills, and bibliography. Psychiatric Rehabilitation Journal, 23(4), 378-392.
Cradock, J., Young, A. S., & Sullivan, G. (2001). The accuracy of medical record documentation in schizophrenia. Journal of Behavioral Health Services and Research, 28(4), 456-465.
Department of Veteran Affairs. (1997). Clinical guideline for management of persons with psychoses (Version 1.0). Washington, DC: Veterans Health Administration.
DeSantis, P., Robison, K., Johnson, D., et al. (1997). The final report of the Blue Ribbon Commission on Mental Health Care. Madison, WI: Governor's Blue Ribbon Commission on Mental Health Care. Retrieved June 8, 2001, from http://www.dhfs.state.wi.us/MH_BCMH/bluerib.htm.
Dixon, L., Lyles, A., Scott, J., Lehman, A., Postrado, L., Goldman, H., et al. (1999). Services to families of adults with schizophrenia: From treatment recommendations to dissemination. Psychiatric Services, 50(2), 233-238.
Drake, R. E., & Becker, D. R. (1996). The individual placement and support model of supported employment. Psychiatric Services, 47(5), 473-475.
Drake, R. E., McHugo, G. J., Bebout, R. R., Becker, D. R., Harris, M., Bond, G. R., et al. (1999). A randomized clinical trial of supported employment for inner-city patients with severe mental disorders. Archives of General Psychiatry, 56(7), 627-633.
Duberman, T. L. (1999). Assessing the critical behavioral competencies of outstanding managed care primary care physicians. Managed Care Interface, 12(3), 76-80.
Egnew, R. C. (1995). California's mental health and educational partnership: A competency based graduate social work curriculum. Salinas, CA: Monterey County Health Department.
Frances, A., Docherty, J. P., & Kahn, D. A., (Eds.). (1996). The Expert Consensus Guideline Series: Treatment of Bipolar Disorder. Journal of Clinical Psychiatry, 57(Suppl. 12A), 3-89.
Galanter, M. (1988). Zealous self-help groups as adjuncts to psychiatric treatment: A study of Recovery, Inc. American Journal of Psychiatry, 145(10), 1248-1253.
Glynn, S. M., Liberman, R. P., & Backer, T. E. (1997). Involving families in mental health services: Competencies for mental health workers. Northridge, CA: Center for Improving Mental Health Systems.
Grusky, O., Tierney, K., & Spanish, M. T. (1989). Which community mental health services are most important? Administration and Policy in Mental Health, 17, 3-16.
International Association of Psychosocial Rehabilitation Services. (1997). Practice guidelines for the psychiatric rehabilitation of persons with severe and persistent mental illness in a managed care environment. Columbia, MD: Author.
Johnson, D. L. (1990). Service needs of the seriously mentally ill: Training implications for psychology. Washington, DC: American Psychological Association.
Jonikas, J. (1993). Staff competencies for service-delivery staff in psychosocial rehabilitation programs. Chicago: Thresholds National Research and Training Center on Rehabilitation and Mental Illness.
Kennedy, M. (1989). Psychiatric rehospitalization of GROWers. Paper presented at the Biennial Conference of the Society for Community Research and Action, East Lansing, MI.
Kissling, W. (1991). Guidelines for neuroleptic relapse prevention in schizophrenia. New York: Springer-Verlag.
Kuehnel, T., Liberman, R., Howard, E., & Backer, T. (1996). Psychiatric rehabilitation competencies for mental health workers. Los Angeles: Human Interaction Research Institute. Unpublished manuscript.
Lauder, W., Reynolds, W., Reilly, V., & Angus, N. (2000). The development and testing of the Mental Health Problems Perception Questionnaire. Journal of Psychiatric and Mental Health Nursing, 7(3), 221-226.
Lehman, A. F. (1995). Vocational rehabilitation in schizophrenia. Schizophrenia Bulletin, 21(4), 645-656.
Lehman, A. F. (1999). Quality of care in mental health: The case of schizophrenia. Health Affairs (Millwood), 18(5), 52-65.
Lehman, A. F., & Steinwachs, D. M. (1998). Translating research into practice: The Schizophrenia Patient Outcomes Research Team (PORT) treatment recommendations. Schizophrenia Bulletin, 24(1), 1-10.
Levine, M., & Perkins, D. V. (1987). Principles of community psychology: Perspectives and applications. New York: Oxford University Press.
Liberman, R. P., Hilty, D. M., Drake, R. E., & Tsang, H. W. (2001). Requirements for multidisciplinary teamwork in psychiatric rehabilitation. Psychiatric Services, 52(10), 1331-1342.
Lu, F., Lim, R., & Mezzich, J. (1995). Issues in the assessment and diagnosis of culturally diverse individuals. In J. Oldham & M. Riba (Eds.), Review of psychiatry (pp. 477-509). Washington, DC: American Psychiatric Press, Inc.
McEvoy, J. P., Scheifler, P. L., Frances, A. (Eds.). (1999). Treatment of schizophrenia 1999. The expert consensus guideline series. Journal of Clinical Psychiatry, 60Suppl. 11, 3-80.
McEvoy, J. P., Weiden, P. J., Smith, T. E., Carpenter, D., Kahn, D. A., & Frances, A. (1996). The Expert Consensus Guideline Series: Treatment of schizophrenia. Journal of Clinical Psychiatry, 57(Suppl. 12B), 5-58.
Meredith, L. S., Rubenstein, L. V., Rost, K., Ford, D. E., Gordon, N., Nutting, P., et al. (1999). Treating depression in staff-model versus network-model managed care organizations. Journal of General Internal Medicine, 14(1), 39-48.
Moos, R., Schaefer, J., Andrassy, J., & Moos, B. (2001). Outpatient mental health care, self-help groups, and patients' one-year treatment outcomes. Journal of Clinical Psychology, 57(3), 273-287.
Muesser, K. T., & Glynn, S. M. (1988). Family intervention for schizophrenia. In K. S. Dobson & K. D. Craig (Eds.), Empirically-supported therapies: Best practices in professional psychology (pp. 157-185). Thousand Oaks, CA: Sage.
Muñoz, R. A. (2000). American Psychiatric Association Practice Guidelines for the treatment of psychiatric disorders: Compendium 2000. Washington, DC: American Psychiatric Association.
Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.
Oxman, A. D., Thomson, M. A., Davis, D. A., & Haynes, R. B. (1995). No magic bullets: A systematic review of 102 trials of interventions to improve professional practice. Canadian Medical Association Journal, 153(10), 1423-1431.
Peabody, J. W., Luck, J., Glassman, P., Dresselhaus, T. R., & Lee, M. (2000). Comparison of vignettes, standardized patients, and chart abstraction: A prospective validation study of 3 methods for measuring quality. JAMA, 283(13), 1715-1722.
Rappaport, J. (1993). Narrative studies, personal stories, and identity transformation in the mutual help context. Journal of Applied Behavioral Science, 29, 239-256.
Rush, A. J., Rago, W. V., Crismon, M. L., Toprac, M. G., Shon, S. P., Suppes, T., et al. (1999). Medication treatment for the severely and persistently mentally ill: The Texas Medication Algorithm Project. Journal of Clinical Psychiatry, 60(5), 284-291.
Sachs, G. S., Printz, D. J., Kahn, D. A., Carpenter, D., Docherty, J. P. (2000). The Expert Consensus Guideline Series: Medication Treatment of Bipolar Disorder 2000. (A Postgraduate Medicine Special Report). New York: McGraw-Hill.
Satish, U., Streufert, S., Marshall, R., Smith, J. S., Powers, S., Gorman, P., et al. (2000). Strategic management simulations is a novel way to measure resident competencies. American Journal of Surgery, 181, 557-561.
Segal, S. P., Silverman, C., & Temkin, T. (1995). Measuring empowerment in client-run self-help agencies. Community Mental Health Journal, 31(3), 215-227.
Taylor, M., Bradley, V., & Warren, R. (1996). The community support skill standards: Tools for managing change and achieving outcomes, skill standards for direct service workers in the human service. Cambridge: Human Services Research Institute.
Torey, C., & Wyzik, P. (1997). New Hampshire clinical practice guidelines for adults in community support programs. Lebanon, NH: West Central Services.
Trochim, W., & Cook, J. (1993). Workforce competencies for psychosocial rehabilitation workers: A concept mapping project (Final report). Columbus: International Association of Psychosocial Rehabilitation Services.
Unutzer, J., Simon, G., Pabiniak, C., Bond, K., & Katon, W. (2000). The use of administrative data to assess quality of care for bipolar disorder in a large staff model HMO. General Hospital Psychiatry, 22(1), 1-10.
Ware, J. E. (1984). Methodological considerations in the selection of health status assessment procedures. In N. K. Wenger, M. E. Mattson, D. C. Furberg, J. Elinson (Eds.), Assessment of quality of life in clinical trials of cardiovascular therapies. New York: Le Jacq Publishing.
Yager, J., Docherty, J. P., & Tischler, G. L. (1997). Preparing psychiatric residents for managed care. Values, proficiencies, curriculum, and implications for psychotherapy training. Journal of Psychotherapy Practice and Research, 6(2), 108-122.
Young, A. S., Forquer, S. L., Tran, A., Starzynski, M., & Shatkin, J. (2000). Identifying clinical competencies that support rehabilitation and empowerment in individuals with severe mental illness. Journal of Behavioral Health Services Research, 27(3), 321-333.
Young, A. S., Grusky, O., Sullivan, G., Webster, C. M., & Podus, D. (1998). The effect of provider characteristics on case management activities. Administration and Policy in Mental Health, 26(1), 21-32.
Young, A. S., Sullivan, G., Burnam, M. A., & Brook, R. H. (1998). Measuring the quality of outpatient treatment for schizophrenia. Archives of General Psychiatry, 55(7), 611-617.
Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99, 432-442.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Chinman, M., Young, A.S., Rowe, M. et al. An Instrument to Assess Competencies of Providers Treating Severe Mental Illness. Ment Health Serv Res 5, 97–108 (2003). https://doi.org/10.1023/A:1023281527952
Issue Date:
DOI: https://doi.org/10.1023/A:1023281527952