Abstract
This study examines factors associated with the implementation and short-term outcomes in dissemination sites of Multisystemic Therapy (MST), an intensive, short-term, family- and community-based treatment for serious antisocial behavior in youth. Participants were 666 children and families served by 217 therapists in 39 sites. Pre- (T1) to immediate posttreatment (T2) differences in child problems and functioning were similar in magnitude to those found in randomized trials of MST. Results of random effects regression supported direct effects of therapist adherence, organizational climate, and structure at baseline on immediate posttreatment child outcomes. However, organizational factors were unrelated to adherence; thus, a hypothesized mediation model in which organizational climate and structure affect outcomes through therapist adherence to MST was not supported. Furthermore, the direction of associations between some organizational climate variables and outcomes countered expectations. Post hoc moderation analyses clarify these findings, with organizational effects differing by level of therapist adherence during treatment. Implications for the transfer of evidence-based psychosocial treatments for youth to usual care practice settings are discussed.
Article PDF
Similar content being viewed by others
REFERENCES
Achenbach T. M. (1991). Integrative guide for the 1991 CBCL/4-18, YSR, and TRF profiles. Burlington: University of Vermont, Department of Psychiatry.
American College of Mental Health Administration. (1997). Final Report, The Santa Fe Summit on behavioral health: Preserving quality and value in the managed care equation. Pittsburgh, PA: Author.
Baron, R. M., & Kenny, D. A. (1986). The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51, 1173-1182.
Bickman, L. (1999). Practice makes perfect and other myths about mental health services. American Psychologist, 54, 965-987.
Bickman, L., Lambert, E. W., Karver, M., & Andrade, A. R. (1998). Two low-cost measures of child and adolescent functioning for services research. Evaluation and Programming Planning, 21, 263-275.
Bronfenbrenner, U. (1979). The ecology of human development: Experiments by nature and design. Cambridge, MA: Harvard University Press.
Brown, B. S. (1995). Reducing impediments to technology transfer in drug abuse programming. In T. E. Backer, S. L. David, & G. Soucy (Eds.), Reviewing the behavioral science knowledge base on technology transfer (NIDA Research Monograph 155, NIH Publication No. 95–4035) (pp. 169-185). Rockville, MD: National Institute on Drug Abuse.
Brown, B. S. (2000). From research to practice: The bridge is out and the water's rising. In J. A. Levy, R. C. Stephens, & D. C. McBride (Eds.), Emerging issues in the field of drug abuse. Advances in Medical Sociology (Vol. 7, pp. 345-365). Stamford, CT: JAI Press.
Burns, B. J. (1999). A call for a mental health services research agenda for youth with serious emotional disturbance. Mental Health Services Research, 1, 5-20.
Burns, B. J., Hoagwood, K., & Mrazek, P. J. (1999). Effective treatment for mental disorders in children and adolescents. Clinical Child and Family Psychology Review, 2, 199-254.
Gibbons, R. D., & Bock, R. D. (1987). Trend in correlated proportions. Psychometrika, 52, 113-124.
Glisson, C. (1992). Structure and technology in human service organizations. In Y. Hasenfeld (Ed.), Human services as complex organizations (pp. 184-202). Newbury Park, CA: Sage.
Glisson, C. (2000). Organizational culture and climate. In R. Patti (Ed.), The handbook of social welfare management (pp. 195-217). Thousand Oaks, CA: Sage Publications.
Glisson, C., & Hemmelgarn, A. L. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children's service systems. Child Abuse and Neglect, 22(5, 401-421.
Goldstein, H. (1995). Multilevel statistical models (2nd ed.). New York: Halstead Press.
Hage, J., & Aiken, M. (1967). Relationship of centralization to other structural properties. Administrative Science Quarterly, 12, 73-92.
Hall, R. H. (1963). The concept of bureaucracy: An empirical assessment. American Journal of Sociology, 69, 32-40.
Halliday-Boykins, C. A., & Henggeler, S. W. (2001). Multisystemic therapy: Theory, research and practice. In E. Walton, P. A. Sandau-Beckler, & M. Mannes (Eds.), Balancing family-centered services and child well-being (pp. 320-335). New York: Columbia University Press.
Hemmelgarn, A. L., Glisson, C., & Dukes, D. (2001). Emergency room culture and the emotional support component of Family-Centered Care. Children's Health Care, 30, 93-110.
Henggeler, S. W., & Borduin, C. M. (1992). Multisystemic Therapy Adherence Scales. Unpublished instrument, Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina.
Henggeler, S. W., Melton, G. B., Brondino, M. J., Scherer, D. G., & Hanley, J. H. (1997). Multisystemic therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination. Journal of Consulting and Clinical Psychology, 65, 821-833.
Henggeler, S. W., Melton, G. B., & Smith, L. A. (1992). Family preservation using multisystemic therapy: An effective alternative to incarcerating serious juvenile offenders. Journal of Consulting and Clinical Psychology, 60, 953-961.
Henggeler, S. W., Pickrel, S. G., & Brondino, M. J. (1999). Multisystemic treatment of substance abusing and dependent delinquents: Outcomes, treatment fidelity, and transportability. Mental Health Services Research, 1, 171-184.
Henggeler, S. W., Rowland, M. R., Randall, J., Ward, D., Pickrel, S. G., Cunningham, P. B., et al. (1999). Home-based multisystemic therapy as an alternative to the hospitalization of youth in psychiatric crisis: Clinical outcomes. Journal of the American Academy of Child and Adolescent Psychiatry, 38, 1331-1339.
Henggeler, S. W., & Schoenwald, S. K. (1998). The MST supervisory manual: Promoting quality assurance at the clinical level. Charleston, SC: MST Services, Inc.
Henggeler, S. W., & Schoenwald, S. K. (1999). The role of quality assurance in achieving outcomes in MST programs. Journal of Juvenile Justice and Detention Services, 14, 1-17.
Henggeler, S. W., Schoenwald, S. K., Borduin, C. M., Rowland, M. D., & Cunningham, P. B. (1998), Multisystemic treatment of antisocial behavior in children and adolescents. New York and London: Guilford Press.
Henggeler, S. W., Schoenwald, S. K., Liao, J. G., Letourneau, E. J., & Edwards, D. L. (2002). Transporting efficacious treatments to field settings: The link between supervisory practices and therapist fidelity in MST programs. Journal of Clinical Child Psychology, 31, 155-167.
Henggeler, S. W., Schoenwald, S. K., & Munger, R. L. (1996). Families and therapists achieve clinical outcomes, systems of care mediate the process. Journal of Child and Family Studies, 5, 177-183.
Henggeler, S. W., Schoenwald, S. K., Rowland, M. D., & Cunningham, P. B. (2002). Serious emotional disturbance in children and adolescents: Multisystemic therapy. New York: Guilford Press.
Hoagwood, K., Burns, B. J., Kiser, L., Ringeisen, H., & Schoenwald, S. (2001). Evidence-based practice in child and adolescent mental health services. Psychiatric Services, 52, 1179-1189.
Hoagwood, K., Burns, B. J., & Weisz, J. (2002). A profitable conjunction: From science to service in children's mental health. In B. J. Burns & K. Hoagwood (Eds.), Community-based interventions for youth with severe emotional disturbances (pp. 327-338). New York: Oxford University Press.
Hoagwood, K., Hibbs, E., Brent, D., & Jensen, P. (1995). Introduction to the special section: Efficacy and effectiveness studies of child and adolescent psychotherapy. Journal of Consulting and Clinical Psychology, 63, 683-687.
Hofmann, D. A., & Gavin, M. B. (1998). Centering decisions in hierarchical linear models: Implications for research in organizations. Journal of Management, 24, 623-641.
Hohmann, A. A., & Shear, M. K. (2002). Community-based intervention research: Coping with the noise in real life in study design. American Journal of Psychiatry, 159, 201-207.
Holmbeck, G. N. (1997). Toward terminological, conceptual, and statistical clarity in the study of mediators: Examples from the child-clinical and pediatric psychology literatures. Journal of Consulting and Clinical Psychology, 65, 599-610.
Huey, S. J., Henggeler, S. W., Brondino, M. J., & Pickrel, S. G. (2000). Mechanisms of change in multisystemic therapy: Reducing delinquent behavior through therapist adherence and improved family and peer functioning. Journal of Consulting and Clinical Psychology, 68, 451-467.
James, L.R., & Sells, S.B. (1981). Psychological climate: Theoretical perspectives and empirical research. In D. Magnussen (Ed.), The situation: An interactional perspective (pp. 275-295). Hillsdale, NJ: Erlbaum.
Laird, N. M., & Ware, J. H. (1982). Random-effects models for longitudinal data. Biometrics, 38, 963-974.
Letourneau, E. J., Sheidow, A. J., & Schoenwald, S. K. (2002). Structure and reliability of the MST therapist adherence scale in a large community sample. Charleston: Family Services Research Center, Medical University of South Carolina.
Loeber, R., & Farrington, D. P. (1998). Serious and violent juvenile offenders: Risk factors and successful interventions. Thousand Oaks, CA: Sage.
Raudenbush, S. W., & Bryk A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
Rogers, E. M. (1995). Diffusion of Innovations (4th ed.). New York: The Free Press.
Rosenheck, R. A. (2001). Organizational process: A missing link between research and practice. Psychiatric Services, 52, 1607-1612.
SAS Institute (2000). SAS/STAT User's Guide, Version 8. Cary, NC: SAS Institute Inc.
Schoenwald, S. K. (1998). Multisystemic therapy consultation guidelines. Charleston, SC: MST Institute.
Schoenwald, S. K., Halliday-Boykins, C., & Henggeler, S. W. (2003). Client-level predictors of adherence to MST in community service settings. Family Process, 42, 345-359.
Schoenwald, S. K., & Henggeler, S. W. (2002). Services research and family based treatment. In H. A. Liddle, D. A. Santisteban, R. F. Levant, & J. H. Bray (Eds.), Family psychology: Science-based interventions (pp. 259-282). Washington, DC: American Psychological Association.
Schoenwald, S. K., Henggeler, S. W., Brondino, M. J., & Rowland, M. D. (2000). Multisystemic therapy: Monitoring treatment fidelity. Family Process, 39, 83-103.
Schoenwald, S. K., & Hoagwood, K. (2001). Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services, 52, 1190-1197.
Schoenwald, S. K., Letourneau, E. J., & Halliday-Boykins, C. A. (2003). Therapist and client predictors of adherence to MST in community service settings. Manuscript in preparation.
Scott, W. R. (1990). Technology and structure: An organizational level perspective. In P. S. Goodman & L. S. Sproull (Eds.), Technology and organizations. San Francisco: Jossey-Bass.
Shaw, B. F., Olmsted, M., Dobson, K. S., Sotsky, S. M., Elkin, I., Yamaguchi, J., et al. (1999). Therapist competence ratings in relation to clinical outcome in cognitive therapy of depression. Journal of Consulting and Clinical Psychology, 67, 837-846.
Sheidow, A. J., Schoenwald, S. K., & Liao, J. G. (2002). Adaptation of organizational climate and structure scales for use with child and family therapy providers. Charleston: Family Services Research Center, Medical University of South Carolina.
Simpson, D. D. (2002). A conceptual framework for transferring research to practice. Journal of Substance Abuse Treatment, 4, 171-182.
Snijders, T. A. B., & Bosker, R. J. (1994). Modeled variance in two-level models. Sociological Methods and Research, 22, 342-344.
Stiratelli, R., Laird, N. M., & Ware, J. H. (1984). Random-effects models for serial observations with binary response. Biometrics, 40, 961-971.
U.S. Public Health Service. (2000). Report of the Surgeon General's Conference on Children's Mental Health: A national action agenda. Washington, DC: Author.
Weisz, J. R. (2000). Agenda for child and adolescent psychotherapy research: On the need to put science into practice. Archives of General Psychiatry, 57, 837-838.
Weisz, J. R., Donenberg, G. R., Han, S. S., & Weiss, B. (1995). Bridging the gap between laboratory and clinic in child and adolescent psychotherapy. Journal of Consulting and Clinical Psychology, 63, 688-701.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Schoenwald, S.K., Sheidow, A.J., Letourneau, E.J. et al. Transportability of Multisystemic Therapy: Evidence for Multilevel Influences. Ment Health Serv Res 5, 223–239 (2003). https://doi.org/10.1023/A:1026229102151
Issue Date:
DOI: https://doi.org/10.1023/A:1026229102151