Abstract
Universal community-oriented interventions are an important component in the prevention of youth health and behavior problems. Testing the universality of the effects of an intervention that was designed to be universal is important because it provides information about how the program operates and for whom and under what conditions it is most effective. The present study examined whether the previously established significant effects of the universal, community-based Communities That Care (CTC) prevention program on the prevalence of substance use and the variety of delinquent behaviors held equally for boys and girls and in risk-related subgroups defined by early substance use, early delinquency, and high levels of community-targeted risk at baseline. Interaction analyses of data from a panel of 4,407 students followed from Grade 5 to Grade 8 in the first randomized trial of CTC in 12 matched community pairs suggests that CTC reduced students’ substance use and delinquency equally across risk-related subgroups and gender, with two exceptions: The effect of CTC on reducing substance use in 8th grade was stronger for boys than girls and the impact of CTC on reducing 8th-grade delinquency was stronger for students who were nondelinquent at baseline.
Similar content being viewed by others
References
Allen, J. P., & Philliber, S. (2001). Who benefits most from a broadly targeted prevention program? Differential efficacy across populations in the Teen Outreach program. Journal of Community Psychology, 29, 637–655.
Amaro, H., Blake, S. M., Schwartz, P. M., & Flinchbaugh, L. J. (2001). Developing theory-based substance abuse prevention programs for young adolescent girls. Journal of Early Adolescence, 21, 256–293.
Arthur, M. W., Hawkins, J. D., Pollard, J. A., Catalano, R. F., & Baglioni, A. J., Jr. (2002). Measuring risk and protective factors for substance use, delinquency, and other adolescent problem behaviors: The Communities That Care Youth Survey. Evaluation Review, 26, 575–601.
Arthur, M. W., Glaser, R. R., & Hawkins, J. D. (2005). Steps towards community-level resilience: Community adoption of science-based prevention programming. In R. D. Peters, B. Leadbeater, & R. J. McMahon (Eds.), Resilience in children, families, and communities: Linking context to practice and policy (pp. 177–194). New York: Kluwer Academic/Plenum Publishers.
Beach, S. R. H., Brody, G. H., Kogan, S. M., Philibert, R. A., Chen, Y. F., & Lei, M. K. (2009). Change in caregiver depression in response to parent training: Genetic moderation of intervention effects. Journal of Family Psychology, 23, 112–117.
Blake, S. M., Amaro, H., Schwartz, P. M., & Flinchbaugh, L. J. (2001). A review of substance abuse prevention interventions for young adolescent girls. Journal of Early Adolescence, 21, 294–324.
Botvin, G., Mihalic, S., & Grotpeter, J. K. (Eds.). (1998). Life skills training, vol. 5. Boulder, CO: Center for the Study and Prevention of Violence, Institute of Behavioral Science, University of Colorado.
Breslow, N., & Clayton, D. G. (1993). Approximate inference in generalized linear mixed models. Journal of the American Statistical Association, 88, 9–25.
Brody, G. H., Kogan, S. M., Chen, Y. F., & Murry, V. M. (2008). Long-term effects of the Strong African American Families Program on youths’ conduct problems. Journal of Adolescent Health, 43, 474–481.
Brown, E. C., Hawkins, J. D., Arthur, M. W., Briney, J. S., & Abbott, R. D. (2007). Effects of Communities That Care on prevention services systems: Outcomes from the Community Youth Development Study at 1.5 years. Prevention Science, 8, 180–191.
Brown, C. H., Wang, W., Kellam, S. G., Muthen, B. O., Petras, H., Toyinbo, P., et al. (2008). Methods for testing theory and evaluating impact in randomized field trials: Intent-to-treat analyses for integrating the perspectives of person, place, and time. Drug and Alcohol Dependence, 95, S74–S104.
Brown, E. C., Graham, J. W., Hawkins, J. D., Arthur, M. W., Baldwin, M. M., Oesterle, S., et al. (2009). Design and analysis of the Community Youth Development Study longitudinal cohort sample. Evaluation Review, 33, 311–334.
Chesney-Lind, M. (1997). The female offender: Girls, women and crime. Thousand Oaks, CA: Sage.
Chou, C. P., Montgomery, S., Pentz, M. A., Rohrbach, L. A., Johnson, C. A., Flay, B. R., et al. (1998). Effects of a community-based prevention program in decreasing drug use in high-risk adolescents. American Journal of Public Health, 88, 944–948.
Collins, L. M., Schafer, J. L., & Kam, C. M. (2001). A comparison of inclusive and restrictive strategies in modern missing data procedures. Psychological Methods, 6, 330–351.
Conduct Problems Prevention Research Group (2007). Fast track randomized controlled trial to prevent externalizing psychiatric disorders: Findings from grades 3 to 9. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 1250–1262.
Dawson-McClure, S. R., Sandler, I. N., Wolchik, S. A., & Millsap, R. E. (2004). Risk as a moderator of the effects of prevention programs for children from divorced families: A six-year longitudinal study. Journal of Abnormal Child Psychology, 32, 175–190.
Eisen, M., Zellman, G. L., Massett, H. A., & Murray, D. M. (2002). Evaluating the Lions-Quest “Skills for Adolescence” drug education program: First-year behavior outcomes. Addictive Behaviors, 27, 619–632.
Ellickson, P. L., & Bell, R. M. (1990). Drug prevention in junior high: A multi-site longitudinal test. Science, 247, 1299–1305.
Elliott, D. S., & Mihalic, S. (2004). Issues in disseminating and replicating effective prevention programs. Prevention Science, 5, 47–53.
Fagan, A. A., Van Horn, M. L., Hawkins, J. D., & Arthur, M. W. (2007). Gender similarities and differences in the association between risk and protective factors and self-reported serious delinquency. Prevention Science, 8, 115–124.
Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W. (2008a). Bridging science to practice: Achieving prevention program implementation fidelity in the Community Youth Development Study. American Journal of Community Psychology, 41, 235–249.
Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W. (2008b). Implementing effective community-based prevention programs in the Community Youth Development Study. Youth Violence and Juvenile Justice, 6, 256–278.
Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W. (2009). Translational research in action: Implementation of the Communities That Care prevention system in 12 communities. Journal of Community Psychology, 37, 809–829.
Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., et al. (2005). Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science, 6, 151–175.
Foley, A. (2008). The current state of gender-specific delinquency programming. Journal of Criminal Justice, 36, 262–269.
Gardner, F., Connell, A., Trentacosta, C. J., Shaw, D. S., Dishion, T. J., & Wilson, M. N. (2009). Moderators of outcome in a brief family-centered intervention for preventing early problem behavior. Journal of Consulting and Clinical Psychology, 77, 543–553.
Glaser, R. R., Van Horn, M. L., Arthur, M. W., Hawkins, J. D., & Catalano, R. F. (2005). Measurement properties of the Communities That Care Youth Survey across demographic groups. Journal of Quantitative Criminology, 21, 73–102.
Gottfredson, D. C., & Wilson, D. B. (2003). Characteristics of effective school-based substance abuse prevention. Prevention Science, 4, 27–38.
Graham, J. W., Taylor, B. J., Olchowski, A. E., & Cumsille, P. E. (2006). Planned missing data designs in psychological research. Psychological Methods, 11, 323–343.
Guyll, M., Spoth, R. L., Chao, W., Wickrama, K. A. S., & Russell, D. (2004). Family-focused preventive interventions: Evaluating parental risk moderation of substance use trajectories. Journal of Family Psychology, 18, 293–301.
Hawkins, J. D., Brown, E. C., Oesterle, S., Arthur, M. W., Abbott, R. D., & Catalano, R. F. (2008). Early effects of Communities That Care on targeted risks and initiation of delinquent behavior and substance use. Journal of Adolescent Health, 43, 15–22.
Hawkins, J. D., & Catalano, R. F. (2002). Investing in your community’s youth: An introduction to the Communities That Care system. South Deerfield, MA: Channing Bete.
Hawkins, J. D., Catalano, R. F., & Arthur, M. W. (2002). Promoting science-based prevention in communities. Addictive Behaviors, 27, 951–976.
Hawkins, J. D., Catalano, R. F., Arthur, M. W., Egan, E., Brown, E. C., Abbott, R. D., et al. (2008). Testing Communities That Care: The rationale, design and behavioral baseline equivalence of the Community Youth Development Study. Prevention Science, 9, 178–190.
Hawkins, J. D., Oesterle, S., Brown, E. C., Arthur, M. W., Abbott, R. D., Fagan, A. A., et al. (2009). Results of a type 2 translational research trial to prevent adolescent drug use and delinquency: A test of Communities That Care. Archives of Pediatrics & Adolescent Medicine, 163, 789–798.
Kellam, S. G., Brown, C. H., Poduska, J. M., Ialongo, N. S., Wang, W., Toyinbo, P., et al. (2008). Effects of a universal classroom behavior management program in first and second grades on young adult behavioral, psychiatric, and social outcomes. Drug and Alcohol Dependence, 95, S5–S28.
Kellam, S. G., Ling, X., Merisca, R., Brown, C. H., & Ialongo, N. (1998). The effect of the level of aggression in the first grade classroom on the course and malleability of aggressive behavior into middle school. Development and Psychopathology, 10, 165–185.
Khoo, S. T. (2001). Assessing program effects in the presence of treatment-baseline interactions: A latent curve approach. Psychological Methods, 6, 234–257.
Komro, K. A., Perry, C. L., Veblen-Mortenson, S., Farbakhsh, K., Toomey, T. L., Stigler, M. H., et al. (2008). Outcomes from a randomized controlled trial of a multi-component alcohol use preventive intervention for urban youth: Project Northland Chicago. Addiction, 103, 606–618.
Kraemer, H. C., Wilson, G. T., Fairburn, C. G., & Agras, W. S. (2002). Mediators and moderators of treatment effects in randomized clinical trials. Archives of General Psychiatry, 59, 877–883.
Kulis, S., Nieri, T., Yabiku, S., Stromwall, L. K., & Marsiglia, F. F. (2007). Promoting reduced and discontinued substance use among adolescent substance users: Effectiveness of a universal prevention program. Prevention Science, 8, 35–49.
Kulis, S., Yabiku, S. T., Marsiglia, F. F., Nieri, T., & Crossman, A. (2007). Differences by gender, ethnicity, and acculturation in the efficacy of the Keepin’ It Real model prevention program. Journal of Drug Education, 37, 123–144.
Kumpfer, K. L., Smith, P., & Summerhays, J. F. (2008). A wakeup call to the prevention field: Are prevention programs for substance use effective for girls? Substance Use & Misuse, 43, 978–1001.
Leon, A. C., & Heo, M. (2009). Sample sizes required to detect interactions between two binary fixed-effects in a mixed-effects linear regression model. Computational Statistics & Data Analysis, 53, 603–608.
Liang, K. Y., & Zeger, S. L. (1986). Longitudinal data analysis using generalized linear models. Biometrika, 73, 13–22.
Longshore, D., Ellickson, P. L., McCaffrey, D. F., & St. Clair, P. A. (2007). School-based drug prevention among at-risk adolescents: Effects of ALERT plus. Health Education & Behavior, 34, 651–668.
Mason, W. A., Kosterman, R., Haggerty, K. P., Hawkins, J. D., Redmond, C., Spoth, R. L., et al. (2009). Gender moderation and social developmental mediation of the effect of a family-focused substance use preventive intervention on young adult alcohol abuse. Addictive Behaviors, 34, 599–605.
Matthews, J. N. S., & Altman, D. G. (1996). Statistics notes: Interaction 2: Compare effect sizes not p values. British Medical Journal, 313, 808.
Murray, D. M. (1998). Design and analysis of group-randomized trials. New York: Oxford University Press.
Nelson, D. E., Mowery, P., Tomar, S., Marcus, S., Giovino, G., & Zhao, L. (2006). Trends in smokeless tobacco use among adults and adolescents in the United States. American Journal of Public Health, 96, 897–905.
Olds, D. L., Eckenrode, J., Henderson, C. R., Jr., Kitzman, H., Powers, J., Cole, R., et al. (1997). Long-term effects of home visitation on maternal life course and child abuse and neglect. Fifteen-year follow-up of a randomized trial. Journal of the American Medical Association, 278, 637–643.
Pentz, M. A., Dwyer, J. H., MacKinnon, D. P., Flay, B. R., Hansen, W. B., Wang, E. Y. I., et al. (1989). A multi-community trial for primary prevention of adolescent drug abuse: Effects on drug use prevalence. Journal of the American Medical Association, 261, 3259–3266.
Pentz, M. A., Jasuja, G. K., Rohrbach, L. A., Sussman, S., & Bardo, M. T. (2006). Translation in tobacco and drug abuse prevention research. Evaluation & the Health Professions, 29, 246–271.
Perry, C. L., Williams, C. L., Komro, K. A., Veblen-Mortenson, S., Stigler, M. H., Munson, K. A., et al. (2002). Project Northland: Long-term outcomes of community action to reduce adolescent alcohol use. Health Education Research, 17, 117–132.
Perry, C. L., Williams, C. L., Veblen Mortenson, S., Toomey, T. L., Komro, K. A., Anstine, P. S., et al. (1996). Project Northland: Outcomes of a community-wide alcohol use prevention program during early adolescence. American Journal of Public Health, 86, 956–965.
Quinby, R. K., Fagan, A. A., Hanson, K., Brooke-Weiss, B., Arthur, M. W., & Hawkins, J. D. (2008). Installing the Communities That Care prevention system: Implementation progress and fidelity in a randomized controlled trial. Journal of Community Psychology, 36, 313–332.
Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Newbury Park, CA: Sage.
Raudenbush, S. W., Bryk, A. S., Cheong, Y. F., & Congdon, R. T., Jr. (2004). HLM 6: Hierarchical linear and nonlinear modeling. Lincolnwood, IL: Scientific Software International, Inc.
Rogers, E. (1995). Diffusion of innovations (4th ed.). New York: Free Press.
Rohrbach, L. A., Grana, R., Sussman, S., & Valente, T. W. (2006). Type II translation: Transporting prevention interventions from research to real-world settings. Evaluation & The Health Professions, 29, 302–333.
Rubin, D. B. (1987). Multiple imputation for nonresponse in surveys. New York: Wiley.
Schafer, J. L. (2000). NORM for Windows 95/98/NT (Version 2.03). University Park: Center for the Study and Prevention through Innovative Methodology at Pennsylvania State University.
Schafer, J. L., & Graham, J. W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147–177.
Sloboda, Z., Stephens, R. C., Stephens, P. C., Grey, S. F., Teasdale, B., Hawthorne, R. D., et al. (2009). The Adolescent Substance Abuse Prevention Study: A randomized field trial of a universal substance abuse prevention program. Drug and Alcohol Dependence, 102, 1–10.
Snyder, H. N. (2008). Juvenile arrests 2006. Retrieved October 5, 2009, 2009, from http://www.ncjrs.gov/pdffiles1/ojjdp/221338.pdf.
Social Development Research Group. (2005–2007). Community Youth Development Study, Youth Development Survey [Grades 5–7]. Seattle: Social Development Research Group, School of Social Work, University of Washington.
Spoth, R., Shin, C., Guyll, M., Redmond, C., & Azevedo, K. (2006). Universality of effects: An examination of the comparability of long-term family intervention effects on substance use across risk-related subgroups. Prevention Science, 7, 209–224.
Spoth, R., Redmond, C., Shin, C., Greenberg, M., Clair, S., & Feinberg, M. (2007). Substance use outcomes at 18 months past baseline: The PROSPER community-university partnership trial. American Journal of Preventive Medicine, 32, 395–402.
Steffensmeier, D., Schwartz, J., Zhong, H., & Ackerman, J. (2005). An assessment of recent trends in girls’ violence using diverse longitudinal sources: Is the gender gap closing? Criminology, 43, 355–405.
Stoolmiller, M., Eddy, J., & Reid, J. B. (2000). Detecting and describing preventive intervention effects in a universal school-based randomized trial targeting delinquent and violent behavior. Journal of Consulting and Clinical Psychology, 68, 296–306.
Substance Abuse and Mental Health Services Administration. (2005). Communities That Care prevention strategies guide. Retrieved March 7, 2006, from http://ncadi.samhsa.gov/features/ctc/resources.aspx.
Tolan, P., Gorman-Smith, D., & Henry, D. (2004). Supporting families in a high-risk setting: Proximal effects of the SAFEChildren preventive intervention. Journal of Consulting and Clinical Psychology, 72, 855–869.
Van Horn, M. L., Fagan, A. A., Jaki, T., Brown, E. C., Hawkins, J. D., Arthur, M. W., et al. (2008). Using multilevel mixtures to evaluate intervention effects in group randomized trials. Multivariate Behavioral Research, 43, 289–326.
Wagenaar, A. C., Gehan, J. P., Jones-Webb, R., Toomey, T. L., Forster, J. L., Wolfson, M., et al. (1999). Communities Mobilizing for Change on Alcohol: Lessons and results from a 15-community randomized trial. Journal of Community Psychology, 27, 315–326.
Woolf, S. H. (2008). The meaning of translational research and why it matters. Journal of American Medical Association, 299, 211–213.
Yin, R. K., & Ware, A. J. (2000). Using outcome data to evaluate community drug prevention initiatives: Pushing the state-of-the-art. Journal of Community Psychology, 28, 323–338.
Zahn, M. A., Hawkins, S. R., Chiancone, J., & Whitworth, A. (2008). Girls study group: Charting the way to delinquency prevention for girls. Retrieved October 5, 2009, 2009, from http://www.ncjrs.gov/pdffiles1/ojjdp/223434.pdf.
Acknowledgments
This work was supported by a research grant from the National Institute on Drug Abuse (R01 DA015183-03) with co-funding from the National Cancer Institute, the National Institute of Child Health and Human Development, the National Institute of Mental Health, and the Center for Substance Abuse Prevention. The authors wish to acknowledge the contributions of the communities participating in the Community Youth Development Study and the collaborating state offices of drug abuse prevention in Colorado, Illinois, Kansas, Maine, Oregon, Utah, and Washington. The authors would like to thank Dr. David M. Murray for his consultation on the power analyses.
Richard F. Catalano is a board member of Channing Bete Company, distributor of Supporting School Success ® and Guiding Good Choices ®. These programs were used in some communities in the study that produced the data set used in this paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
An erratum to this article can be found at http://dx.doi.org/10.1007/s11121-010-0183-4
Rights and permissions
About this article
Cite this article
Oesterle, S., Hawkins, J.D., Fagan, A.A. et al. Testing the Universality of the Effects of the Communities That Care Prevention System for Preventing Adolescent Drug Use and Delinquency. Prev Sci 11, 411–423 (2010). https://doi.org/10.1007/s11121-010-0178-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11121-010-0178-1