Test–Retest Reliability of Self-Reported HIV/STD-Related Measures Among African-American Adolescents in Four U.S. Cities

doi:10.1016/j.jadohealth.2008.09.002

Journal of Adolescent Health

Volume 44, Issue 3, March 2009, Pages 214-221

https://doi.org/10.1016/j.jadohealth.2008.09.002 Get rights and content

Abstract

Purpose

To evaluate the test–retest reliability of self-reported sexuality-related data in a sample of African American adolescents residing in four U.S. cities.

Methods

Using audio computer-assisted self-interviewing (ACASI), 156 African American teens (mean age = 15.5 years) provided data on lifetime and recent sexual behavior, HIV/sexually transmitted disease (STD) testing, and theoretical antecedents of sexual risk behavior on two occasions separated by 2 weeks.

Results

Most self-reports of lifetime sexual behavior and STD/HIV testing were stable across the two assessment points. Test–retest agreement was substantial for dichotomous indices of lifetime sexual behaviors and STD testing (kappas ranging from .61–.87), and for 3-month recall of vaginal sex (kappa = .72) and number of sexual partners (intraclass correlation coefficient [ICC] = .68). Lower reliability estimates emerged for count data of unprotected vaginal sex occasions (ICC = .44). Test–retest reliability estimates for antecedents of sexual risk behavior were highest for a validated measure of HIV-related knowledge (r = .73), but somewhat lower for peer norms (r = .58) and condom use self-efficacy (r = .50).

Conclusions

Although variability in the stability of self-report data was observed, findings confirm that most sexual behavior, STD and HIV testing history, and psychosocial measures can be assessed reliably among adolescents. Research should continue to identify strategies to enhance the reliability of self-report sexual behavior data from youth at risk for HIV and other sexually transmitted infections.

Section snippets

Participants

A total of 187 participants completed the Time 1 (T1) assessment. Of these, 156 (83%) completed the identical Time 2 (T2) assessment. African American adolescents were recruited from two northern cities (Syracuse, NY, and Providence, RI) and two southern cities (Macon, GA, and Columbia, SC). Among participants who completed both questionnaires, 26% (n = 41) were from Syracuse, 23% (n = 36) were from Providence, 25% (n = 39) were from Macon, and 26% (n = 40) were from Columbia. There were more

Dichotomous indices of sexual behavior and STI/HIV testing

As shown in Table 1, moderate to high levels of consistency between the two assessments were observed for dichotomous indices of lifetime sexual behaviors (kappa ranged from .67–.85). Kappa coefficients for self-reports of lifetime engagement in any vaginal sex and for reports of engaging in vaginal sex in the last 3 months were .67 and .72, respectively. Self-reported occasions of vaginal intercourse without a condom (past 3 months) were in the “moderate” range (kappa = .47). Among sexually

Discussion

In this study, we evaluated the test–retest reliability of lifetime and recent sexual behavior data, self-reported HIV and STD testing history, and self-report measures of theoretical antecedents of HIV risk behavior in a sample of African American teens. Based on established benchmarks [38], [39], 85% of the indices reported on in this study showed moderate to excellent levels of agreement between T1 and T2. Similar to earlier studies [14], [15], adolescents in our sample were consistent in

Acknowledgments

We extend thanks and appreciation to all of our community partners, as well as the teen participants in Syracuse, Columbia, Macon, and Providence. We also thank Rebecca Bostwick, Pamela Fleischauer, Cynthia Grossman, Andure Walker, Thierry Fortune, Richard Usher, Ivan Juzang, and the extended study teams at each site for their contributions to this research.

References (46)

N.D. Brener et al.
Assessment of factors affecting the validity of self-reported health-risk behavior among adolescents: evidence from the scientific literature
J Adolesc Health
(2003)
D.M. Siegel et al.
Self-reported honesty among middle and high school students responding to a sexual behavior questionnaire
J Adolesc Health
(1998)
L.A. Palen et al.
Inconsistent reports of sexual intercourse among South African high school students
J Adolesc Health
(2008)
B.C. Leigh et al.
Sexual behavior of American adolescents: results from a U.S. national survey
J Adolesc Health
(1994)
N.D. Brener et al.
Reliability of the 1999 youth risk behavior survey questionnaire
J Adolesc Health
(2002)
J.L. Brown et al.
Alcohol use, partner type, and risky sexual behavior among college students: findings from an event-level study
Addict Behav
(2007)
L.F. O'Sullivan
Challenging assumptions regarding the validity of self-report measures: the special case of sexual behavior
J Adolesc Health
(2008)
K.E. Schroder et al.
methodological challenges in research on sexual risk behavior: II. Accuracy of self-reports
Ann Behav Med
(2003)
J.A. Catania et al.
Methodological problems in AIDS behavioral research: influences on measurement error and participation bias in studies of sexual behavior
Psychol Bull
(1990)
L.S. Weinhardt et al.
Reliability and validity of self-report measures of HIV-related sexual behavior: progress since 1990 and recommendations for research and practice
Arch Sex Behav
(1998)

M.P. Carey et al.

Assessing sexual risk behaviour with the Timeline Followback (TLFB) approach: continued development and psychometric evaluation with psychiatric outpatients

Int J STD AIDS

(2001)

V.E. Stone et al.

Measuring change in sexual behavior: concordance between survey measures

J Sex Res

(1999)

R. Needle et al.

Reliability of self-reported HIV risk behaviors of drug users

Psychol Addict Behav

(1995)

K. McElrath et al.

The consistency of self-reported HIV risk behavior among injection drug users

Am J Public Health

(1994)

D.M. Upchurch et al.

Inconsistencies in reporting the occurence and timing of first intercourse among adolescents

J Sex Res

(2002)

J. Jaccard et al.

A paradigm for studying the accuracy of self-reports of risk behavior relevant to AIDS: empirical perspectives on stability, recall bias, and transitory influences

J Appl Soc Psychol

(1995)

K.D. Hearn et al.

Assessing reliability of early adolescent girls’ reports of romantic and sexual behavior

Arch Sex Behaiv

(2003)

D. Romer et al.

“Talking” computers: a reliable and private method to conduct interviews on sensitive topics with children

J Sex Res

(1997)

R. Sieving et al.

Reliability of self-reported contraceptive use and sexual behaviors among adolescent girls

J Sex Res

(2005)

E.W. Schrimshaw et al.

Test–retest reliability of self-reported sexual behavior, sexual orientation, and psychosexual milestones among gay, lesbian, and bisexual youths

Arch Sex Behav

(2006)

I. Ajzen et al.

Predicting and changing behavior: a reasoned action approach

B.C. Jaworski et al.

Development and psychometric evaluation of a self-administered questionnaire to measure knowledge of sexually transmitted diseases

AIDS Behav

(2007)

M.L. Williams et al.

A comparison of the reliability of self-reported drug use and sexual behaviors using computer-assisted versus face-to-face interviewing

AIDS Educ Prev

(2000)

Cited by (60)

Education level, students’ knowledge and attitude towards STIs in selected secondary schools in Kisoro municipality, Western Uganda
2023, Social Sciences and Humanities Open
Understanding sexually transmitted infections (STIs) is crucial for preventing their spread, especially among secondary school students who, as adolescents, are more vulnerable to STIs. However, the lack of information on secondary students' knowledge of STIs hampers development of health education programmes for secondary schools. The objective of this study was to establish the students’ knowledge about STIs and HIV/AIDS, and their attitudes towards prevention of STIs. Data were collected using a cross-sectional survey design in which respondents filled out a structured questionnaire. The results demonstrate a knowledge gap among Ordinary- and Advanced-level students regarding the types, symptoms, causes, and prevention of STIs. The main conclusion is that education level partially explains the association between knowledge of types of STIs and HIV/AIDS, as well as attitude towards prevention. To reduce disparity in knowledge, continued sensitization of students about STIs and HIV/AIDS is recommended.
Prevalence of Sexually Transmitted Infections and Risk Factors Among Young People in a Public Health Center in Brazil: A Cross-Sectional Study
2020, Journal of Pediatric and Adolescent Gynecology
Citation Excerpt :
Regarding marital status, the majority of young persons were single (77.72%) and had multiple partners (62.96%). Studies show that single teenagers are more inclined to relationships with multiple partners, thereby increasing their chances of acquiring STI/HIV.36 Approximately 86% reported not using or irregularly using condoms.
Sexually transmitted infections (STI) significantly affect the health of sexually active people, especially young people, and can cause low sexual dysfunction, low self-esteem, infertility, increased transmission of HIV, and death.
We reviewed the medical records of a cross-section of users of a public health services center and verified the prevalence of STI and its associated predictors for male and female individuals 13-24 years of age in an interior county of southern Brazil.
The records of 1703 adolescents and young adults, stratified by age (13-18 and 19-24 years, respectively) and sex, admitted between April 1, 2012, and March 31, 2017, were reviewed in this retrospective study. Epidemiological, clinical, and laboratory data of medical records were analyzed using the chi-square test and odds ratio, with confidence interval of 95% by the Stata® 9.0 program. During the study period, a total of 3448 patients were attended to; of these, 1703 (49.39%) were 13-24 years of age, with 86.56% of those 19-24 years having at least 1 STI. The prevalence of STI among men and women, respectively, was 35.40% and 47.67% for condylomata, 8.46% and 7.00% for herpes, 26.35% and 18.80% for syphilis, and 20.06% and 6.27% for urethral discharge syndrome. The risk for STI acquisition was the highest in young adults (odds ratio [OR] 1.55, 95% confidence interval [CI] 1.17-2.06, P = .002), female individuals (OR 1.51, 95% CI 1.14-2.00, P = .004), those with multiple sexual partners (OR 1.62, 95% CI 1.22-2.16, P < .001), and those not using or irregularly using prophylactics (OR 1.62, 95% CI 1.22-2.16, P < .001).
The findings revealed a significant prevalence of STI among young people in public health service. The predictors associated with STI in these patients were being female, having multiple partners in the last year, and not using or irregularly using prophylactics. These predictors confirm the necessity to implement more aggressive strategies to prevent the occurrence of STI in specific populations with higher disease risk, thereby minimizing costs and damage caused by the infections.
Does Initiating Vaginal Sexual Intercourse During a Safer Sex Media Campaign Influence Life Satisfaction Among African American Adolescents?
2020, Journal of Adolescent Health
Citation Excerpt :
Pretest and posttest data were collected at baseline and at 3-, 6-, 12-, and 18-month intervals. Participants were recruited through direct outreach to community-based organizations that provided recreational, social, and education services for African American youth (21%), participant referrals (29%), respondent-driven sampling (15%), and referrals from adult community members (14%), school-based social workers (12%), and street outreach by the study team (9%) [10–13]. Institutional review boards at the respective universities approved all study protocols in the four study sites.
Addressing adolescent sexual risk behaviors in the STI/HIV prevention literature is well documented; however, intervention impacts on life satisfaction are relatively unexplored. This study is a secondary analysis of data (N = 1,658) from a randomized, multisite, multilevel safer sex media campaign (Project iMPPACS) analyzing life satisfaction across baseline and follow-up data collected from 2006 to 2008 among participants (mean age 15.08 years) who reported never having had vaginal sex at baseline (n = 787).
Participants were separated into groups based on whether they reported having vaginal sex (yes/no) at baseline. Then taking into account the nested study design and controlling for confounders, a mixed model repeated measures analysis of variance assessed whether differences in mean total life satisfaction (LS) were associated across time in the media and nonmedia study conditions separately by gender.
A significant interaction between time and media condition was detected (p = .039) where mean total LS increased +.065 units from baseline (M = 5.364) to last contact in media cities and decreased −.084 units from baseline (M = 5.557) to last contact in nonmedia cities when controlling for the effect of initiating vaginal sex. No significant differences in LS at baseline were observed between media and nonmedia intervention cities. Results by gender suggest most positive change in LS was observed for females with mixed findings for males.
Although Project iMPPACS was not designed with the intent on improving participants’ life satisfaction, results advance the LS literature by demonstrating a temporal sequence for sexual risk taking and LS over time.
Emergency Department Directors Are Willing to Expand Reproductive Health Services for Adolescents
2019, Journal of Pediatric and Adolescent Gynecology
Citation Excerpt :
It is possible ED directors were either unaware of these capabilities, or simply have not had the opportunity to use them. This is a relevant issue, because adolescents and adults in the pediatric ED and other settings have indicated they prefer answering questions regarding their sexual history via electronic questionnaire, and in some instances, they provide more comprehensive and accurate information using electronic questionnaires.13,30–37 Thus, the preference expressed by most ED directors we surveyed to gather this kind of sensitive information during face-to-face interviews seems questionable.
Nearly 20 million adolescents receive emergency department (ED) care each year, many of whom have untreated reproductive health issues. ED visits represent an opportunity to provide appropriate care, however, ED physician reproductive health care practices and capabilities in the United States have not been described. We sought to characterize pediatric ED director's individual practice and ED system resources for providing adolescent reproductive health care.
We invited pediatric ED division and/or medical directors nationally to participate in an anonymous, online survey.
Outcomes included ED directors' personal practice regarding providing adolescent patients reproductive health care, and their ED's resources and standard practice regarding screening adolescents for sexually transmitted infections (STIs) and other reproductive health concerns.
One hundred thirty-five of 442 (30.5%) ED directors responded. Respondents were 73% (90/124) male, with a median of 18 (interquartile range, 13-23) years of experience and 63% (84/134) working in urban EDs. Seventy-one percent (90/130) preferred face-to-face interviews for obtaining a sexual history, but only 59% (77/130) of participants “always ask parents to leave the room for sensitive questions.” Eighty-four percent (106/127) were receptive to pregnancy prevention interventions being initiated in the ED, with 75% (80/106) of those willing to provide an intervention. Only 16% (21/128) indicated their ED has a universal STI screening program, and only 18% (23/126) “always” successfully notify patients of a positive STI test.
ED directors are comfortable providing adolescent reproductive health care, and many individual- and ED-level opportunities exist to provide improved reproductive health care for adolescents in the ED.
Prädiktoren für selbstberichtete sexuell übertragbare Infektionen bei türkischen Universitätsstudenten
2023, JDDG - Journal of the German Society of Dermatology
Predictors of self-reported sexually transmitted infections among Turkish university students
2023, JDDG - Journal of the German Society of Dermatology

View all citing articles on Scopus

: This research was supported by a cooperative agreement from the National Institute of Mental Health (Pim Brouwers, Program Officer) to the following sites: Columbia, SC (U01-MH66802; Robert Valois, PI); Macon, GA (U01-MH066807; Ralph DiClemente, PI); Philadelphia, PA (U01-MH066809; Daniel Romer, PI); Providence, RI (U01-MH-066785; Larry Brown, PI); Syracuse, NY (U01-MH-66794; Peter Vanable, PI).

View full text

Original articleTest–Retest Reliability of Self-Reported HIV/STD-Related Measures Among African-American Adolescents in Four U.S. Cities

Abstract

Purpose

Methods

Results

Conclusions

Section snippets

Participants

Dichotomous indices of sexual behavior and STI/HIV testing

Discussion

Acknowledgments

J Adolesc Health

J Adolesc Health

J Adolesc Health

J Adolesc Health

J Adolesc Health

Addict Behav

J Adolesc Health

methodological challenges in research on sexual risk behavior: II. Accuracy of self-reports

Ann Behav Med

Methodological problems in AIDS behavioral research: influences on measurement error and participation bias in studies of sexual behavior

Psychol Bull

Reliability and validity of self-report measures of HIV-related sexual behavior: progress since 1990 and recommendations for research and practice

Arch Sex Behav

Assessing sexual risk behaviour with the Timeline Followback (TLFB) approach: continued development and psychometric evaluation with psychiatric outpatients

Int J STD AIDS

Measuring change in sexual behavior: concordance between survey measures

J Sex Res

Reliability of self-reported HIV risk behaviors of drug users

Psychol Addict Behav

The consistency of self-reported HIV risk behavior among injection drug users

Am J Public Health

Inconsistencies in reporting the occurence and timing of first intercourse among adolescents

J Sex Res

A paradigm for studying the accuracy of self-reports of risk behavior relevant to AIDS: empirical perspectives on stability, recall bias, and transitory influences

J Appl Soc Psychol

Assessing reliability of early adolescent girls’ reports of romantic and sexual behavior

Arch Sex Behaiv

“Talking” computers: a reliable and private method to conduct interviews on sensitive topics with children

J Sex Res

Reliability of self-reported contraceptive use and sexual behaviors among adolescent girls

J Sex Res

Test–retest reliability of self-reported sexual behavior, sexual orientation, and psychosexual milestones among gay, lesbian, and bisexual youths

Arch Sex Behav

Predicting and changing behavior: a reasoned action approach

Development and psychometric evaluation of a self-administered questionnaire to measure knowledge of sexually transmitted diseases

AIDS Behav

A comparison of the reliability of self-reported drug use and sexual behaviors using computer-assisted versus face-to-face interviewing

AIDS Educ Prev

Original article
Test–Retest Reliability of Self-Reported HIV/STD-Related Measures Among African-American Adolescents in Four U.S. Cities