Elsevier

Vaccine

Volume 21, Issues 27–30, 1 October 2003, Pages 4250-4255
Vaccine

Using capture–recapture methods to assess varicella incidence in a community under active surveillance

https://doi.org/10.1016/S0264-410X(03)00458-4Get rights and content

Abstract

The Varicella (chickenpox) Active Surveillance Project (VASP) has been conducting active surveillance since 1 January 1995 in the high desert community known as Antelope Valley, CA (population 300,000) among 300 public and private schools, daycares, and healthcare providers. Capture–recapture methods were applied to estimate reporting completeness for 1995 varicella incidence data and these were compared with the national average incidence rates by age reported by the National Health Interview Survey (NHIS). Varicella cases reported among individuals aged <20 years reflect under-reporting in excess of 50%. Despite limitations on accuracy, capture–recapture estimates are a reasonably accurate, quick, and inexpensive approach in epidemiologic studies.

Introduction

Capture–recapture methods, derived from techniques developed for studies of animal abundance, estimate the true population size by evaluating the degree of overlap among incomplete lists of cases from existing data sources. Capture–recapture involves consideration of three basic assumptions: (1) the population is closed, i.e. no significant changes occur in the population under study during the investigation (e.g. due to migration or death); (2) there is no loss of tags so that individuals can be matched from capture to recapture; and (3) each individual has the same probability of being caught in the second sample so that capture in the first sample does not affect capture in the second sample, i.e. the samples are independent. While assumptions (1) and (2) are often met, failure to meet assumption (3) can lead to inaccurate and sometimes misleading results—since in epidemiological investigations, sources often display dependence and heterogeneity of capture probabilities [1].

This is the first paper to apply capture–recapture to varicella, a common communicable disease that displays seasonality. Capture–recapture methods have been used in the 1980s and 1990s in studies to estimate the completeness and prevalence of many infectious and chronic diseases, including pertussis [2], tetanus [3], sexually transmitted disease [4], AIDS [5], [6], measles [7], [8], meningococcal disease (which is also a highly seasonal infection) [9], [10], HIV-1 [11], and cryptococcosis [12].

The major question individuals have regarding capture–recapture is “Will capture–recapture give you the ‘truth’, i.e. an extremely accurate estimate of the incidence of disease?” Simply answered, no—it will not. The estimates presented in most epidemiologic studies are extremely poor, missing 10–90% of the cases, with a high degree of variation [13], [14], [15], [16]. Therefore, the options are (a) not to use capture–recapture and report varicella cases from which incidence rates are almost uninterruptible, (b) try to count every case of varicella which is horrendously expensive and slow, or (c) utilize capture–recapture which, depending on the degree to which the assumptions are satisfied, can be a compromise, reasonably accurate, quick, and inexpensive approach.

Section snippets

Surveillance methods

The Varicella Active Surveillance Project (VASP) collected case reports of varicella from approximately 300 reporting sites representing nearly 100% sampling of the Antelope Valley population from 1 January 1995 through 31 December 1995. A case of varicella is defined as illness with acute onset of a diffuse papulovesicular rash without other known cause. Reporting sites were comprised of two main ascertainment sources: schools—consisting of all public and private schools and daycare centers

Results

Reporting completeness of varicella cases via active surveillance using two ascertainment sources was 46% with an estimated 4498 (95% CI, 4122–4962) cases in the 1–19 age group (Table 1). The NHIS annual varicella incidence in the US of 53.2 cases per 1000 in this same age group is 4.2% higher than the ascertainment-corrected incidence in the Antelope Valley of 50.9 cases per 1000 (4498/88,379) (Table 2).

Cases among individuals aged 1–19 years were stratified by quarter to evaluate the effects

Discussion

Since the Antelope Valley is a geographically isolated community in which few individuals seek healthcare or attend school outside the region, the study population is effectively closed. Cases reported to active surveillance with addresses outside the surveillance area of Antelope Valley were excluded.

Failure to identify the same individual in both the school and healthcare ascertainment sources will lead to an overestimation of varicella cases based on the assumptions of capture–recapture

Acknowledgements

We wish to thank each of the 300 surveillance sites, including school principals and nurses, as well as physicians and other healthcare professionals in the Antelope Valley community for their faithful and continued reporting of varicella cases to this project. The Varicella Active Surveillance Project under the Los Angeles County Department of Health Services (LACDHS), Acute Communicable Disease Control unit, is supported by a grant provided by the Centers for Disease Control and Prevention

References (24)

  • C.A. McGilchrist et al.

    Loglinear models using capture–recapture methods to estimate the size of a measles epidemic

    J. Clin. Epidemiol.

    (1996)
  • E.B. Hook et al.

    Capture–recapture methods (Letter)

    The Lancet

    (1992)
  • C. Stephen

    Capture–recapture methods in epidemiological studies

    Infect. Control Hosp. Epidemiol.

    (1996)
  • R.W. Sutter et al.

    Pertussis hospitalizations and mortality in the United States, 1985–1988

    JAMA

    (1992)
  • R.W. Sutter et al.

    Assessment of vital statistics and surveillance data for monitoring tetanus mortality, United States, 1979–1984

    Am. J. Epidemiol.

    (1990)
  • G. Rubin et al.

    Using mark-recapture methodology to estimate the size of a population at risk for sexually transmitted diseases

    Stat. Med.

    (1992)
  • S.K. Modesitt et al.

    Evaluation of active versus passive AIDS surveillance in Oregon

    Am. J. Public Health

    (1990)
  • A.M. Hardy et al.

    Review of death certificates to assess completeness of AIDS case reporting

    Public Health Rep.

    (1987)
  • S.F. Davis et al.

    Reporting efficiency during a measles outbreak in New York City, 1991

    Am. J. Public Health

    (1993)
  • B. Hubert et al.

    Evaluation of the exhaustivness and representativeness of a surveillance system using the capture–recapture method: application of the surveillance of meningococcal infections in France in 1989 and 1990

    Rev. Epidmiol. Sante Publique

    (1993)
  • D.M. Ackman et al.

    Assessment of surveillance for meningococcal disease in New York State, 1991

    AJE

    (1996)
  • D.D. Abeni et al.

    Capture–recapture to estimate the size of the population with human immunodeficiency virus type 1 infection

    Epidemiology

    (1994)
  • Cited by (11)

    • Review of the United States universal varicella vaccination program: Herpes zoster incidence rates, cost-effectiveness, and vaccine efficacy based primarily on the Antelope Valley Varicella Active Surveillance Project data

      2013, Vaccine
      Citation Excerpt :

      Goldman secured the services of a knowledgeable attorney, who, after reviewing the facts, advised the Los Angeles County's legal counsel: “(a) if your client persists in its efforts to restrain his findings, (b) if his findings enhance the public health, safety, and welfare, (c) if by seeking to restrain him from imparting valuable information concerning the lack of safety and effectiveness of the pharmaceutical being reported upon, and (d) if the County of Los Angeles has in any way been enriched by its participation in any study the results of which it seeks to restrain in this manner or any other manner whatsoever,” then there would be follow-up litigation under both the State and Federal False Claims Acts. The county dropped its opposition and the manuscripts were peer-reviewed and accepted for publication as three consecutive articles in the journal Vaccine in October 2003 [3,31,32]. In 2004, AV-VASP and CDC took issue with Goldman's presentation of HZ data and authored a criticism [33] of the three studies published in Vaccine by Goldman.

    View all citing articles on Scopus
    View full text