Articles
Systematic reviews of acupuncture — are there problems with these?

https://doi.org/10.1054/caom.2001.0073Get rights and content

Abstract

In recent years, many systematic reviews of the clinical efficacy of acupuncture have been conducted. Almost every review found major problems with the quality of the clinical trials, making it difficult to draw clear conclusions about efficacy. The present paper explores a number of important issues involved in the design and conduct of systematic reviews of acupuncture. Examples are pointed out of mistakes in inclusion-exclusion criteria and problems with judgements about adequacy of test treatment in some reviews. More importantly, problems are identified with the criteria by which study quality is scored, especially with the Jadad summary scale, that appear to bias against finding acupuncture to be effective. Examples are also identified where the conclusions of systematic reviews appear to have been misstated by others summarizing findings of those reviews, thereby undermining the conclusions of those broader reviews. These findings suggest that the methodologies of systematic reviews of acupuncture need to be improved and that many systematic reviews need to be redone using improved methods.

References (51)

  • D. Melchart et al.

    Acupuncture for recurrent headaches: a systematic review of randomized controlled trials

    Cephalalgia

    (1999)
  • E. Ernst et al.

    Acupuncture as a treatment for temporomandibular joint dysfunction. A systematic review of randomized trials

    Arch Otolar Head Neck Surg

    (1999)
  • Ernst, E. Pittler, M.H. The effectiveness of acupuncture in treating acute dental pain: a systematic review, Br Dent J,...
  • E. Ernst

    Acupuncture as a symptomatic treatment of osteoarthritis: a systematic review

    Scand J Rheumatol

    (1997)
  • Ezzo, E. Hadhazy, V. Birch, S. et al. Acupuncture for osteoarthritis of the knee: A systematic review, Arth and...
  • B. Berman et al.

    Is acupuncture an effective treatment for fibromyalgia? A clinical review

    J Fam Pract

    (1999)
  • E. Ernst et al.

    Acupuncture as an adjuvant therapy in stroke rehabilitation?

    Wien Med Wschr

    (1996)
  • J. Kleijnen et al.

    Acupuncture and asthma; a review of controlled trials

    Thorax

    (1991)
  • K. Linde et al.

    Randomized clinical trials of acupuncture for asthma — a systematic review

    Forsch Kompl

    (1996)
  • K. Linde et al.

    Acupuncture for chronic asthma (Cochrane review)

    The Cochrane Library, issue 1

    (2000)
  • A.J. Vickers

    Can acupuncture have specific effects on health? A systematic review of acupuncture antiemesis trials

    J Roy Soc Med

    (1996)
  • G. ter Reit et al.

    A meta-analysis of studies into the effect of acupuncture on addiction

    Brit J Gen Pract

    (1990)
  • A.R. White et al.

    A meta-analysis of acupuncture techniques for smoking cessation

    Tobacco Control

    (1999)
  • E Ernst

    Acupuncture/acupressure for weight reduction? A systematic review

    Wien Klin Wochenschr

    (1997)
  • Ezzo, J. Lao, L.X. Berman, B. Assessing clinical efficacy of acupuncture: what has been learned from systematic reviews...
  • Cited by (20)

    • Clinical reasoning in Western acupuncture

      2010, Acupuncture in Manual Therapy
    • Acupuncture and related techniques for postoperative pain: A systematic review of randomized controlled trials

      2008, British Journal of Anaesthesia
      Citation Excerpt :

      We also performed sensitivity analyses by restricting the analysis to high-quality RCTs as defined as those trials with validity score of 5 or greater and to RCTs in which both patients and assessor blinding was described and the method of blinding deemed adequate. We also conducted two additional sensitivity analyses by restricting the analysis to trials in patients undergoing abdominal surgery, and to trials in which acupuncture was achieved by needling of meridian points, since some believe that acupuncture must involve needle insertion.3 We screened 126 potentially relevant papers, of which 111 were excluded for various reasons (Fig. 1).

    • Acupuncture for pelvic and back pain in pregnancy: a systematic review

      2008, American Journal of Obstetrics and Gynecology
      Citation Excerpt :

      We included auricular acupuncture trials, but only if this was combined with body acupuncture, and intended to perform a separate analysis for such trials. We postulated that the neurohumoral mechanisms involved in these other therapies may differ from those involved in needle acupuncture; in addition, we noted that most experts would agree that acupuncture by definition involves insertion of needles into the skin.26,27 Two reviewers independently extracted data from eligible trials as defined above.

    View all citing articles on Scopus
    f1

    Phone: +31(0)20 689 5145

    f2

    Fax: +31(0)20 689 1328

    View full text