Skip to main content
  • Research article
  • Open access
  • Published:

Effectiveness of physical exam signs for early detection of critical illness in pediatric systemic inflammatory response syndrome

Abstract

Background

Early detection of compensated pediatric septic shock requires diagnostic tests that are sensitive and specific. Four physical exam signs are recommended for detecting pediatric septic shock prior to hypotension (cold extremities, mental status, capillary refill, peripheral pulse quality); this study tested their ability to detect patients who develop organ dysfunction among a cohort of undifferentiated pediatric systemic inflammatory response syndrome patients.

Methods

A prospective cohort of 239 pediatric emergency department patients <19 years with fever and tachycardia and undergoing phlebotomy were enrolled. Physicians recorded initial physical exams on a standardized form. Abstraction of the medical record determined outcomes including organ dysfunction, intensive care unit stay, serious bacterial infection, and therapies.

Results

Organ dysfunction occurred in 13/239 (5.4%) patients. Presence of at least one sign was significantly associated with organ dysfunction (Relative Risk: 2.71, 95% CI: 1.05–6.99), and presence of at least two signs had a Relative Risk = 4.98 (95% CI: 1.82–13.58). The sensitivity of exam findings ranged from 8–54%, specificity from 84–98%. Signs were associated with increased risk of intensive care and fluid bolus, but not with serious bacterial infection, intravenous antibiotics or admission. Altered mental status and peripheral pulse quality were significantly associated with organ dysfunction, while abnormal capillary refill time and presence of cold, mottled extremities were not.

Conclusions

Certain recommended physical exam signs were associated with increased risk of organ dysfunction, a rare outcome in this undifferentiated pediatric population with fever and tachycardia. Sensitivity was low, while specificity was high. Additional research into optimally sensitive and specific diagnostic strategies is needed.

Peer Review reports

Background

Severe sepsis affects >72,000 children yearly in the US, with mortality estimates from 10–20% [1, 2]. Adherence to time-sensitive pediatric sepsis treatment guidelines reduces mortality; [3] however, delayed recognition often leads to deviation from these guidelines [4]. Contributing to the challenge of recognition of pediatric sepsis are the large numbers of febrile children with self-limited illness who present to emergency departments for treatment [5]. Therefore, identifying optimal strategies for early identification of pediatric sepsis, particularly of patients in a state of compensated shock, is paramount.

American College of Critical Care Medicine (ACCM) guidelines recommend specific physical examination findings for identification of pediatric septic shock requiring resuscitation; this approach has been adopted into pediatric emergency department (ED) triage strategies [68]. In addition, the pediatric guidelines recommend against the use of laboratory tests to identify septic shock. However, these specific physical examination findings have not been prospectively evaluated for their effectiveness in diagnosing septic shock in patients outside of the intensive care setting.

Current ACCM guidelines for early recognition of septic shock recommend assessment of mental status, capillary refill, peripheral pulse quality, cold/mottled extremities, urine output, and hypotension [6]. At initial presentation, urine output is difficult to quantify, and hypotension defines decompensated shock; therefore four of the recommended physical examination signs remain useful for detection of compensated sepsis in the ED. We tested the effectiveness of these four parameters, or Clinical Recognition Signs (CRS), in predicting severe illness in pediatric ED patients with potential early sepsis.

Methods

This was a planned subanalysis of a prospective cohort study testing lactate levels for diagnosis of sepsis, and was conducted in the ED of a free-standing children’s hospital. Inclusion criteria were: age <19 years; triage heart rate and temperature consistent with systemic inflammatory response syndrome (SIRS) definitions [9] [Additional file 1]; phlebotomy performed in ED; and enrollment preceding or ≤15 minutes after intravenous fluid initiation. Patients transferred from another institution, or with an inborn error of metabolism were excluded. This hospital did not have a sepsis screening or treatment protocol in place at the time of the study. The Children’s Hospital of Philadelphia Institutional Review Board approved this study, with a full waiver of informed consent due to demonstrated barriers in obtaining timely and informed consent from critically ill patients and families prior to receipt of treatments.

Pediatric emergency medicine (PEM) fellows and attendings recorded CRS at the time of their first examination using multiple choice categorical responses that corresponded to the severity of each finding on a data collection form [Additional file 2]. In order to capture real-world effectiveness, physicians were not explicitly trained in physical examination for CRS. All study physicians were board-certified in pediatrics and/or pediatric emergency medicine and >90% of their active clinical practice was in pediatric emergency medicine. When possible, a second PEM physician examined the subject, and independently completed a data collection form to determine inter-rater reliability. Details of the ED visit and subsequent hospitalization, obtained from the medical record, were recorded after discharge on a data collection form.

All discharged patients underwent review of subsequent visits in the inpatient and outpatient electronic medical record within 90 days of the index visit. Evidence of severe sepsis that developed within 3 days of ED presentation, or new problems that developed after the primary visit potentially attributable to a shock episode treated elsewhere, were recorded. For patients without follow up visits in the hospital system, the Social Security Death Index was reviewed and deaths recorded.

The main predictor variables were abnormal CRS. Each CRS was analyzed as a binary variable (normal/abnormal) and categorical, and presence of ≥1 and ≥2 signs was analyzed. Clinically relevant and frequently referenced combinations of CRS were evaluated. A patient was classified as having cold shock when weak peripheral pulses and prolonged capillary refill were present, warm shock when bounding pulses and flash capillary refill were present, and World Health Organization-Emergency Triage and Treatment (WHO-ETAT) shock when cold extremities, capillary refill >3 seconds and weak peripheral pulses were present. The primary outcome measure was presence of organ dysfunction (OD) within 24 hours of ED triage, as defined by International Pediatric Sepsis Consensus Conference definitions [Additional file 3] [9]. Secondary outcomes included ED disposition, intravenous antibiotic administration in the ED, intravenous fluid bolus administration in the ED, and serious bacterial infection (SBI). SBI was defined as a pathogen-positive culture from blood, urine, or cerebrospinal fluid, or definite infiltrate by pediatric attending radiologist interpretation of chest radiograph.

Sample size was calculated for the parent study of serum lactate levels in pediatric SIRS, and enrollment carried out over 13 months to satisfy that sample size [10]. Study data were summarized using standard descriptive statistics. The magnitude of associations between categorical variables and outcomes were described using relative risks. Logistic regression analysis was performed with CRS found to be significant in univariate analysis; receipt of intravenous antibiotics and receipt of 40 ml/kg of isotonic fluid were covariables. Test characteristics (sensitivity, specificity, likelihood ratios) were calculated. Relative risks and likelihood ratios whose 95% confidence intervals did not include one were considered statistically significant. The incidence and test characteristics of cold shock, warm shock and WHO-ETAT shock were evaluated. The kappa statistic or percent concordance when appropriate, were calculated as measures of inter-rater reliability.

Results

239 eligible patients were enrolled and their characteristics are shown in Table 1. Over two-thirds of subjects (67.8%) had no CRS; 64 (26.7%) subjects had one CRS; ten (4.2%) subjects had two CRS, and three (1.3%) subjects had three CRS. No patient displayed all four abnormal CRS. Organ dysfunction within 24 hours developed in 5.4% subjects. 76.6% of patients were hospitalized; 8.0% were admitted to the intensive care unit (ICU), and no patients died.

Table 1 Subject characteristics

The presence of ≥1 CRS was significantly associated with OD within 24 hours (RR: 2.71, 95% CI 1.05–6.99), and presence of ≥2 CRS carried greater risk of OD (RR: 4.98, 95% CI: 1.82–13.58). In analysis of each sign as normal/abnormal, altered mental status and altered peripheral pulse quality were significantly associated with risk of OD, while abnormal capillary refill time and cold, mottled extremities were not [Table 2]. The negative predictive value of exam findings ranged from 94–97%, and positive predictive value ranged from 3–25% [Table 2]. When altered mental status and altered peripheral pulses were analyzed with logistic regression with intravenous antibiotics and receipt of at least 40 ml/kg of isotonic fluid as covariables, only altered mental status remained significantly associated with organ dysfunction, with an odds ratio of 3.84 (1.083–13.62).

Table 2 Sepsis clinical recognition signs present in ED as predictors of organ dysfunction within 24 hours

The presence of ≥1 or ≥2 CRS was associated with an increased likelihood of ICU admission. The presence of ≥2 CRS was associated with an increased likelihood of receiving a fluid bolus [Table 3]. CRS were not associated with intravenous antibiotic administration, SBI, or admission. Mean time from triage to antibiotic in the overall study population was 3.40 ± 1.49 hours; time in patients with ≥1 CRS was 3.34 ± 0.44 hours, and in patients with ≥2 CRS it was 3.05 ± 0.69 hours.

Table 3 Relative risk of clinical outcomes in patients with clinical recognition signs present on initial physical examination

Within each of the four CRS, each abnormal finding was independently evaluated for association with the outcome of organ dysfunction. The abnormal mental status category of “agitation” (RR: 5.75, 95% CI: 2.07–16.0) and the pulse abnormality category of “weak/thready” (RR: 9.63, 95% CI: 2.17–42.77) were the only specific findings significantly associated with organ dysfunction. Few patients displayed the combination of findings specific to cold shock (0), warm shock (1), or WHO shock (0) that had been planned for analysis. The patient displaying characteristics of warm shock did not develop organ dysfunction.

PEM attendings completed 79.9% of assessments; PEM fellows completed 12.1%, and general pediatricians completed 8.0%. Exams were completed before institution of intravenous therapies for nearly all subjects (95.8%). Of the 10 (4.2%) exams for which the exams were performed after therapy had been initiated, all exams were performed within 15 minutes of the start of intravenous therapy as specified in the inclusion criteria. Subjects had received a mean of 9 ml/kg of fluid prior to examination for CRS. Two patients were examined within 15 minutes after the start of an antibiotic infusion; no patients were examined after vasoactive agents. None of the patients who were enrolled after the start of intravenous therapy had either the predictor, CRS, or the outcomes of organ dysfunction or serious bacterial infection. Kappa as a measure of inter-rater reliability could not be calculated in several categories where only normal findings were present, therefore percent concordance rather than the kappa statistic is presented in Table 2.

Review of the medical records of the 56 patients discharged primarily from the ED revealed that 21 (37.5%) subjects had made additional visits in the healthcare system, although none were within 72 hours for progression of illness. The additional visits demonstrated that no patients were hospitalized for progression of primary process at the index visit, and no records of additional new medical problems attributable to sepsis or death. Search of the Social Security Death Index for the 35 subjects without further visits in our system yielded no reported deaths.

Discussion

Previous studies have not evaluated all four CRS at the time of presentation to care as predictors in children with SIRS, though these findings are consistent with prior studies of individual predictors. In mixed-severity populations of children, capillary refill time has been demonstrated to have limited value as a predictor of illness severity in infectious illness [11, 12]. However, a large study of patients referred for specialty transport to children’s hospitals found that abnormal capillary refill times were associated with increased mortality [3]. This likely reflects differing effectiveness of abnormal capillary refill time for determining risk of organ dysfunction in an undifferentiated low-risk population, compared to its ability to stratify risk of death in a high risk, critically-ill population. Additionally, capillary refill times have been demonstrated to be significantly altered by ambient temperature, thus the capillary refill time measured by an ED physician early in a patient’s course may be artificially slow due to outside temperature or undressing a child, potentially accounting for its lack of association with outcome in this study [13].

To have SIRS, a patient must display two out of four criteria. This study only evaluated patients with SIRS by two criteria that are readily available in triage, heart rate and temperature, and thus these results would not necessarily be the same in patients fulfilling different SIRS criteria. Patients with SIRS and phlebotomy during their ED stay were enrolled in order to increase the severity of illness in the study cohort compared to the general SIRS population, resulting in a study population with a 75% admission rate. These results cannot be extrapolated to all ED patients with SIRS, in which a lower pre-test probability for severe illness would likely make the positive predictive value of these tests lower. In addition, in order to study effectiveness, physical examination was performed by uncoached PEM physicians. It is possible that with additional training and standardization, the examination findings would display improved test characteristics; nonetheless, these findings represent their effectiveness when used by physicians who are highly trained and practice in the setting in which these examination techniques are frequently used. The study was not powered to estimate sensitivity with narrow confidence intervals, which would have required thousands of patients given the low prevalence of organ dysfunction; nonetheless the likelihood ratios from our study sample and analysis are informative. This was by intention a snapshot study of these physical exam characteristics. The conclusions limited to these four exam parameters performed once at the outset of ED care.

There are limitations to the study. The most significant limitation was the small number of patients with the primary outcome, organ dysfunction. Sample size was calculated for the parent study of lactate in the ED, and in these calculations a higher percentage of patients with organ dysfunction than was actually seen had been estimated prior to the study. With little literature to guide estimates of organ dysfunction in an undifferentiated pediatric SIRS population, adult and pediatric critical care data were used for these estimates. The low frequency of our outcome influences the wide confidence intervals of the results, as well as the low positive predictive value of CRS. Although not intended to determine the prevalence of organ dysfunction in pediatric SIRS, it is likely that the low frequency of this outcome in the study population accurately reflects of the needle-in-a-haystack challenge of detecting severe sepsis among all children with fever and tachycardia. Additionally, although all patients enrolled demonstrated fever and tachycardia, suggesting infection as a contributing problem, it is possible that organ dysfunction due to other, non-sepsis diagnoses may have confounded the data.

Children were enrolled before or within 15 minutes of the start of intravenous therapy; before therapy for >95% of patients. Because of the challenges of screening and enrolling patients in emergency research, and the near-simultaneous physical examination and therapeutic decision-making that an emergency physician carries out, this window of time was considered a practical window in which to enroll patients, in which intravenous therapy might be expected to minimally alter examination findings. Although this could have potentially influenced results, none of the patients enrolled after the start of intravenous therapy had the predictor, CRS, or the outcome, organ dysfunction, so if it biased results, it would have only served to falsely improve test characteristics of CRS. The study population was approximately half African-American, 30% Caucasian, and 20% other. This may limit its generalizability to different populations, particularly if the test characteristics and reproducibility of physical exam findings varies by race.

Because ED treatment was not standardized, it is possible that if patients with CRS received more aggressive treatment, it would have prevented them from developing the primary outcome of organ dysfunction. However, there was no difference in administration of fluid or antibiotics, aside from the patients with at least two CRS who were more likely to receive an intravenous fluid bolus. Mean time to antibiotic was slightly faster in patients with CRS, however all times were over 3 hours from triage, and the only interval that has been demonstrated to differentially improve outcomes in ED sepsis patients is a time <1 hour [14]. The lack of protocol and time to antibiotics do not represent ideal sepsis care, but are consistent with the majority of emergency department pediatric sepsis care described in prior descriptive studies [4, 15, 16].

Physical examination remains medicine’s well-honed technique for assessment of patient condition. Experienced clinicians frequently determine that a patient appears “septic” based on a clinical impression that considers exam findings and patient characteristics. However, with evidence that life-saving resuscitation begins in the first minutes of ED care, all diagnostic modalities deserve critical evaluation to determine those that accurately risk-stratify patients from the moment of presentation, including the specific characteristics currently recommended for this purpose. Standardization of assessing these physical exam parameters, the use of additional historical and physical findings, traditional laboratory parameters, novel biomarkers, and non-invasive devices for measuring cardiac output and perfusion are all avenues for research with potential to improve diagnosis of early pediatric sepsis.

Timely sepsis resuscitation is life saving, yet at the same time it requires many resources: personnel at the bedside, placement of intravenous peripheral or central catheters, rapid procurement and administration of intravenous fluid boluses, antibiotics and potentially additional medications. Unnecessary aggressive resuscitation diverts resources from other patients, increases costs, and potentially induces medical and psychological harm. With serious negative consequences to both the under-diagnosis and over-diagnosis of sepsis requiring resuscitation, diagnostic strategies that are both sensitive and specific must be sought.

Conclusions

This investigation evaluated physical examination CRS for early diagnosis of pediatric sepsis in the ED. It demonstrated that the presence of ≥1 or ≥2 CRS was significantly associated with OD and ICU admission, but not associated with ED antibiotic administration, SBI, or admission. Abnormal peripheral pulse quality and altered mental status were significantly associated with development of OD, while abnormal capillary refill and presence of cold, mottled extremities were not.

This study has implications for sepsis screening protocols. The high negative predictive values of CRS make their absence reassuring that a patient is unlikely to progress to organ dysfunction. However, the association of one CRS with organ dysfunction was modest. Although the clinical recognition signs recommended for diagnosis of pediatric sepsis are specific, they lack the positive predictive value that would be ideal for a test in sepsis, and research should continue to determine tests that diagnose children with compensated septic shock with both specificity and sensitivity.

Abbreviations

ACCM:

American College of Critical Care Medicine

CRS:

Clinical recognition sign

ED:

Emergency Department

ICU:

Intensive care unit

OD:

Organ dysfunction

PEM:

Pediatric emergency medicine

SBI:

Serious bacterial infection

SIRS:

Systemic inflammatory response syndrome.

References

  1. Hartman ME, Linde-Zwirble WT, Angus DC, Watson RS: Trends in the epidemiology of pediatric severe sepsis*. SocietiesPediatr Crit Care Med. 2013, 14 (7): 686-693. 10.1097/PCC.0b013e3182917fad.

    Article  Google Scholar 

  2. Balamuth F, Weiss SL, Neuman MI, Scott H, Brady PW, Paul R, Farris RW, McClead R, Hayes K, Gaieski D, Hall M, Shah SS, Alpern ER: Pediatric severe sepsis in U.S. children’s hospitals. SocietiesPediatr Crit Care Med. 2014, [Epub ahead of print]

    Google Scholar 

  3. Carcillo JA, Kuch BA, Han YY, Day S, Greenwald BM, McCloskey KA, Pearson-Shaver AL, Orr RA: Mortality and functional morbidity after use of PALS/APLS by community physicians. Pediatrics. 2009, 124 (2): 500-508. 10.1542/peds.2008-1967.

    Article  PubMed  Google Scholar 

  4. Han YY, Carcillo JA, Dragotta MA, Bills DM, Watson RS, Westerman ME, Orr RA: Early reversal of pediatric-neonatal septic shock by community physicians is associated with improved outcome. Pediatrics. 2003, 112 (4): 793-799. 10.1542/peds.112.4.793.

    Article  PubMed  Google Scholar 

  5. Statistical Brief #52: Healthcare Cost and Utilization Project. [http://www.hcup-us.ahrq.gov/reports/statbriefs/sb52.jsp]

  6. Brierley J, Carcillo JA, Choong K, Cornell T, Decaen A, Deymann A, Doctor A, Davis A, Duff J, Dugas MA, Duncan A, Evans B, Feldman J, Felmet K, Fisher G, Frankel L, Jeffries H, Greenwald B, Gutierrez J, Hall M, Han YY, Hanson J, Hazelzet J, Hernan L, Kiff J, Kissoon N, Kon A, Irazuzta J, Lin J, Lorts A, et al: Clinical practice parameters for hemodynamic support of pediatric and neonatal septic shock: 2007 update from the American College of Critical Care Medicine. Crit Care Med. 2009, 37 (2): 666-688. 10.1097/CCM.0b013e31819323c6.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Cruz AT, Perry AM, Williams EA, Graf JM, Wuestner ER, Patel B: Implementation of goal-directed therapy for children with suspected sepsis in the emergency department. Pediatrics. 2011, 127 (3): e758-e766. 10.1542/peds.2010-2895.

    Article  PubMed  Google Scholar 

  8. Larsen GY, Mecham N, Greenberg R: An emergency department septic shock protocol and care guideline for children initiated at triage. Pediatrics. 2011, 127 (6): e1585-e1592. 10.1542/peds.2010-3513.

    Article  PubMed  Google Scholar 

  9. Goldstein B, Giroir B, Randolph A, International Consensus Conference on Pediatric S: International pediatric sepsis consensus conference: definitions for sepsis and organ dysfunction in pediatrics. SocietiesPediatr Crit Care Med. 2005, 6 (1): 2-8. 10.1097/01.PCC.0000149131.72248.E6.

    Article  Google Scholar 

  10. Scott HF, Donoghue AJ, Gaieski DF, Marchese RF, Mistry RD: The utility of early lactate testing in undifferentiated pediatric systemic inflammatory response syndrome. Acad Emerg Med. 2012, 19 (11): 1276-1280. 10.1111/acem.12014.

    Article  PubMed  Google Scholar 

  11. Pamba A, Maitland K: Capillary refill: prognostic value in Kenyan children. Arch Dis Child. 2004, 89 (10): 950-955. 10.1136/adc.2003.032516.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Leonard PA, Beattie TF: Is measurement of capillary refill time useful as part of the initial assessment of children?. Eur J Emerg Med. 2004, 11 (3): 158-163. 10.1097/01.mej.0000127643.38834.86.

    Article  PubMed  Google Scholar 

  13. Gorelick MH, Shaw KN, Baker MD: Effect of ambient temperature on capillary refill in healthy children. Pediatrics. 1993, 92 (5): 699-702.

    CAS  PubMed  Google Scholar 

  14. Gaieski DF, Mikkelsen ME, Band RA, Pines JM, Massone R, Furia FF, Shofer FS, Goyal M: Impact of time to antibiotics on survival in patients with severe sepsis or septic shock in whom early goal-directed therapy was initiated in the emergency department. Crit Care Med. 2010, 38 (4): 1045-1053. 10.1097/CCM.0b013e3181cc4824.

    Article  PubMed  Google Scholar 

  15. Inwald DP, Tasker RC, Peters MJ, Nadel S, Paediatric Intensive Care Society Study G: Emergency management of children with severe sepsis in the United Kingdom: the results of the Paediatric Intensive Care Society sepsis audit. Arch Dis Child. 2009, 94 (5): 348-353. 10.1136/adc.2008.153064.

    Article  CAS  PubMed  Google Scholar 

  16. Paul R, Neuman MI, Monuteaux MC, Melendez E: Adherence to PALS Sepsis Guidelines and Hospital Length of Stay. Pediatrics. 2012, 130 (2): e273-e280. 10.1542/peds.2012-0094.

    Article  PubMed  Google Scholar 

Pre-publication history

Download references

Acknowledgments

All phases of this study were supported by the Academic Pediatric Association Region 2 Young Investigator Grant and the Nicholas Crognale Endowed Chair for Emergency Medicine at the Children’s Hospital of Philadelphia. Neither funding source had any role in the design, collection, analysis, interpretation of data, writing the manuscript or decision to submit manuscript for publication.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Halden F Scott.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

HS conceptualized and designed the study, obtained research funding, supervised conduct of the trial and data collection, managed the data, takes responsibility for the integrity of the data and accuracy of the analysis, drafted the initial manuscript, and approved the final manuscript as submitted. AD contributed to the design of the study, interpreted the results, revised the manuscript and read and approved the final manuscript as submitted. DG contributed to the design of the study, interpreted the results, revised the manuscript and read and approved the final manuscript as submitted. RFM collected data, supervised conduct of the trial, revised the manuscript and read and approved the final manuscript as submitted. RDM designed the study, obtained research funding, supervised conduct of the trial and data collection, interpreted the data, revised the manuscript, and read and approved the final manuscript as submitted.

Electronic supplementary material

12873_2014_216_MOESM1_ESM.pdf

Additional file 1: SIRS Definitions. This file details age-specific SIRS parameters, as defined in the reference cited. (PDF 81 KB)

12873_2014_216_MOESM2_ESM.pdf

Additional file 2: Questionnaire Completed by Physicians in the Emergency Department Describing their Initial Physical Examination of the Patient. This file is a replica of the study data collection form used to record the physical exam. (PDF 68 KB)

12873_2014_216_MOESM3_ESM.pdf

Additional file 3: Study Organ Dysfunction Definitions, adapted from IPSCC definitions. This file contains the definitions used for assessing presence of the primary outcome, organ dysfunction. (PDF 62 KB)

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Scott, H.F., Donoghue, A.J., Gaieski, D.F. et al. Effectiveness of physical exam signs for early detection of critical illness in pediatric systemic inflammatory response syndrome. BMC Emerg Med 14, 24 (2014). https://doi.org/10.1186/1471-227X-14-24

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-227X-14-24

Keywords