Skip to main content
Log in

Computer Input Devices: Neutral Party or Source of Significant Error in Manual Lesion Segmentation?

  • Published:
Journal of Digital Imaging Aims and scope Submit manuscript

Abstract

Lesion segmentation involves outlining the contour of an abnormality on an image to distinguish boundaries between normal and abnormal tissue and is essential to track malignant and benign disease in medical imaging for clinical, research, and treatment purposes. A laser optical mouse and a graphics tablet were used by radiologists to segment 12 simulated reference lesions per subject in two groups (one group comprised three lesion morphologies in two sizes, one for each input device for each device two sets of six, composed of three morphologies in two sizes each). Time for segmentation was recorded. Subjects completed an opinion survey following segmentation. Error in contour segmentation was calculated using root mean square error. Error in area of segmentation was calculated compared to the reference lesion. 11 radiologists segmented a total of 132 simulated lesions. Overall error in contour segmentation was less with the graphics tablet than with the mouse (P < 0.0001). Error in area of segmentation was not significantly different between the tablet and the mouse (P = 0.62). Time for segmentation was less with the tablet than the mouse (P = 0.011). All subjects preferred the graphics tablet for future segmentation (P = 0.011) and felt subjectively that the tablet was faster, easier, and more accurate (P = 0.0005). For purposes in which accuracy in contour of lesion segmentation is of the greater importance, the graphics tablet is superior to the mouse in accuracy with a small speed benefit. For purposes in which accuracy of area of lesion segmentation is of greater importance, the graphics tablet and mouse are equally accurate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig 1.

Similar content being viewed by others

References

  1. Saini S. Radiologic measurement of tumor size in clinical trials. AJR 176:333–334, 2001

    CAS  PubMed  Google Scholar 

  2. Gavrielides MA, Kinnard LM, Myers KJ, et al. Noncalcified lung nodules: volumetric assessment with thoracic CT. Radiology 251:26–37, 2009

    Article  PubMed  Google Scholar 

  3. Hopper KD, Kasales CJ, Van Slyke MA, et al. Analysis of interobserver and intraobserver variability in CT tumor measurements. AJR 167:851–854, 1996

    CAS  PubMed  Google Scholar 

  4. Schwartz LH, Ginsberg MS, DeCorato D, et al. Evaluation of tumor measurement in oncology: use of film-based and electronic techniques. J Clin Oncol 18:2179–2184, 2000

    CAS  PubMed  Google Scholar 

  5. Zijdenbos AP, Forghani R, Evans AC. Automatic “pipeline” analysis of 3-D MRI data for clinical trials: application to multiple sclerosis. IEEE Trans Med Imaging 21:1280–1291, 2002

    Google Scholar 

  6. Yu H, Caldwell C, Mah K, et al. Automated radiation targeting in head-and-neck cancer using region-based texture analysis of PET and CT images. Int J Radiat Oncol Biol Phys 75(2):618–625, 2009

    Google Scholar 

  7. Suit H. The Gray Lecture 2001: coming technical advances in radiation oncology. Int J Radiat Oncol Biol Phys 53(4):798–809, 2002

    Article  PubMed  Google Scholar 

  8. De Xivry JO, Janssens G, Bosmans G, et al. Tumor delineation and cumulative dose computation in radiotherapy based on deformable registration of respiratory correlated CT images of lung cancer patients. Radiother Oncol 85:232–238, 2007

    Article  Google Scholar 

  9. Hamilton CS, Ebert MA. Volumetric uncertainty in radiotherapy. Clin Oncol 17:456–464, 2005

    Article  CAS  Google Scholar 

  10. Cao L, Li X, Zhan J, Chen W. Automated lung segmentation algorithm for CAD system of thoracic CT. Journal of Medical Colleges of PLA 23:215–222, 2008

    Article  Google Scholar 

  11. Lao Z, Shen D, Liu D, et al. Computer-assisted segmentation of white matter lesions in 3D MR images using support vector machine. Acad Radiol 15:300–313, 2008

    Article  PubMed  Google Scholar 

  12. Kostopoulos S, Glotsos D, Kagadis GC, et al. A hybrid pixel-based classification method for blood vessel segmentation and aneurysm detection on CTA. Comput Graph 31:493–500, 2007

    Article  Google Scholar 

  13. Goodman LR, Gulsun M, Washington L, et al. Inherent variability of CT lung nodule measurements in vivo using semiautomated volumetric measurements. AJR 186:989–994, 1996

    Article  Google Scholar 

  14. Alfano B, Brunetti A, Larabina M, et al. Automated segmentation and measurement of global white matter lesion volume in patients with multiple sclerosis. J Magn Reson Imaging 12:799–807, 2000

    Article  CAS  PubMed  Google Scholar 

  15. Vannier MW, Pilgram TK, Speidel CM, et al. Validation of magnetic resonance imaging (MRI) multispectral tissue classification. Comput Med Imaging graph 15:217–223, 1991

    Article  CAS  PubMed  Google Scholar 

  16. Zijdenbos AP, Dawant BM, Margolin RA. Measurement reliability and reproducibility in manual and semi-automatic MRI segmentation. Proceedings of the 15th IEEE-Engineering in Medicine and Biology Society 15:162–163, 1993

    Article  Google Scholar 

  17. Street E, Hadjiiski L, Sahiner B, et al. Automated volume analysis of head and neck lesions on CT scans using 3D level set segmentation. Med Phys 24:4399–4408, 2007

    Article  Google Scholar 

  18. Anbeek P, Vincken KL, van Bochove GS, et al. Probabilistic segmentation of brain tissue in MR imaging. Neuroimage 27:795–804, 2005

    Article  PubMed  Google Scholar 

  19. Solloway S, Hutchinson CE, Waterton JC, et al. The use of active shape models for making thickness measurements of articular cartilage from MR images. Magn Reson Med 37:943–952, 1997

    Article  CAS  PubMed  Google Scholar 

  20. McWalter EJ, Wirth W, Siebert M, et al. Use of novel interactive input devices for segmentation of articular cartilage from magnetic resonance images. Osteoarthr Cartil 13:48–53, 2005

    Article  CAS  PubMed  Google Scholar 

  21. Kravits JF. Of mice and pen: effects of input device on different age groups performing goal-oriented tasks. Proceedings of the Human Factors and Ergonomics Society 51st Annual Meeting 2007: 45–49

  22. MacKenzie IS, Sellen A, Buxton W. A comparison of input devices in elemental pointing and dragging tasks. Proceedings of ACM CHI’91 Conference on Human Factors in Computing Systems 161–166, 1991

  23. Kotani K, Horii K. An analysis of muscular load and performance in using a pen tablet system. J Physiol Anthropol Appl Hum Sci 22:89–95, 2003

    Article  Google Scholar 

  24. Bertuca DJ. Letting go of the mouse: using alternative computer input devices to improve productivity and reduce injury. OCLC Syst Serv 17(2):79–83, 2001

    Article  Google Scholar 

  25. Larsson SN, Stapleton S, Larsson L. A comparison of speed and accuracy of contouring using mouse versus graphics tablet. Clin Oncol 19:S36, 2007

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to James Y. Chen.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chen, J.Y., Seagull, F.J., Nagy, P. et al. Computer Input Devices: Neutral Party or Source of Significant Error in Manual Lesion Segmentation?. J Digit Imaging 24, 135–141 (2011). https://doi.org/10.1007/s10278-009-9258-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10278-009-9258-9

Key words

Navigation