Extraction of Airways From CT (EXACT'09)

P Lo, Berbke Ginneken, JM Reinhardt, T Yavarna, PA Jong, B Irving, C Fetita, M Ortner, R Pinho, J Sijbers, M Feuerstein, A Fabijanska, C Bauer, R Beichel, CS Mendoza, R Wiemker, J van der Lee, AP Reeves, S Born, O WeinheimerEM van Rikxoort, J Tschirren, K Mori, B Odry, DP Naidich, Ieneke Hartmann, EA Hoffman, M Prokop, JH Pedersen, Marleen de Bruijne

Research output: Contribution to journalArticleAcademicpeer-review

169 Citations (Scopus)


This paper describes a framework for establishing a reference airway tree segmentation, which was used to quantitatively evaluate 15 different airway tree extraction algorithms in a standardized manner. Because of the sheer difficulty involved in manually constructing a complete reference standard from scratch, we propose to construct the reference using results from all algorithms that are to be evaluated. We start by subdividing each segmented airway tree into its individual branch segments. Each branch segment is then visually scored by trained observers to determine whether or not it is a correctly segmented part of the airway tree. Finally, the reference airway trees are constructed by taking the union of all correctly extracted branch segments. Fifteen airway tree extraction algorithms from different research groups are evaluated on a diverse set of 20 chest computed tomography (CT) scans of subjects ranging from healthy volunteers to patients with severe pathologies, scanned at different sites, with different CT scanner brands, models, and scanning protocols. Three performance measures covering different aspects of segmentation quality were computed for all participating algorithms. Results from the evaluation showed that no single algorithm could extract more than an average of 74% of the total length of all branches in the reference standard, indicating substantial differences between the algorithms. A fusion scheme that obtained superior results is presented, demonstrating that there is complementary information provided by the different algorithms and there is still room for further improvements in airway segmentation algorithms.
Original languageUndefined/Unknown
Pages (from-to)2093-2107
Number of pages15
JournalIEEE Transactions on Medical Imaging
Issue number11
Publication statusPublished - 2012

Research programs

  • EMC NIHES-03-30-01
  • EMC NIHES-03-30-03

Cite this