1 Introduction
Lung Cancer is one of the most serious fatal diseases. It is the leading cause of cancer death among both men and women. As per American Cancer Society's publication, Cancer Facts & Figures 2017 [1], about 155,870 deaths from lung cancer are estimated for the year of 2017 in the USA alone. The possibility of lung cancer is about 1 in every 13 men and about 1 in every 16 women. The treatment of lung cancer is effective only during its early stages.
The early detection of lung cancer can be performed effectively with the help of an automated cancer detection system.
Many researchers investigate the development of the computer-aided diagnosis (CAD), system for lung cancer from different image modalities. The performance of a particular CAD system can be evaluated in terms of accuracy, the number of false positives, speed, and automation level. The input of a CAD system is the medical images obtained from an appropriate modality. The segmentation of lung region is a pre-processing step of the CAD system in order to reduce the search space for the detection of lung nodules. In nodule detection step, the locations of lung nodules are detected. The detected nodules are then segmented. Finally, a candidate set of features such as appearance feature, shape and volume are extracted, and used for diagnosis [2].
Here, we focus only in lung segmentation on which the performance of the whole CAD system depends. It is the most critical step of CAD system as the remaining steps proceed on the segmented lung. The most common usage of lung segmentation algorithm is to quantify the lung disease progression, regression or stagnation and change in the visual extent of disease over time. It is also an important marker of response to therapy and a predictor for chances of survival. Lung segmentation algorithms are also commonly used as a pre-processing step for the segmentation of other lung structures and anomalies, such as nodules, vessels, lobules, and fissures.
In this paper, an automated lung segmentation method is proposed, which is used to segment lung region including Juxta-Pleural nodules.
The performance of the method is evaluated by using data available from the Lung Image Database Consortium (LIDC) [3], and data collected from Regional Institute of Medical Sciences, Imphal (RIMS). It is also compared with that of the existing Image Thresholding method [4], and then concluded that the proposed method yields better performance than the existing method.
The rest of the paper is organized as follows: Section 2, Related Works, a brief overview of the existing methods is presented. Section 3, Methodology, the proposed method for the segmentation of lung including Juxta-Pleural nodules is described. Section 4, Experimental Results and Analyses, the performance of the proposed method is evaluated and compared it with the performance of the existing Image Thresholding method. At the last section of this paper, the conclusion and future works are included.
2 Related Works
Hu et al. [4], practiced an Iterative Thresholding, Dynamic Programming, and Morphological operations. They achieved Root Mean Square Distance (RmsD), as 0.8 pixel. Mendonca et al. [5] showed the Sensitivity (Sen.) of 0.9225 and Positive Predictive Value (PPV), of 0.968 by using spatial edge detector method. Yim et al. [6] used both region growing and connected component labeling and showed Root Mean Square Distance (RmsD) of 1.2 pixel. Overlap Measure (OM), of 0.8165 has been shown by Sluimer et al. [7] using the shape-based method. Campadelli et al. [8] produced the value of Sensitivity (Sen.) of 0.9174, Specificity (Spec.) of 0.9584, Positive Predictive Value (PPV) of 0.9197 and Accuracy (Acc.) of 0.9437 by using spatial edge detector method. Korfiatis et al. [9], showed the value of Overlap Measure (OM) as 0.983 and Root Mean Square Distance (RmsD) as 0.52 mm by using wavelet edge detector method. Gao et al. [10] demonstrated the value of Dice Similarity Coefficient (DSC) as 0.9946 by using thresholding method. Shi et al. [11], studied the method of the shape-based deformable model with 0.92 Overlap Measure (OM).
El-Baz et al. [12], practiced statistical MGRF model and found the value of Accuracy (Acc.) as 0.968.
Annangi et al. [13], worked the shape-based deformable model technique and gave the value of Dice Similarity Coefficient (DSC) as 0.88. Kockelkorn et al. [14] found the value of Overlap Measure (OM), as 0.96 by prior training and statistical classifier technique. Besbes et al. [15] used the shape-based technique and found the value of Overlap Measure (OM) as 0.9474. Hua et al. [16] reported the value of Sensitivity (Sen.) as 0.986 and Specificity (Spec.) as 0.995 by graph search technique. Sun et al. [17], used the shape-based technique and found the value of Dice Similarity Coefficient (DSC) as 0.975. Abdollahi et al. [18] worked the statistical MGRF model technique and showed the value of Dice Similarity Coefficient (DSC) as 0.960.
The existing Lung Segmentation methods focused on the accuracy of the segmentation but Juxta-Pleural nodule cases were not considered. A brief summary of the above mentioned existing methods of Lung Segmentation is given in Table 1.
Model | Approach | Performance |
---|---|---|
Hu et al. [4] | Iterative Thresholding | RmsD = 0.8 pixel |
Mendonca et al. [5] | Spatial Edge Detection | Sen = 0.9225 PPV = 0.968 |
Yim et al. [6] | Region Growing | RmsD = 1.2 pixel |
Sluimer et al. [7] | Shape-based method | OM = 0.8165 |
Campadelli et al. [8] | Spatial Edge Model | Sen = 0.9174 Spec =0.9584 |
Korfiatis et al. [9] | Wavelet Edge Detection | OM = 0.983 RmsD=0.52mm |
Gao et al. [10] | Thresholding | DSC = 0.9946 |
Shi et al. [11] | Shape-based Deformable Model | OM = 0.92 |
El-Baz et al. [12] | Statistical MGRF | Acc = 0.968 |
Annangi et al. [13] | Shape-based Deformable Model | DSC = 0.88 |
Kockelkorn et al. [14] | Statistical classification | OM = 0.96 |
Besbes et al. [15] | Shape-based Technique | OM = 0.9474 |
Hua et al. [16] | Graph search Technique | Sen = 0.986 Spec = 0.995 |
Sun et al. [17] | Active Shape Model | DSC = 0.975 |
Abdollahi et al. [18] | Statistical MGRF | DSC = 0.960 |
3 Methodology
The goal of the lung segmentation is to separate the voxels corresponding to lung tissue from the voxels corresponding to the surrounding anatomy. In our proposed method, there are two steps to segment lung tissues from CT scan image, namely (i) Lung Field Extraction and (ii) Boundary Analysis and Segmentation of Lung. In the first step, extraction of the lung field is performed by using Image Thresholding technique and Connected Component Analysis. Here, the extracted lung field does not include Juxta-Pleural nodules. Most of the existing thresholding-based Lung Segmentation methods finalized in this Lung Field Extraction step, extended with some morphological smoothing post processing steps. The addition of the proposed method can be seen in the next processing step, it is designed to include Juxta-Pleural nodules in the Lung Segmentation.
In the second step, the boundaries of both left and right lungs are analyzed by identifying Juxta-Pleural nodules affecting lung boundaries, and then segment lung region with Juxta-Pleural nodule inclusion. Under the following subsections, the two steps of the proposed method are described in details.
3.1 Lung Field Extraction
Lung Field Extraction step is divided into three parts: (a) Background Suppression, (b) Lung Field Extraction by Thresholding, and (c) Lung Volume Extraction using Connected Component Analysis.
First, the Background Suppression extracts the body region by removing the surrounding air space.
Then, the Lung Field Extraction by Thresholding separates the lung tissues from the extracted body but at this stage, Juxta-Pleural nodules cannot be included. Finally, the Lung Volume Extraction using Connected Component Analysis reconstructs 3D lung model of the lungs from the 2D slices of the extracted lung regions.
a. Background Suppression
The surrounding air space of the patient’s body on CT scan image, is removed by using Image Thresholding technique with a threshold value of-600 H.U. Then, a morphological hole filling operation is applied on the thresholder image in order to include the lung inside the segmented body. Finally, each of pixel on the thresholder image is multiplied with the corresponding pixel on the original CT image, in order to get the body without the surrounding air space, as shown in Figure 1.
b. Lung Field Extraction by Thresholding
After background suppression, the background pixels are replaced with white pixels, so that the lung field which has lesser intensity, can be extracted easily. The extraction of lung field is performed by using Image Thresholding technique [19] with a threshold value of -500 H.U. But, the internal airways of lung are lighter in intensity compare to that of lung.
Hence, a morphological hole filling operation is applied to include all the airways inside the lung, as shown in Figure 2.
c. Lung Volume Extraction using Connected Component Analysis
In this step, the lung volume is extracted. There are other internal structures and organs which are of similar intensity to that of the lung. Those structures and organs are usually not attached to the lung, and hence they can also be removed by using 3D Connected Component Analysis [20], using 6-Neighborhood Connectivity.
Since both left and right lungs are connected with bronchi and both lungs occupy maximum volume in the thorax, lung volume is extracted by choosing the largest number of voxels among all the connected components, as shown in Figure 3.
3.2 Boundary Analysis and Segmentation of Lung
After lung field extraction, in this step, the boundary edges of the extracted lung field are analyzed in order to include Juxta-Pleural nodules. First, the edges of the extracted lungs from the binary lung field images are detected using Sobel Edge Detection Technique [21].
The lung images after applying Lung Field Extraction and Sobel Edge Detection are shown in Figure 4 and 5. In the following subsections, the polar coordinates of the edge points are detected from the detected edges of lungs, then Juxta-Pleural nodules are detected from the upper boundary edge points, and finally, the lung boundaries at Juxta-Pleural nodule locations are reconstructed.
a. Detection of Polar Coordinates of the Edge Points
After the detection of the lung edges, the edge points which is in Cartesian coordinate system are detected and then converted into Polar Coordinate System. First, the white edge pixels are extracted and the Cartesian coordinates of the extracted edge points are detected. The centroid of the edge points of the lung is considered as the origin of the coordinate system.
Then, the coordinates of the edge points are converted in Polar Coordinate System by using the following equations:
where θ is the angle and r is the radial distance of the point
The extracted edge points in Cartesian Coordinate System is shown in Figure 6 with center as a red dot in the middle. After the conversion to Polar Coordinate System, the edge points are plotted in XY plane such that the angle (in degree) of the polar coordinates, is plotted along x-axis and the radial distance along y-axis, as shown in Figure 7.
b. Juxta-Pleural Nodule Detection
From the Figure 7, the upper boundary line is extracted using Max function. The derivative of this boundary line is then thresholded with two fixed threshold values
c. Boundary Reconstruction using Gray-level Profiling
From the above detected Juxta-Pleural nodule location, the boundary of the lung at Juxta-Pleural nodule location, is reconstructed by using Gray-level Profiling [21]. After Gray-level profiling the edge points are further aligned by using an 1D averaging filter. Figure 9 and 10 show the segmented lung before and after Gray-level Profiling.
Finally, the region of Juxta-Pleural nodule is filled by using morphological hole filling operation. The images of the lungs before and after the lung segmentation are shown below:
4. Experimental Results and Analyses
In order to evaluate the performance of the proposed system, we need ground-truth images which have to be compared with. We calculate true positive (TP), true negative (TN), false positive (FP) and false negative (FN) using logical pixel-wise operators as follows:
where
From these values, we calculate seven performance parameters: Sensitivity (Sen.), Specificity (Spec.), Accuracy (Acc.), Dice Similarity Coefficient (DSC), Overlap Measure (OM), Positive Predictive Value (PPV) and Root Mean Square Distance (RmsD):
where
Using LIDC data | Using RIMS data | |||
---|---|---|---|---|
Existing Method | Proposed Method | Existing Method | Proposed Method | |
Accuracy (Acc) | 0.98634 | 0.99958 | 0.99303 | 0.99805 |
Sensitivity (Sen) | 0.92208 | 0.99759 | 0.96269 | 0.99204 |
Specificity (Spec) | 1 | 1 | 0.99935 | 0.9993 |
Dice Similarity Coefficient (DSC) | 0.95946 | 0.99879 | 0.97944 | 0.99433 |
Overlap Measure (OM) | 0.92208 | 0.99759 | 0.9597 | 0.98872 |
Positive Predictive Value (PPV) | 1 | 1 | 0.99677 | 0.99662 |
Root Mean Square Distance (RmsD) | 0.11689 | 0.02057 | 0.08350 | 0.04419 |
The graphs (shown in Figure 13 and 14) show the comparison between the proposed method and the existing threshold method in terms of sensitivity, specificity, and accuracy. From this graph, we found that the proposed method has higher sensitivity, specificity, and accuracy. Hence, the proposed method is more efficient than the existing Image Thresholding method.
5. Conclusion
The segmentation of lung including Juxta-Pleural nodule is a challenging task for many researches. The existing segmentation methods such as Image Thresholding, Region-growing algorithm, Active contour, Level sets, etc. fail to segment lungs including Juxta-Pleural nodules.
So, we proposed a new fully automated image processing method to segment lung including Juxta-Pleural nodules. The proposed method consists of two main stages: (i) Lung field extraction, which extracts initial lung region, and (ii) Boundary Analysis and Segmentation of Lung, which segments lungs with Juxta-Pleural nodules. And, we found the performance of the proposed method yields a better result than that of the existing Image Thresholding method [4].
The segmented lung obtains from the proposed system can further be applied to image processing steps (like Nodule Detection, Nodule Segmentation, and Nodule Diagnosis) in the CAD system for Lung Cancer. Hence, further works to detect, segment and diagnosis of lung cancer cells (pulmonary nodules), can be done efficiently from this proposed lung segmentation.