<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "journalpublishing3.dtd">
<article xml:lang="en" article-type="research-article" xmlns:xlink="http://www.w3.org/1999/xlink">
<?release-delay 0|0?>
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">OL</journal-id>
<journal-title-group>
<journal-title>Oncology Letters</journal-title>
</journal-title-group>
<issn pub-type="ppub">1792-1074</issn>
<issn pub-type="epub">1792-1082</issn>
<publisher>
<publisher-name>D.A. Spandidos</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3892/ol.2018.8805</article-id>
<article-id pub-id-type="publisher-id">OL-0-0-8805</article-id>
<article-categories>
<subj-group>
<subject>Articles</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Discrimination of malignant and benign breast masses using automatic segmentation and features extracted from dynamic contrast-enhanced and diffusion-weighted MRI</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author"><name><surname>Jiang</surname><given-names>Xinhua</given-names></name>
<xref rid="af1-ol-0-0-8805" ref-type="aff">1</xref>
<xref rid="fn1-ol-0-0-8805" ref-type="author-notes">&#x002A;</xref></contrib>
<contrib contrib-type="author"><name><surname>Xie</surname><given-names>Fei</given-names></name>
<xref rid="af1-ol-0-0-8805" ref-type="aff">1</xref>
<xref rid="fn1-ol-0-0-8805" ref-type="author-notes">&#x002A;</xref></contrib>
<contrib contrib-type="author"><name><surname>Liu</surname><given-names>Lizhi</given-names></name>
<xref rid="af1-ol-0-0-8805" ref-type="aff">1</xref>
<xref rid="fn1-ol-0-0-8805" ref-type="author-notes">&#x002A;</xref></contrib>
<contrib contrib-type="author"><name><surname>Peng</surname><given-names>Yanxia</given-names></name>
<xref rid="af2-ol-0-0-8805" ref-type="aff">2</xref></contrib>
<contrib contrib-type="author"><name><surname>Cai</surname><given-names>Hongmin</given-names></name>
<xref rid="af3-ol-0-0-8805" ref-type="aff">3</xref>
<xref rid="fn1-ol-0-0-8805" ref-type="author-notes">&#x002A;</xref>
<xref rid="c2-ol-0-0-8805" ref-type="corresp"/></contrib>
<contrib contrib-type="author"><name><surname>Li</surname><given-names>Li</given-names></name>
<xref rid="af1-ol-0-0-8805" ref-type="aff">1</xref>
<xref rid="fn1-ol-0-0-8805" ref-type="author-notes">&#x002A;</xref>
<xref rid="c1-ol-0-0-8805" ref-type="corresp"/></contrib>
</contrib-group>
<aff id="af1-ol-0-0-8805"><label>1</label>Department of Medical Imaging, Collaborative Innovation Center for Cancer Medicine, State Key Laboratory of Oncology in South China, Sun Yat-sen University Cancer Center, Guangzhou, Guangdong 510060, P.R. China</aff>
<aff id="af2-ol-0-0-8805"><label>2</label>Department of Radiology, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, Guangdong 510630, P.R. China</aff>
<aff id="af3-ol-0-0-8805"><label>3</label>Department of Computer Science, School of Computer Science and Engineering, South China University of Technology, Guangzhou, Guangdong 510006, P.R. China</aff>
<author-notes>
<corresp id="c1-ol-0-0-8805"><italic>Correspondence to</italic>: Dr Li Li, Department of Medical Imaging, Collaborative Innovation Center for Cancer Medicine, State Key Laboratory of Oncology in South China, Sun Yat-sen University Cancer Center, 651 Dongfeng East Road, Guangzhou, Guangdong 510060, P.R. China, E-mail: <email>li2@mail.sysu.edu.cn</email></corresp>
<corresp id="c2-ol-0-0-8805">Dr Hongmin Cai, Department of Computer Science, School of Computer Science and Engineering, South China University of Technology, 281 Wushan Road, Guangzhou, Guangdong 510006, P.R. China, E-mail: <email>hmcai@scut.edu.cn</email></corresp>
<fn id="fn1-ol-0-0-8805"><label>&#x002A;</label><p>Contributed equally</p></fn>
</author-notes>
<pub-date pub-type="ppub">
<month>08</month>
<year>2018</year></pub-date>
<pub-date pub-type="epub">
<day>24</day>
<month>05</month>
<year>2018</year></pub-date>
<volume>16</volume>
<issue>2</issue>
<fpage>1521</fpage>
<lpage>1528</lpage>
<history>
<date date-type="received"><day>29</day><month>07</month><year>2015</year></date>
<date date-type="accepted"><day>21</day><month>04</month><year>2017</year></date>
</history>
<permissions>
<copyright-statement>Copyright: &#x00A9; Jiang et al.</copyright-statement>
<copyright-year>2018</copyright-year>
<license license-type="open-access">
<license-p>This is an open access article distributed under the terms of the <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by-nc-nd/4.0/">Creative Commons Attribution-NonCommercial-NoDerivs License</ext-link>, which permits use and distribution in any medium, provided the original work is properly cited, the use is non-commercial and no modifications or adaptations are made.</license-p></license>
</permissions>
<abstract>
<p>Magnetic resonance imaging exhibits high sensitivity but low specificity for breast cancer. The present study aimed to investigate whether combining morphology, texture features and kinetic features with diffusion-weighted imaging using quantitative analysis improves the accuracy of discriminating malignant from benign breast masses. In total, 104 and 171 malignant lesions in 205 women were included. Additionally, 13 texture and 11 morphology features were computed from each lesion using a semi-automated segmentation method. To increase prediction accuracy, a newly designed classification model, difference-weighted local hyperplane, was used for statistical analysis of the combined effects of the features for predicting lesion type. The mean apparent diffusion coefficient (ADC) value for each lesion was calculated. Diagnostic performances of morphology and texture features, kinetic features and ADC alone and the combination of them were evaluated using receiver operating characteristics analysis. Malignant lesions had lower mean ADCs than benign lesions. By using 10-fold cross validation scheme, combined morphological and kinetic features achieved a diagnostic average accuracy of 0.87. Adding an ADC threshold of 1.37&#x00D7;10<sup>&#x2212;3</sup> mm<sup>2</sup>/sec increased the overall averaged accuracy to 0.90. A multivariate model combining ADC values with 6 morphological and kinetic parameters best discriminated malignant from benign lesions. Incorporating morphology and texture features, kinetic features and ADC into a multivariable diagnostic model improves the discriminatory power of breast lesions.</p>
</abstract>
<kwd-group>
<kwd>diffusion-weighted imaging</kwd>
<kwd>breast mass</kwd>
<kwd>quantitative morphology and texture features</kwd>
<kwd>computer-aided diagnosis</kwd>
<kwd>difference-weighted local hyperplane</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec sec-type="intro">
<title>Introduction</title>
<p>Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) is increasingly used for breast cancer diagnosis as an adjunct to conventional imaging techniques (<xref rid="b1-ol-0-0-8805" ref-type="bibr">1</xref>). It is used for all stages of management, including detection, diagnosis, pre-operative staging, therapy response monitoring and surveillance (<xref rid="b2-ol-0-0-8805" ref-type="bibr">2</xref>&#x2013;<xref rid="b6-ol-0-0-8805" ref-type="bibr">6</xref>). Breast MRI has demonstrated a high sensitivity, but with the shortcoming of varying specificity, reported from 0.37 to 0.97 (<xref rid="b3-ol-0-0-8805" ref-type="bibr">3</xref>,<xref rid="b7-ol-0-0-8805" ref-type="bibr">7</xref>), which may lead to unnecessary biopsies. Studies have demonstrated that using morphological features in routine clinical practice as additional diagnostic criteria in breast MRI can improve specificity without significantly reducing sensitivity (<xref rid="b8-ol-0-0-8805" ref-type="bibr">8</xref>,<xref rid="b9-ol-0-0-8805" ref-type="bibr">9</xref>).</p>
<p>Currently, computer-assisted diagnosis (CAD) systems for breast MRI are increasingly used in clinical practice in order to reduce inter-observer variations in interpretations by facilitating a quantitative and objective evaluation of the images (<xref rid="b10-ol-0-0-8805" ref-type="bibr">10</xref>), thus shortening the time to diagnosis.</p>
<p>Diffusion weighted MRI (DWI) reflects the movement of water within tissues by measuring the degree of random molecular motion, which is quantified by the apparent diffusion coefficient (ADC) value. Previous studies (<xref rid="b11-ol-0-0-8805" ref-type="bibr">11</xref>,<xref rid="b12-ol-0-0-8805" ref-type="bibr">12</xref>) used DWI as an additional tool for diagnosing breast cancer and found that the ADC is significantly lower in malignant tumors than in benign breast lesions or normal tissue. The observed low ADC values associated with malignancy are mainly due to high cell density, which causes increased restriction of the extracellular matrix and increased fraction of signal from intracellular water (<xref rid="b11-ol-0-0-8805" ref-type="bibr">11</xref>). Through combined ADC and dynamic contrast-enhanced kinetics, the diagnostic accuracy of breast MRI has improved (<xref rid="b13-ol-0-0-8805" ref-type="bibr">13</xref>). Yabuuchi <italic>et al</italic> (<xref rid="b14-ol-0-0-8805" ref-type="bibr">14</xref>) reported a high accuracy for enhancing breast masses through a combination of DWI and DCE-MRI features. However, the interpretation of breast DCE-MRI imaging is mainly based on judgments from radiologists; it will be beneficiary to derive discrimination rules provided by CAD. To the best of our knowledge, no published studies have conducted a robust assessment by incorporating morphology and texture features, and kinetic features provided by CAD and ADC into a multivariable diagnostic model for the discrimination of breast masses.</p>
<p>The purpose of this study was to retrospectively investigate whether combining morphology, texture features and kinetic features with ADC using quantitative analysis improves the accuracy for differentiating between benign and malignant breast lesions in MRI.</p>
</sec>
<sec sec-type="materials|methods">
<title>Materials and methods</title>
<sec>
<title/>
<sec>
<title>Patients and lesions</title>
<p>In total, 320 patients came to Sun Yat-sen University Cancer Center for clinically indicated bilateral breast MRI between September 2008 and December 2011. The patients&#x0027; breast MRI examinations were retrospectively reviewed. The MRI studies of 205 women with 275 breast lesions met the following inclusion criteria in the present study: i) MRI was performed using a 1.5-T magnet; ii) both DCE-MRI imaging and DWI imaging sequences were performed; iii) diagnosis was confirmed following pathological analysis subsequent to core-needle biopsy or surgical excision (248 lesions), or lesion stability was confirmed at a minimum follow-up of 2 years (27 lesions); iv) lesions presented as a mass according to the breast imaging reporting and data system MRI lexicon; and v) patients had not received a biopsy or received therapy prior to MRI examination. Of the 320 patients, 23 were excluded for not having a suspicious abnormality on dynamic images, 40 were excluded for non-mass-like enhancement, 16 were excluded because their pathological results were not determined, 20 were excluded for having lesions without a sufficient follow-up period, and 16 were excluded for inadequate fat suppression on DWI images.</p>
</sec>
<sec>
<title>MRI image acquisition</title>
<p>Imaging was performed with a GE Signa HDx 1.5-T superconductive magnetic system, using a bilateral, dedicated four-channel phased-array breast coil in the prone position. Standard imaging was performed, including an axial fast spin echo (FSE) T1WI and an axial and sagittal FSE T2WI. Subsequently, DWI images were acquired in the axial planes, prior to gadolinium-based contrast material injection, using: A spin-echo single-shot echo planar imaging sequence; array spatial sensitivity encoding technique (acceleration factor of two); b values of 0 and 800 sec/mm<sup>2</sup>; fat suppression; 5,000/75 (repetition time msec/echo time msec); 5 mm section thickness; a 30&#x00D7;30 cm field of view; a 128&#x00D7;128 matrix; 0 mm section gap; and 130 sec acquisition time.</p>
<p>Subsequently, after one set of unenhanced baseline images, dynamic contrast-enhanced MRI data were acquired using an MRI-specific automatic power injector (Medrad Inc., Pittsburgh, PA, USA) to inject 0.1 mmol/kg body weight contrast medium gadolinium diethylenetriamine penta-acetic acid (Gd-DTPA), with a hand venipuncture technique at a rate of 3 ml/sec. Saline (10 ml at 3 ml/sec) was then injected to wash the tube. Dynamic scanning was initiated by simultaneously pushing the high-pressure syringe button and the dynamic scan button. Nine post-contrast sets were acquired. Each sequence was performed in the sagittal plane at 20 sec intervals with fat suppression using: Three-dimensional spoiled gradient recall echo sequence; 5.5/2.6 repetition time msec/echo time msec; 3.4 mm slice thickness; 15&#x00B0; flip angle; a 22&#x00D7;22 cm field of view; a 288&#x00D7;192 matrix; and a 59 sec acquisition time. Subsequently, axial MRI was employed using fat-suppressed enhanced T1WI sequence.</p>
</sec>
<sec>
<title>Data analyses</title>
<p>All images were analyzed independently by two radiologists with ten years experience in interpreting breast MRI. They were blinded to the histological results of current patients. The images were assessed independently and any disagreements were resolved by achieving consensus. All lesions were assessed using The Breast Imaging Reporting and Data System (BI-RADS) (<xref rid="b15-ol-0-0-8805" ref-type="bibr">15</xref>). BI-RADS category 1 (negative) and category 2 (benign) denote an essentially 0&#x0025; likelihood of cancer. BI-RADS category 3 (probably benign) assessment is more intuitive and can be recommended in the case of a unique focal finding for which the likelihood of malignancy is &#x2265;0&#x0025; but &#x2264;2&#x0025;. BI-RADS category 4 (suspicious) and category 5 (highly suggestive of malignancy) describe MRI findings that are suspicious enough to warrant tissue diagnosis. BI-RADS category 6 (known biopsy-proven malignancy) describes MRI findings of biopsy-proven breast cancer for which surgical excision is recommended when clinically appropriate. All images were analyzed on a workstation (Centricity Radiology RA 600 V 7.0; GE Healthcare, Chicago, IL, USA). All quantitative analysis software was written in MATLAB (MathWorks, Natick, MA, USA; <uri xlink:href="http//www.mathworks.com">http//www.mathworks.com</uri>).</p>
</sec>
<sec>
<title>Analysis of lesion kinetics</title>
<p>For kinetic analysis, time-signal intensity curves were obtained from manually drawn regions of interest (ROIs), the size of which varied with the size of the enhancing lesion and were chosen to selectively include the area with the strongest enhancement, as identified on the first post contrast subtracted image. The early-phase enhancement rate and the signal enhancement ratio (SER) (<xref rid="b16-ol-0-0-8805" ref-type="bibr">16</xref>) were quantified by means of an ROI-based determination of lesion signal intensity prior and subsequent to the injection of Gd-DTPA. The early-phase enhancement was calculated according to the enhancement formula (SI<sub>1</sub>-SI<sub>0</sub>)/SI<sub>0</sub> &#x00D7;100 (<xref rid="b17-ol-0-0-8805" ref-type="bibr">17</xref>) and SER was defined as (SI<sub>1</sub>-SI<sub>0</sub>)/(SI<sub>last</sub>-SI<sub>0</sub>), where SI<sub>0</sub>, SI<sub>1</sub>, and SI<sub>last</sub> represent the signal intensity in the pre-contrast, the first post-contrast and the last images, respectively.</p>
</sec>
<sec>
<title>Analysis of morphological and texture features</title>
<p>Following manual lesion identification, automatic segmentation was undertaken for lesion contours. The segmentation used a novel two-step approach that incorporated fuzzy c-means (FCM) clustering (<xref rid="b18-ol-0-0-8805" ref-type="bibr">18</xref>) and gradient vector flow snake algorithm (<xref rid="b19-ol-0-0-8805" ref-type="bibr">19</xref>). The FCM clustering based method was used to obtain initialization for commencement of segmentation while the gradient vector flow snake model was further applied to obtain the exact segmentation (<xref rid="f1-ol-0-0-8805" ref-type="fig">Fig. 1</xref>). A total of 13 texture features were estimated from the gray level co-occurrence matrix (GLCM) (<xref rid="b20-ol-0-0-8805" ref-type="bibr">20</xref>). The parameters included: Angular second moment; contrast; correlation; inverse difference moment; sum average; sum variance; sum entropy; entropy; difference average; difference variance; difference entropy; information measure of correlation 1; and information measure of correlation 2 (<xref rid="b21-ol-0-0-8805" ref-type="bibr">21</xref>). In total, 11 morphological features, including compactness, spiculation, extent, elongation, solidity, circularity, entropy of radial length distribution, fractal, heterogeneity, area and eccentricity, were also computed (<xref rid="b22-ol-0-0-8805" ref-type="bibr">22</xref>).</p>
<p>Breast masses in the study were all verified histopathologically (<xref rid="tI-ol-0-0-8805" ref-type="table">Table I</xref>), or the diagnosis was confirmed following at &#x2265;2 years of follow-up. Lesion status was used as baseline for statistical evaluation of the performance of the features. The whole patients set was randomly divided into two sets, one for classifier training and the other for testing the performance of the classifier. The ten-fold cross validation scheme was used to evaluate and find the classifier with the best performance.</p>
</sec>
<sec>
<title>Analysis of ADC</title>
<p>The ROIs were manually drawn on the diffusion-weighted images (b=800 s/mm<sup>2</sup>; <xref rid="f2-ol-0-0-8805" ref-type="fig">Figs. 2</xref> and <xref rid="f3-ol-0-0-8805" ref-type="fig">3</xref>) and were placed in regions with high signal intensity on the images. The contrast and morphological characteristics at the early phase of contrast-enhanced T1-weighted imaging and T2-weighted imaging were used to guide ROI placement to prevent areas of T2 shine-through, which was usually found in necrotic or cystic parts. The ROIs were defined as the area slightly smaller than the actual lesions to reduce partial volume effects. In the current study, all ROIs were &#x003E;20 mm<sup>2</sup> (<xref rid="b23-ol-0-0-8805" ref-type="bibr">23</xref>). The DWI intensity for each lesion was classified as high or low compared to that of the corresponding background breast tissue. The mean ADC of the voxels in ROIs were then obtained.</p>
</sec>
<sec>
<title>Statistical analysis</title>
<p>Morphological features were shown to perform well in terms of discriminating lesion types (<xref rid="b8-ol-0-0-8805" ref-type="bibr">8</xref>). Meanwhile, using the textural or kinetic measurements alone can also shade light in the characteristics of lesions, shown in <xref rid="tII-ol-0-0-8805" ref-type="table">Table II</xref>. Therefore, the combination of the merits of the characterization parameters, including morphological, textural and kinetic measurements, was expected to achieve a better, or at least comparable performance compared with individual measurements. The combination of the parameters as whole reflected different aspects of lesion properties and was a potentially comprehensive approach to the characterization of lesion status.</p>
<p>In total, 24 features were initially estimated from the segmented lesion image. Since the features may be self-dependent or irrelevant to the lesion type, an exhaustive feature selection method was used to find an optimal feature subset in which the classification accuracy is highest (<xref rid="b24-ol-0-0-8805" ref-type="bibr">24</xref>). The differentiation of malignant from benign lesions was treated as a two-class pattern classification problem. A newly reported classification model, the difference-weighted local hyperplane classification model (DWLH), was used to select the feature subset and to evaluate the performance of the combined feature subsets (<xref rid="b25-ol-0-0-8805" ref-type="bibr">25</xref>). In the classification model, a local hyperplane is constructed from its nearest neighbor for each observed sample. The label of the sample is decided by the minimized distance to its class-dependent hyperplane. The performance of the model is superior to that of the classical k-nearest neighbors algorithm in that the local hyperplane is robust to noises and outliers (<xref rid="b26-ol-0-0-8805" ref-type="bibr">26</xref>). The present study selected DWLH, not only because of its superior performance over classical models, including the support vector machine, but also as a result of the rationale behind its mathematical formulation (<xref rid="b27-ol-0-0-8805" ref-type="bibr">27</xref>). Since lesions usually share certain pictorial similarities among patients with the same type lesions, the status of lesion could be deducted from its nearest neighbors, other than particular one as k-nearest neighbors does. This follows the same rationale with the classifier of DWLH.</p>
<p>To test the discrimination power of different characterization of breast masses, the whole dataset where categorized into six subgroups including morphology, kinetics, texture features and their combinations. To further evaluate the discrimination power of ADC, various characteristics of breast masses were combined with/without ADC, resulting another three data subgroups. On each subgroup, the classifier of DWLH was evaluated via ten-fold cross validation scheme. For each experiment, the averaged accuracy and AUC were calculated to serve as criteria of the feature performance. To eliminate the statistical variations during the training phase, the present study conducted 10 classification experiments independently on each dataset. The averaged classification error was recorded and is presented in <xref rid="tIII-ol-0-0-8805" ref-type="table">Table III</xref>. Receiver operating characteristic (ROC) analysis was also used to evaluate the diagnostic performance of the model under various features. The area under the ROC curve (AUC) served as the criterion for selecting the best combination.</p>
</sec>
</sec>
</sec>
<sec sec-type="results">
<title>Results</title>
<p>In total, 205 women with 275 lesions met the inclusion criteria. The mean age of these patients was 46.2&#x00B1;10.9 years (age range, 18&#x2013;78 years). A total of 48 lesions were assessed as probably benign finding (BI-RADS category 3), 147 were assessed as suspicious (BI-RADS category 4), and 80 were assessed as highly suggestive of malignancy (BI-RADS category 5). <xref rid="tI-ol-0-0-8805" ref-type="table">Table I</xref> exhibits the distribution of histopathological findings of all analyzed lesions. The mean lesion size, defined as the longest dimension on DCE-MRI images, was 1.3&#x00B1;2.1 cm (range, 0.5&#x2013;3.0 cm) for benign lesions and 2.8&#x00B1;1.5 cm (range, 1.5&#x2013;5.0 cm) for malignant lesions.</p>
<sec>
<title/>
<sec>
<title>Diagnostic performance of morphological and kinetic features</title>
<p>Segmentation results of randomly selected sample breast lesion can be seen in <xref rid="f1-ol-0-0-8805" ref-type="fig">Fig. 1</xref>. In total, 6 features performed optimally in terms of prediction. The features included two shape (heterogeneity, area) and three texture (sum variance, sum entropy, difference entropy) parameters and one kinetic parameter (SER).</p>
<p>The diagnostic performance of each feature used in the experiment classifier was also evaluated individually. The mean and standard deviation and the diagnostic performance of the 6 selected parameters are summarized in <xref rid="tII-ol-0-0-8805" ref-type="table">Table II</xref>. Among the 6 parameters, the diagnostic accuracy of SER was the highest.</p>
<p>Utilization of 5 anatomical features, including texture and shape parameters, resulted in an AUC of 0.68. The kinetic parameter SER reached a comparable AUC of 0.84. When combining these 6 parameters into a unified diagnostic model, the AUC was further improved to 0.86. This combined classifier achieved a sensitivity of 0.81 and a specificity of 0.91 with a diagnostic accuracy of 0.87 (<xref rid="tIII-ol-0-0-8805" ref-type="table">Table III</xref>).</p>
</sec>
<sec>
<title>Diagnostic performance of ADC value</title>
<p>A malignant lesion and a benign lesion can be seen in <xref rid="f2-ol-0-0-8805" ref-type="fig">Fig. 2</xref> and in <xref rid="f3-ol-0-0-8805" ref-type="fig">Fig. 3</xref>, respectively. The box plot of the ADC for all patients is shown in <xref rid="f4-ol-0-0-8805" ref-type="fig">Fig. 4</xref>. An overlap of ADC was observed between malignant and benign breast lesions. The mean ADC of malignant lesions (mean, 1.16&#x00D7;10<sup>&#x2212;3</sup> mm<sup>2</sup>/sec; 95&#x0025; CI, 1.13&#x00D7;10<sup>&#x2212;3</sup> mm<sup>2</sup>/sec; 1.20&#x00D7;10<sup>&#x2212;3</sup> mm<sup>2</sup>/sec) was significantly lower than that observed for benign lesions (P&#x003C;0.05; mean, 1.68&#x00D7;10<sup>&#x2212;3</sup> mm<sup>2</sup>/sec; 95&#x0025; CI, 1.62&#x00D7;10<sup>&#x2212;3</sup> mm<sup>2</sup>/sec; 1.75&#x00D7;10<sup>&#x2212;3</sup> mm<sup>2</sup>/sec). The predictive accuracy (sensitivity, specificity) of mean ADC was 0.84 (0.78 and 0.90, respectively; <xref rid="tIII-ol-0-0-8805" ref-type="table">Table III</xref>). Thus, a threshold value of 1.37&#x00D7;10<sup>&#x2212;3</sup> mm<sup>2</sup>/sec can achieve a specificity of 0.90, with a sensitivity of 0.78, to discriminate between malignant and benign lesions.</p>
</sec>
<sec>
<title>Analysis of the model combining morphology and kinetic features with ADC values</title>
<p>When the ADC value was incorporated into the feature sets, the sensitivity, specificity and accuracy of the classification model increased to 0.85, 0.94 and 0.90, respectively (<xref rid="tIII-ol-0-0-8805" ref-type="table">Table III</xref>). The value of AUC was dramatically increased from 0.86 to 0.90 by incorporating without/with using ADC (<xref rid="f5-ol-0-0-8805" ref-type="fig">Fig. 5</xref>). It implies that the ADC possesses the potential power in discriminating benign masses from malignant ones. It also suggests that addition of ADC values enhances the discriminatory power of the combined feature set.</p>
</sec>
</sec>
</sec>
<sec sec-type="discussion">
<title>Discussion</title>
<p>The results of the present study demonstrate that incorporating morphology and texture features, kinetic features and ADC into a multivariable diagnostic model in breast MRI increases diagnostic accuracy. Although previous studies have demonstrated that the combination of DWI and DCE-MRI can result in high diagnostic accuracy (<xref rid="b28-ol-0-0-8805" ref-type="bibr">28</xref>), and the addition of DWI to DCE-MRI improves the positive predictive value (PPV) of breast MRI (<xref rid="b23-ol-0-0-8805" ref-type="bibr">23</xref>), the assessments were mainly based on the subjective expertise of individual radiologists. In the current study, the undertaken contrast-enhanced breast images were analyzed by professional CAD software, which ensured less human interference and produced definitive parameters. A series of quantitative analysis was then followed to study the discrimination potentials of the images. El Khouli <italic>et al</italic> (<xref rid="b29-ol-0-0-8805" ref-type="bibr">29</xref>) demonstrated that quantitative assessment of the type of contrast enhancement kinetic curve on breast DCE-MRI for establishing or excluding malignancy is superior to standard qualitative assessment.</p>
<p>The present study applied quantitative analysis to characterize the morphology, texture and kinetic features of breast lesions and used advanced machine learning techniques to obtain a classifier for differential diagnosis. A total of 11 morphology, 13 GLCM texture and 2 kinetic features were extracted in order to characterize each lesion. Furthermore, 2 shape (heterogeneity, area) and 3 texture (sum variance, sum entropy, difference entropy) parameters and 1 kinetic parameter (SER) were selected by DWLH using ten-fold cross validation. The diagnostic performance based on 2 shape features (heterogeneity, area) and 3 texture features (sum variance, sum entropy, difference entropy) reached an AUC value of 0.68. Using the kinetic parameter SER it reached a comparable AUC of 0.84. When all 6 parameters were combined, the resulting AUC improved further to 0.86. This finding demonstrates that the combination of the kinetic enhancement data and morphology information in a systematic model is the most effective and comprehensive approach to the diagnosis of breast masses. These results are consistent with those of Newell <italic>et al</italic> (<xref rid="b28-ol-0-0-8805" ref-type="bibr">28</xref>). The performance of the shape and textural features (AUC=0.68) in the present study is evidently lower than that of kinetic parameter SER (AUC=0.84), which is different from the results of Newell <italic>et al</italic> (<xref rid="b28-ol-0-0-8805" ref-type="bibr">28</xref>) who received an AUC of 0.87 when using morphological features to separate between benign and malignant breast masses and a comparable value of 0.88 when using the kinetic parameters.</p>
<p>In particular, it was found that SER was an effective kinetic feature for the diagnosis of breast masses. Its AUC value was the highest among all the parameters when measured individually. SER has the advantage of being able to depict the heterogeneous microvascular network in breast cancers (<xref rid="b30-ol-0-0-8805" ref-type="bibr">30</xref>). High SER corresponded to early signal enhancement, with rapid washout of intravenous contrast reflecting high tumor vascularity. Similarly, low SER correlated with slow and sustained enhancement of contrast, reflecting low tumor vascularity (<xref rid="b31-ol-0-0-8805" ref-type="bibr">31</xref>). SER, based on changes in signal intensity between 3 time points, is an effective kinetic parameter in the present study. However, it may be affected by the selection of time points, by the magnet strength, the sequence parameters (repetition time, echo time, flip angle) and by the contrast agent concentration. Therefore, with a different selection of sequence parameters, or a different selection of time points, different SER values could be derived, and the diagnostic effectiveness of SER may be altered.</p>
<p>Contrast-enhanced MRI imaging reflects the tumor vascular bed and ADC has been demonstrated to correlate with tumor cellularity density in breast cancer (<xref rid="b32-ol-0-0-8805" ref-type="bibr">32</xref>). The present results reveal that diagnostic accuracy is increased when the morphological and kinetic features are combined with the ADC value. This finding suggests that DWI may yield information different from and complementary to that obtained with DCE-MRI (<xref rid="b33-ol-0-0-8805" ref-type="bibr">33</xref>).</p>
<p>Additionally, the mean ADC of malignant lesions (mean, 1.16&#x00D7;10<sup>&#x2212;3</sup> mm<sup>2</sup>/sec; 95&#x0025; CI, 1.13&#x00D7;10<sup>&#x2212;3</sup> mm<sup>2</sup>/sec, 1.20&#x00D7;10<sup>&#x2212;3</sup> mm<sup>2</sup>/sec) in the present study was significantly lower than that observed for benign lesions (P&#x003C;0.05; mean, 1.68&#x00D7;10<sup>&#x2212;3</sup> mm<sup>2</sup>/se; 95&#x0025; CI, 1.62&#x00D7;10<sup>&#x2212;3</sup> mm<sup>2</sup>/sec; 1.75&#x00D7;10<sup>&#x2212;3</sup> mm<sup>2</sup>/sec), which are similar results to other studies (<xref rid="b11-ol-0-0-8805" ref-type="bibr">11</xref>,<xref rid="b23-ol-0-0-8805" ref-type="bibr">23</xref>). The diagnostic accuracy of DW imaging performed in the present study was 0.87, which is slightly higher than previous studies (<xref rid="b33-ol-0-0-8805" ref-type="bibr">33</xref>,<xref rid="b34-ol-0-0-8805" ref-type="bibr">34</xref>). It may be that the current study only evaluates breast mass lesions, while the prior studies evaluate MRI-detected mass and non-mass lesions. Besides, the present DW imaging protocol is different.</p>
<p>There were several limitations to the current study. The lesion segmentation was conducted in two-dimensions and high dimensional description is needed to provide rich spatial information. However, the segmentation algorithm was based on enhanced lesion images, and sequences of two-dimensional images can reflect spatial variations accurately. The present study also had technical limitations. The DW examinations were acquired with relatively thick slices (5 mm) in order to achieve an adequate signal-to-noise ratio. Partial volume averaging within imaging slices may affect the visibility of a number of lesions on DWI. This limitation could be overcome by utilizing longer scanning times or by imaging at higher field strengths (<xref rid="b35-ol-0-0-8805" ref-type="bibr">35</xref>). Finally, the current study excluded the non-mass lesions. This is as non-mass-like enhancement lesions exhibit poorly defined boundaries, which results in difficulty in the analysis of morphology. Diagnosis of non-mass lesions is much more challenging. However, kinetics and ADC analysis may be applied to characterize non-mass lesions. The evaluation of non-mass lesions may be an important next step.</p>
<p>To conclude, it was found that combining ADC with quantitative morphology, texture features and kinetic features improves the accuracy of characterization of breast lesions that present as a mass. These integrated characteristic parameters are promising in terms of generating an overall diagnostic marker for breast masses, which can achieve high levels of diagnostic accuracy.</p>
</sec>
</body>
<back>
<ack>
<title>Acknowledgments</title>
<p>Not applicable.</p>
</ack>
<sec>
<title>Funding</title>
<p>The present study was funded by the Science and Technology Planning Project of Guangdong Province, China (grant nos. 2016B090918066, 2016A010101013 and 2017B020226004), the Science and Technology Program of Guangzhou, China (grant nos. 201704020060 and 201807010057), and the Health and Medical Collaborative Innovation Project of Guangzhou City (grant nos. 201604020003 and 201803010021).</p>
</sec>
<sec>
<title>Availability of data and materials</title>
<p>The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.</p>
</sec>
<sec>
<title>Authors&#x0027; contributions</title>
<p>XJ, FX and LZL performed data collection, data analysis, manuscript drafting and revision. YP aided in the image data collection and data analysis. HC and LL initially developed the concept of the study and contributed in writing the manuscript and all revisions. All authors read and approved the final manuscript.</p>
</sec>
<sec>
<title>Ethics approval and consent to participate</title>
<p>The study was approved by the Ethics Committee of Sun Yat-sen University Cancer Center (Guangzhou, China).</p>
</sec>
<sec>
<title>Consent for publication</title>
<p>All participants provided informed consent for the publication of this data.</p>
</sec>
<sec>
<title>Competing interests</title>
<p>The authors declare that they have no competing interests.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="b1-ol-0-0-8805"><label>1</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Sardanelli</surname><given-names>F</given-names></name><name><surname>Boetes</surname><given-names>C</given-names></name><name><surname>Borisch</surname><given-names>B</given-names></name><name><surname>Decker</surname><given-names>T</given-names></name><name><surname>Federico</surname><given-names>M</given-names></name><name><surname>Gilbert</surname><given-names>FJ</given-names></name><name><surname>Helbich</surname><given-names>T</given-names></name><name><surname>Heywang-K&#x00F6;brunner</surname><given-names>SH</given-names></name><name><surname>Kaiser</surname><given-names>WA</given-names></name><name><surname>Kerin</surname><given-names>MJ</given-names></name><etal/></person-group><article-title>Magnetic resonance imaging of the breast: Recommendations from the EUSOMA working group</article-title><source>Eur J Cancer</source><volume>46</volume><fpage>1296</fpage><lpage>1316</lpage><year>2010</year><pub-id pub-id-type="doi">10.1016/j.ejca.2010.02.015</pub-id><pub-id pub-id-type="pmid">20304629</pub-id></element-citation></ref>
<ref id="b2-ol-0-0-8805"><label>2</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kuhl</surname><given-names>CK</given-names></name><name><surname>Schrading</surname><given-names>S</given-names></name><name><surname>Leutner</surname><given-names>CC</given-names></name><name><surname>Morakkabati-Spitz</surname><given-names>N</given-names></name><name><surname>Wardelmann</surname><given-names>E</given-names></name><name><surname>Fimmers</surname><given-names>R</given-names></name><name><surname>Kuhn</surname><given-names>W</given-names></name><name><surname>Schild</surname><given-names>HH</given-names></name></person-group><article-title>Mammography, breast ultrasound, and magnetic resonance imaging for surveillance of women at high familial risk for breast cancer</article-title><source>J Clin Oncol</source><volume>23</volume><fpage>8469</fpage><lpage>8476</lpage><year>2005</year><pub-id pub-id-type="doi">10.1200/JCO.2004.00.4960</pub-id><pub-id pub-id-type="pmid">16293877</pub-id></element-citation></ref>
<ref id="b3-ol-0-0-8805"><label>3</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schelfout</surname><given-names>K</given-names></name><name><surname>van Goethem</surname><given-names>M</given-names></name><name><surname>Kersschot</surname><given-names>E</given-names></name><name><surname>Colpaert</surname><given-names>C</given-names></name><name><surname>Schelfhout</surname><given-names>AM</given-names></name><name><surname>Leyman</surname><given-names>P</given-names></name><name><surname>Verslegers</surname><given-names>I</given-names></name><name><surname>Biltjes</surname><given-names>I</given-names></name><name><surname>van den Haute</surname><given-names>J</given-names></name><name><surname>Gillardin</surname><given-names>JP</given-names></name><etal/></person-group><article-title>Contrast-enhanced MR imaging of breast lesions and effect on treatment</article-title><source>Eur J Surg Oncol</source><volume>30</volume><fpage>501</fpage><lpage>507</lpage><year>2004</year><pub-id pub-id-type="doi">10.1016/j.ejso.2004.02.003</pub-id><pub-id pub-id-type="pmid">15135477</pub-id></element-citation></ref>
<ref id="b4-ol-0-0-8805"><label>4</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Tillman</surname><given-names>GF</given-names></name><name><surname>Orel</surname><given-names>SG</given-names></name><name><surname>Schnall</surname><given-names>MD</given-names></name><name><surname>Schultz</surname><given-names>DJ</given-names></name><name><surname>Tan</surname><given-names>JE</given-names></name><name><surname>Solin</surname><given-names>LJ</given-names></name></person-group><article-title>Effect of breast magnetic resonance imaging on the clinical management of women with early-stage breast carcinoma</article-title><source>J Clin Oncol</source><volume>20</volume><fpage>3413</fpage><lpage>3423</lpage><year>2002</year><pub-id pub-id-type="doi">10.1200/JCO.2002.08.600</pub-id><pub-id pub-id-type="pmid">12177101</pub-id></element-citation></ref>
<ref id="b5-ol-0-0-8805"><label>5</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Semiglazov</surname><given-names>V</given-names></name></person-group><article-title>Recist for response (clinical and imaging) in neoadjuvant clinical trials in operable breast cancer</article-title><source>J Natl Cancer Inst Monogr</source><volume>2015</volume><fpage>21</fpage><lpage>23</lpage><year>2015</year><pub-id pub-id-type="doi">10.1093/jncimonographs/lgv021</pub-id><pub-id pub-id-type="pmid">26063880</pub-id></element-citation></ref>
<ref id="b6-ol-0-0-8805"><label>6</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Iwasa</surname><given-names>H</given-names></name><name><surname>Kubota</surname><given-names>K</given-names></name><name><surname>Hamada</surname><given-names>N</given-names></name><name><surname>Nogami</surname><given-names>M</given-names></name><name><surname>Nishioka</surname><given-names>A</given-names></name></person-group><article-title>Early prediction of response to neoadjuvant chemotherapy in patients with breast cancer using diffusion-weighted imaging and gray-scale ultrasonography</article-title><source>Oncol Rep</source><volume>31</volume><fpage>1555</fpage><lpage>1560</lpage><year>2014</year><pub-id pub-id-type="doi">10.3892/or.2014.3025</pub-id><pub-id pub-id-type="pmid">24535214</pub-id></element-citation></ref>
<ref id="b7-ol-0-0-8805"><label>7</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Jansen</surname><given-names>SA</given-names></name><name><surname>Fan</surname><given-names>X</given-names></name><name><surname>Karczmar</surname><given-names>GS</given-names></name><name><surname>Abe</surname><given-names>H</given-names></name><name><surname>Schmidt</surname><given-names>RA</given-names></name><name><surname>Giger</surname><given-names>M</given-names></name><name><surname>Newstead</surname><given-names>GM</given-names></name></person-group><article-title>DCEMRI of breast lesions: Is kinetic analysis equally effective for both mass and nonmass-like enhancement?</article-title><source>Med Phys</source><volume>35</volume><fpage>3102</fpage><lpage>3109</lpage><year>2008</year><pub-id pub-id-type="doi">10.1118/1.2936220</pub-id><pub-id pub-id-type="pmid">18697535</pub-id></element-citation></ref>
<ref id="b8-ol-0-0-8805"><label>8</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Malich</surname><given-names>A</given-names></name><name><surname>Fischer</surname><given-names>DR</given-names></name><name><surname>Wurdinger</surname><given-names>S</given-names></name><name><surname>Boettcher</surname><given-names>J</given-names></name><name><surname>Marx</surname><given-names>C</given-names></name><name><surname>Facius</surname><given-names>M</given-names></name><name><surname>Kaiser</surname><given-names>WA</given-names></name></person-group><article-title>Potential MRI interpretation model: Differentiation of benign from malignant breast masses</article-title><source>AJR Am J Roentgenol</source><volume>185</volume><fpage>964</fpage><lpage>970</lpage><year>2005</year><pub-id pub-id-type="doi">10.2214/AJR.04.1073</pub-id><pub-id pub-id-type="pmid">16177416</pub-id></element-citation></ref>
<ref id="b9-ol-0-0-8805"><label>9</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kuhl</surname><given-names>CK</given-names></name></person-group><article-title>MRI of breast tumors</article-title><source>Eur Radiol</source><volume>10</volume><fpage>46</fpage><lpage>58</lpage><year>2000</year><pub-id pub-id-type="doi">10.1007/s003300050006</pub-id><pub-id pub-id-type="pmid">10663717</pub-id></element-citation></ref>
<ref id="b10-ol-0-0-8805"><label>10</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Jiang</surname><given-names>Y</given-names></name><name><surname>Nishikawa</surname><given-names>RM</given-names></name><name><surname>Schmidt</surname><given-names>RA</given-names></name><name><surname>Metz</surname><given-names>CE</given-names></name><name><surname>Giger</surname><given-names>ML</given-names></name><name><surname>Doi</surname><given-names>K</given-names></name></person-group><article-title>Improving breast cancer diagnosis with computer-aided diagnosis</article-title><source>Acad Radiol</source><volume>6</volume><fpage>22</fpage><lpage>33</lpage><year>1999</year><pub-id pub-id-type="doi">10.1016/S1076-6332(99)80058-0</pub-id><pub-id pub-id-type="pmid">9891149</pub-id></element-citation></ref>
<ref id="b11-ol-0-0-8805"><label>11</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hatakenaka</surname><given-names>M</given-names></name><name><surname>Soeda</surname><given-names>H</given-names></name><name><surname>Yabuuchi</surname><given-names>H</given-names></name><name><surname>Matsuo</surname><given-names>Y</given-names></name><name><surname>Kamitani</surname><given-names>T</given-names></name><name><surname>Oda</surname><given-names>Y</given-names></name><name><surname>Tsuneyoshi</surname><given-names>M</given-names></name><name><surname>Honda</surname><given-names>H</given-names></name></person-group><article-title>Apparent diffusion coefficients of breast tumors: Clinical application</article-title><source>Magn Reson Med Sci</source><volume>7</volume><fpage>23</fpage><lpage>29</lpage><year>2008</year><pub-id pub-id-type="doi">10.2463/mrms.7.23</pub-id><pub-id pub-id-type="pmid">18460845</pub-id></element-citation></ref>
<ref id="b12-ol-0-0-8805"><label>12</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rubesova</surname><given-names>E</given-names></name><name><surname>Grell</surname><given-names>AS</given-names></name><name><surname>de Maertelaer</surname><given-names>V</given-names></name><name><surname>Metens</surname><given-names>T</given-names></name><name><surname>Chao</surname><given-names>SL</given-names></name><name><surname>Lemort</surname><given-names>M</given-names></name></person-group><article-title>Quantitative diffusion imaging in breast cancer: A clinical prospective study</article-title><source>J Magn Reson Imaging</source><volume>24</volume><fpage>319</fpage><lpage>324</lpage><year>2006</year><pub-id pub-id-type="doi">10.1002/jmri.20643</pub-id><pub-id pub-id-type="pmid">16786565</pub-id></element-citation></ref>
<ref id="b13-ol-0-0-8805"><label>13</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Partridge</surname><given-names>SC</given-names></name><name><surname>Rahbar</surname><given-names>H</given-names></name><name><surname>Murthy</surname><given-names>R</given-names></name><name><surname>Chai</surname><given-names>X</given-names></name><name><surname>Kurland</surname><given-names>BF</given-names></name><name><surname>DeMartini</surname><given-names>WB</given-names></name><name><surname>Lehman</surname><given-names>CD</given-names></name></person-group><article-title>Improved diagnostic accuracy of breast MRI through combined apparent diffusion coefficients and dynamic contrast-enhanced kinetics</article-title><source>Magn Reson Med</source><volume>65</volume><fpage>1759</fpage><lpage>1767</lpage><year>2011</year><pub-id pub-id-type="doi">10.1002/mrm.22762</pub-id><pub-id pub-id-type="pmid">21254208</pub-id></element-citation></ref>
<ref id="b14-ol-0-0-8805"><label>14</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yabuuchi</surname><given-names>H</given-names></name><name><surname>Matsuo</surname><given-names>Y</given-names></name><name><surname>Okafuji</surname><given-names>T</given-names></name><name><surname>Kamitani</surname><given-names>T</given-names></name><name><surname>Soeda</surname><given-names>H</given-names></name><name><surname>Setoguchi</surname><given-names>T</given-names></name><name><surname>Sakai</surname><given-names>S</given-names></name><name><surname>Hatakenaka</surname><given-names>M</given-names></name><name><surname>Kubo</surname><given-names>M</given-names></name><name><surname>Sadanaga</surname><given-names>N</given-names></name><etal/></person-group><article-title>Enhanced mass on contrast-enhanced breast MR imaging: Lesion characterization using combination of dynamic contrast-enhanced and diffusion-weighted MR images</article-title><source>J Magn Reson Imaging</source><volume>28</volume><fpage>1157</fpage><lpage>1165</lpage><year>2008</year><pub-id pub-id-type="doi">10.1002/jmri.21570</pub-id><pub-id pub-id-type="pmid">18972357</pub-id></element-citation></ref>
<ref id="b15-ol-0-0-8805"><label>15</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shin</surname><given-names>K</given-names></name><name><surname>Phalak</surname><given-names>K</given-names></name><name><surname>Hamame</surname><given-names>A</given-names></name><name><surname>Whitman</surname><given-names>GJ</given-names></name></person-group><article-title>Interpretation of breast MRI utilizing the bi-rads fifth edition lexicon: How are we doing and where are we headed?</article-title><source>Curr Probl Diagn Radiol</source><volume>46</volume><fpage>26</fpage><lpage>34</lpage><year>2017</year><pub-id pub-id-type="doi">10.1067/j.cpradiol.2015.12.001</pub-id><pub-id pub-id-type="pmid">26826797</pub-id></element-citation></ref>
<ref id="b16-ol-0-0-8805"><label>16</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hylton</surname><given-names>NM</given-names></name></person-group><article-title>Vascularity assessment of breast lesions with gadolinium-enhanced MR imaging</article-title><source>Magn Reson Imaging Clin N Am</source><volume>9</volume><fpage>321</fpage><lpage>332</lpage><year>2001</year><pub-id pub-id-type="pmid">11493422</pub-id></element-citation></ref>
<ref id="b17-ol-0-0-8805"><label>17</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kuhl</surname><given-names>CK</given-names></name><name><surname>Mielcareck</surname><given-names>P</given-names></name><name><surname>Klaschik</surname><given-names>S</given-names></name><name><surname>Leutner</surname><given-names>C</given-names></name><name><surname>Wardelmann</surname><given-names>E</given-names></name><name><surname>Gieseke</surname><given-names>J</given-names></name><name><surname>Schild</surname><given-names>HH</given-names></name></person-group><article-title>Dynamic breast MR imaging: Are signal intensity time course data useful for differential diagnosis of enhancing lesions?</article-title><source>Radiology</source><volume>211</volume><fpage>101</fpage><lpage>110</lpage><year>1999</year><pub-id pub-id-type="doi">10.1148/radiology.211.1.r99ap38101</pub-id><pub-id pub-id-type="pmid">10189459</pub-id></element-citation></ref>
<ref id="b18-ol-0-0-8805"><label>18</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wu</surname><given-names>K</given-names></name></person-group><article-title>Analysis of parameter selections for fuzzy c-means</article-title><source>Pattern Recognit</source><volume>45</volume><fpage>407</fpage><lpage>415</lpage><year>2012</year><pub-id pub-id-type="doi">10.1016/j.patcog.2011.07.012</pub-id></element-citation></ref>
<ref id="b19-ol-0-0-8805"><label>19</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Xu</surname><given-names>C</given-names></name><name><surname>Prince</surname><given-names>JL</given-names></name></person-group><article-title>Snakes, shapes, and gradient vector flow</article-title><source>IEEE Trans Image Process</source><volume>7</volume><fpage>359</fpage><lpage>369</lpage><year>1998</year><pub-id pub-id-type="doi">10.1109/83.661186</pub-id><pub-id pub-id-type="pmid">18276256</pub-id></element-citation></ref>
<ref id="b20-ol-0-0-8805"><label>20</label><element-citation publication-type="other"><person-group person-group-type="author"><name><surname>Basu</surname><given-names>S</given-names></name><name><surname>Goldgof</surname><given-names>D</given-names></name><name><surname>Gu</surname><given-names>Y</given-names></name><name><surname>Kumar</surname><given-names>V</given-names></name><name><surname>Choi</surname><given-names>J</given-names></name><name><surname>Gillies</surname><given-names>RJ</given-names></name><name><surname>Hall</surname><given-names>OL</given-names></name><name><surname>Gatenby</surname><given-names>RA</given-names></name></person-group><article-title>Developing a classifier model for lung tumors in CT-scan images</article-title><source>Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Anchorage, AK</source><fpage>1306</fpage><lpage>1312</lpage><year>2011</year></element-citation></ref>
<ref id="b21-ol-0-0-8805"><label>21</label><element-citation publication-type="other"><person-group person-group-type="author"><name><surname>Fu</surname><given-names>LZB</given-names></name></person-group><article-title>A co-occurrence matrix algorithm used for medical image</article-title><source>Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Anchorage, AK</source><fpage>1318</fpage><lpage>1321</lpage><year>2011</year></element-citation></ref>
<ref id="b22-ol-0-0-8805"><label>22</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pang</surname><given-names>Y</given-names></name><name><surname>Li</surname><given-names>L</given-names></name><name><surname>Hu</surname><given-names>W</given-names></name><name><surname>Peng</surname><given-names>Y</given-names></name><name><surname>Liu</surname><given-names>L</given-names></name><name><surname>Shao</surname><given-names>Y</given-names></name></person-group><article-title>Computerized segmentation and characterization of breast lesions in dynamic contrast-enhanced MR images using fuzzy c-means clustering and snake algorithm</article-title><source>Comput Math Methods Med</source><volume>2012</volume><fpage>634907</fpage><year>2012</year><pub-id pub-id-type="doi">10.1155/2012/634907</pub-id><pub-id pub-id-type="pmid">22952558</pub-id></element-citation></ref>
<ref id="b23-ol-0-0-8805"><label>23</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Partridge</surname><given-names>SC</given-names></name><name><surname>DeMartini</surname><given-names>WB</given-names></name><name><surname>Kurland</surname><given-names>BF</given-names></name><name><surname>Eby</surname><given-names>PR</given-names></name><name><surname>White</surname><given-names>SW</given-names></name><name><surname>Lehman</surname><given-names>CD</given-names></name></person-group><article-title>Quantitative diffusion-weighted imaging as an adjunct to conventional breast MRI for improved positive predictive value</article-title><source>AJR Am J Roentgenol</source><volume>193</volume><fpage>1716</fpage><lpage>1722</lpage><year>2009</year><pub-id pub-id-type="doi">10.2214/AJR.08.2139</pub-id><pub-id pub-id-type="pmid">19933670</pub-id></element-citation></ref>
<ref id="b24-ol-0-0-8805"><label>24</label><element-citation publication-type="journal"><person-group person-group-type="author"><collab>Guyon IEA</collab></person-group><article-title>An introduction to variable and feature selection</article-title><source>J Mach Learn Res</source><volume>3</volume><fpage>1157</fpage><lpage>1182</lpage><year>2003</year></element-citation></ref>
<ref id="b25-ol-0-0-8805"><label>25</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Cai</surname><given-names>H</given-names></name></person-group><article-title>Improvements over Adaptive Local Hyperplane to Achieve Better Classification. In: Advances in Data Mining. Applications and Theoretical Aspects</article-title><person-group person-group-type="editor"><name><surname>Perner</surname><given-names>P</given-names></name></person-group><source>ICDM 2011. Lecture Notes in Computer Science</source><comment>vol</comment><volume>6870</volume><publisher-name>Springer</publisher-name><publisher-name>Berlin, Heidelberg</publisher-name><year>2011</year></element-citation></ref>
<ref id="b26-ol-0-0-8805"><label>26</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Herrero</surname><given-names>JR</given-names></name><name><surname>Navarro</surname><given-names>JJ</given-names></name></person-group><article-title>Exploiting computer resources for fast nearest neighbor classification</article-title><source>Pattern Anal Appl</source><volume>10</volume><fpage>265</fpage><lpage>275</lpage><year>2007</year><pub-id pub-id-type="doi">10.1007/s10044-007-0065-y</pub-id></element-citation></ref>
<ref id="b27-ol-0-0-8805"><label>27</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Duan</surname><given-names>KB</given-names></name><name><surname>Rajapakse</surname><given-names>JC</given-names></name><name><surname>Wang</surname><given-names>H</given-names></name><name><surname>Azuaje</surname><given-names>F</given-names></name></person-group><article-title>Multiple SVM-RFE for gene selection in cancer classification with expression data</article-title><source>IEEE Trans Nanobioscience</source><volume>4</volume><fpage>228</fpage><lpage>234</lpage><year>2005</year><pub-id pub-id-type="doi">10.1109/TNB.2005.853657</pub-id><pub-id pub-id-type="pmid">16220686</pub-id></element-citation></ref>
<ref id="b28-ol-0-0-8805"><label>28</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Newell</surname><given-names>D</given-names></name><name><surname>Nie</surname><given-names>K</given-names></name><name><surname>Chen</surname><given-names>JH</given-names></name><name><surname>Hsu</surname><given-names>CC</given-names></name><name><surname>Yu</surname><given-names>HJ</given-names></name><name><surname>Nalcioglu</surname><given-names>O</given-names></name><name><surname>Su</surname><given-names>MY</given-names></name></person-group><article-title>Selection of diagnostic features on breast MRI to differentiate between malignant and benign lesions using computer-aided diagnosis: Differences in lesions presenting as mass and non-mass-like enhancement</article-title><source>Eur Radiol</source><volume>20</volume><fpage>771</fpage><lpage>781</lpage><year>2010</year><pub-id pub-id-type="doi">10.1007/s00330-009-1616-y</pub-id><pub-id pub-id-type="pmid">19789878</pub-id></element-citation></ref>
<ref id="b29-ol-0-0-8805"><label>29</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>El Khouli</surname><given-names>RH</given-names></name><name><surname>Macura</surname><given-names>KJ</given-names></name><name><surname>Jacobs</surname><given-names>MA</given-names></name><name><surname>Khalil</surname><given-names>TH</given-names></name><name><surname>Kamel</surname><given-names>IR</given-names></name><name><surname>Dwyer</surname><given-names>A</given-names></name><name><surname>Bluemke</surname><given-names>DA</given-names></name></person-group><article-title>Dynamic contrast-enhanced MRI of the breast: Quantitative method for kinetic curve type assessment</article-title><source>AJR Am J Roentgenol</source><volume>193</volume><fpage>W295</fpage><lpage>W300</lpage><year>2009</year><pub-id pub-id-type="doi">10.2214/AJR.09.2483</pub-id><pub-id pub-id-type="pmid">19770298</pub-id></element-citation></ref>
<ref id="b30-ol-0-0-8805"><label>30</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Li</surname><given-names>KL</given-names></name><name><surname>Partridge</surname><given-names>SC</given-names></name><name><surname>Joe</surname><given-names>BN</given-names></name><name><surname>Gibbs</surname><given-names>JE</given-names></name><name><surname>Lu</surname><given-names>Y</given-names></name><name><surname>Esserman</surname><given-names>LJ</given-names></name><name><surname>Hylton</surname><given-names>NM</given-names></name></person-group><article-title>Invasive breast cancer: Predicting disease recurrence by using high-spatial-resolution signal enhancement ratio imaging</article-title><source>Radiology</source><volume>248</volume><fpage>79</fpage><lpage>87</lpage><year>2008</year><pub-id pub-id-type="doi">10.1148/radiol.2481070846</pub-id><pub-id pub-id-type="pmid">18566170</pub-id></element-citation></ref>
<ref id="b31-ol-0-0-8805"><label>31</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Esserman</surname><given-names>L</given-names></name><name><surname>Hylton</surname><given-names>N</given-names></name><name><surname>George</surname><given-names>T</given-names></name><name><surname>Weidner</surname><given-names>N</given-names></name></person-group><article-title>Contrast-enhanced magnetic resonance imaging to assess tumor histopathology and angiogenesis in breast carcinoma</article-title><source>Breast J</source><volume>5</volume><fpage>13</fpage><lpage>21</lpage><year>1999</year><pub-id pub-id-type="doi">10.1046/j.1524-4741.1999.005001013.x</pub-id><pub-id pub-id-type="pmid">11348250</pub-id></element-citation></ref>
<ref id="b32-ol-0-0-8805"><label>32</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Guo</surname><given-names>Y</given-names></name><name><surname>Cai</surname><given-names>YQ</given-names></name><name><surname>Cai</surname><given-names>ZL</given-names></name><name><surname>Gao</surname><given-names>YG</given-names></name><name><surname>An</surname><given-names>NY</given-names></name><name><surname>Ma</surname><given-names>L</given-names></name><name><surname>Mahankali</surname><given-names>S</given-names></name><name><surname>Gao</surname><given-names>JH</given-names></name></person-group><article-title>Differentiation of clinically benign and malignant breast lesions using diffusion-weighted imaging</article-title><source>J Magn Reson Imaging</source><volume>16</volume><fpage>172</fpage><lpage>178</lpage><year>2002</year><pub-id pub-id-type="doi">10.1002/jmri.10140</pub-id><pub-id pub-id-type="pmid">12203765</pub-id></element-citation></ref>
<ref id="b33-ol-0-0-8805"><label>33</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Partridge</surname><given-names>SC</given-names></name><name><surname>Mullins</surname><given-names>CD</given-names></name><name><surname>Kurland</surname><given-names>BF</given-names></name><name><surname>Allain</surname><given-names>MD</given-names></name><name><surname>DeMartini</surname><given-names>WB</given-names></name><name><surname>Eby</surname><given-names>PR</given-names></name><name><surname>Lehman</surname><given-names>CD</given-names></name></person-group><article-title>Apparent diffusion coefficient values for discriminating benign and malignant breast MRI lesions: Effects of lesion type and size</article-title><source>AJR Am J Roentgenol</source><volume>194</volume><fpage>1664</fpage><lpage>1673</lpage><year>2010</year><pub-id pub-id-type="doi">10.2214/AJR.09.3534</pub-id><pub-id pub-id-type="pmid">20489111</pub-id></element-citation></ref>
<ref id="b34-ol-0-0-8805"><label>34</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Partridge</surname><given-names>SC</given-names></name><name><surname>Demartini</surname><given-names>WB</given-names></name><name><surname>Kurland</surname><given-names>BF</given-names></name><name><surname>Eby</surname><given-names>PR</given-names></name><name><surname>White</surname><given-names>SW</given-names></name><name><surname>Lehman</surname><given-names>CD</given-names></name></person-group><article-title>Differential diagnosis of mammographically and clinically occult breast lesions on diffusion-weighted MRI</article-title><source>J Magn Reson Imaging</source><volume>31</volume><fpage>562</fpage><lpage>570</lpage><year>2010</year><pub-id pub-id-type="doi">10.1002/jmri.22078</pub-id><pub-id pub-id-type="pmid">20187198</pub-id></element-citation></ref>
<ref id="b35-ol-0-0-8805"><label>35</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rahbar</surname><given-names>H</given-names></name><name><surname>Partridge</surname><given-names>SC</given-names></name><name><surname>Demartini</surname><given-names>WB</given-names></name><name><surname>Gutierrez</surname><given-names>RL</given-names></name><name><surname>Allison</surname><given-names>KH</given-names></name><name><surname>Peacock</surname><given-names>S</given-names></name><name><surname>Lehman</surname><given-names>CD</given-names></name></person-group><article-title>In vivo assessment of ductal carcinoma in situ grade: A model incorporating dynamic contrast-enhanced and diffusion-weighted breast MR imaging parameters</article-title><source>Radiology</source><volume>263</volume><fpage>374</fpage><lpage>382</lpage><year>2012</year><pub-id pub-id-type="doi">10.1148/radiol.12111368</pub-id><pub-id pub-id-type="pmid">22517955</pub-id></element-citation></ref>
</ref-list>
</back>
<floats-group>
<fig id="f1-ol-0-0-8805" position="float">
<label>Figure 1.</label>
<caption><p>A sample breast lesion detected by magnetic resonance imaging. (A) A post-contrast breast lesion is highlighted in the blue rectangle. (B) Initial segmentation result using the fuzzy c-means-based method. (C) Final segmentation by deformation of gradient vector flow snake with initialization of (B).</p></caption>
<graphic xlink:href="ol-16-02-1521-g00.tif"/>
</fig>
<fig id="f2-ol-0-0-8805" position="float">
<label>Figure 2.</label>
<caption><p>Invasive ductal carcinoma (arrows) in a 30-year-old woman. (A) Dynamic contrast-enhanced MRI image in the early phase. Areas of mass-like enhancement are labeled by arrows and the lesion exhibits high signal intensity. (B) Diffusion-weighted MRI image (b=800 sec/mm<sup>2</sup>). (C) ADC map. Lesion exhibits areas with dark blue contours (arrows), which are indicative of a low ADC. ADC measured in this lesion is 0.89&#x00D7;10<sup>&#x2212;3</sup> sec/mm<sup>2</sup>. MRI, magnetic resonance imaging; ADC, apparent diffusion coefficient.</p></caption>
<graphic xlink:href="ol-16-02-1521-g01.tif"/>
</fig>
<fig id="f3-ol-0-0-8805" position="float">
<label>Figure 3.</label>
<caption><p>Fibroadenoma detected in an 18-year-old woman. (A) Dynamic contrast-enhanced MR image in the early phase. Areas of mass-like enhancement are labeled by arrows and the lesion exhibits high signal intensity. (B) Diffusion-weighted MRI image (b=800 sec/mm<sup>2</sup>). (C) ADC map. Lesion exhibits areas with light green contours (arrows), which are indicative of a high ADC. ADC measured in this lesion is 1.91&#x00D7;10<sup>&#x2212;3</sup> sec/mm<sup>2</sup>. MRI, magnetic resonance imaging; ADC, apparent diffusion coefficient.</p></caption>
<graphic xlink:href="ol-16-02-1521-g02.tif"/>
</fig>
<fig id="f4-ol-0-0-8805" position="float">
<label>Figure 4.</label>
<caption><p>Box plot of ADC values of benign and malignant breast lesions, where the data presented as the median &#x00B1; interquartile range. Malignant breast lesions (mean ADC, 1.16&#x00D7;10<sup>&#x2212;3</sup> mm<sup>2</sup>/sec) exhibit lower mean ADCs than benign lesions (mean, 1.68&#x00D7;10<sup>&#x2212;3</sup> mm<sup>2</sup>/sec, P&#x003C;0.05). ADC, apparent diffusion coefficient.</p></caption>
<graphic xlink:href="ol-16-02-1521-g03.tif"/>
</fig>
<fig id="f5-ol-0-0-8805" position="float">
<label>Figure 5.</label>
<caption><p>Comparison of ROC curves from morphological and kinetic analysis, from ADC values, and from combined features. The graph reveals that a model incorporating ADC values with morphological and kinetic features provides the best discriminative ability (AUC=0.90), compared to individual features (AUC=0.68 for morphological features, AUC=0.84 for kinetic features, and AUC=0.83 for ADC values). ROC, receiver operating characteristic; ADC, apparent diffusion coefficient; AUC, area under curve.</p></caption>
<graphic xlink:href="ol-16-02-1521-g04.tif"/>
</fig>
<table-wrap id="tI-ol-0-0-8805" position="float">
<label>Table I.</label>
<caption><p>Histopathology of benign and malignant breast lesions.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="bottom">Tumor group</th>
<th align="center" valign="bottom">Number</th>
<th align="center" valign="bottom">Percentage</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Malignant lesions</td>
<td align="center" valign="top">171</td>
<td align="center" valign="top">62.2</td>
</tr>
<tr>
<td align="left" valign="top">&#x00A0;&#x00A0;Invasive ductal carcinoma</td>
<td align="center" valign="top">136</td>
<td align="center" valign="top">79.5</td>
</tr>
<tr>
<td align="left" valign="top">&#x00A0;&#x00A0;Intra-ductal carcinoma</td>
<td align="center" valign="top">23</td>
<td align="center" valign="top">13.4</td>
</tr>
<tr>
<td align="left" valign="top">&#x00A0;&#x00A0;Lobular carcinoma</td>
<td align="center" valign="top">2</td>
<td align="center" valign="top">1.2</td>
</tr>
<tr>
<td align="left" valign="top">&#x00A0;&#x00A0;Mucinous carcinoma</td>
<td align="center" valign="top">3</td>
<td align="center" valign="top">1.8</td>
</tr>
<tr>
<td align="left" valign="top">&#x00A0;&#x00A0;Medullary carcinoma</td>
<td align="center" valign="top">1</td>
<td align="center" valign="top">0.6</td>
</tr>
<tr>
<td align="left" valign="top">&#x00A0;&#x00A0;Others</td>
<td align="center" valign="top">6</td>
<td align="center" valign="top">3.5</td>
</tr>
<tr>
<td align="left" valign="top">Benign lesions</td>
<td align="center" valign="top">104</td>
<td align="center" valign="top">37.8</td>
</tr>
<tr>
<td align="left" valign="top">&#x00A0;&#x00A0;Fibroadenosis</td>
<td align="center" valign="top">64</td>
<td align="center" valign="top">61.6</td>
</tr>
<tr>
<td align="left" valign="top">&#x00A0;&#x00A0;Intraductal papilloma</td>
<td align="center" valign="top">4</td>
<td align="center" valign="top">3.8</td>
</tr>
<tr>
<td align="left" valign="top">&#x00A0;&#x00A0;Hyperplasia</td>
<td align="center" valign="top">4</td>
<td align="center" valign="top">3.8</td>
</tr>
<tr>
<td align="left" valign="top">&#x00A0;&#x00A0;Phyllodes tumor</td>
<td align="center" valign="top">2</td>
<td align="center" valign="top">1.9</td>
</tr>
<tr>
<td align="left" valign="top">&#x00A0;&#x00A0;Adenomyosis epithelioma</td>
<td align="center" valign="top">1</td>
<td align="center" valign="top">1</td>
</tr>
<tr>
<td align="left" valign="top">&#x00A0;&#x00A0;Inflammation</td>
<td align="center" valign="top">2</td>
<td align="center" valign="top">1.9</td>
</tr>
<tr>
<td align="left" valign="top">Follow-up</td>
<td align="center" valign="top">27</td>
<td align="center" valign="top">26</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap id="tII-ol-0-0-8805" position="float">
<label>Table II.</label>
<caption><p>Group mean, P-values and diagnostic accuracy of selected parameters.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="bottom">Parameters</th>
<th align="center" valign="bottom">Benign<sup><xref rid="tfn1-ol-0-0-8805" ref-type="table-fn">a</xref></sup></th>
<th align="center" valign="bottom">Malignant<sup><xref rid="tfn1-ol-0-0-8805" ref-type="table-fn">a</xref></sup></th>
<th align="center" valign="bottom">P-value<sup><xref rid="tfn2-ol-0-0-8805" ref-type="table-fn">b</xref></sup></th>
<th align="center" valign="bottom">Diagnostic accuracy<sup><xref rid="tfn3-ol-0-0-8805" ref-type="table-fn">c</xref></sup></th>
<th align="center" valign="bottom">Threshold value</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Heterogeneity</td>
<td align="center" valign="top">&#x2212;0.054&#x00B1;1.061</td>
<td align="center" valign="top">0.033&#x00B1;0.964</td>
<td align="center" valign="top">0.486</td>
<td align="center" valign="top">0.633</td>
<td align="center" valign="top">0.17</td>
</tr>
<tr>
<td align="left" valign="top">Area</td>
<td align="center" valign="top">&#x2212;0.403&#x00B1;0.751</td>
<td align="center" valign="top">0.245&#x00B1;1.053</td>
<td align="center" valign="top">&#x003C;0.001</td>
<td align="center" valign="top">0.742</td>
<td align="center" valign="top">440.00</td>
</tr>
<tr>
<td align="left" valign="top">Sum variance</td>
<td align="center" valign="top">0.373&#x00B1;1.094</td>
<td align="center" valign="top">&#x2212;0.227&#x00B1;0.866</td>
<td align="center" valign="top">&#x003C;0.001</td>
<td align="center" valign="top">0.684</td>
<td align="center" valign="top">11582.00</td>
</tr>
<tr>
<td align="left" valign="top">Sum entropy</td>
<td align="center" valign="top">&#x2212;0.508&#x00B1;1.057</td>
<td align="center" valign="top">0.309&#x00B1;0.825</td>
<td align="center" valign="top">&#x003C;0.001</td>
<td align="center" valign="top">0.709</td>
<td align="center" valign="top">7.88</td>
</tr>
<tr>
<td align="left" valign="top">Difference entropy</td>
<td align="center" valign="top">&#x2212;0.171&#x00B1;1.112</td>
<td align="center" valign="top">0.104&#x00B1;0.914</td>
<td align="center" valign="top">0.003</td>
<td align="center" valign="top">0.647</td>
<td align="center" valign="top">5.06</td>
</tr>
<tr>
<td align="left" valign="top">SER</td>
<td align="center" valign="top">&#x2212;0.826&#x00B1;0.756</td>
<td align="center" valign="top">0.502&#x00B1;0.771</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0.876</td>
<td align="center" valign="top">0.34</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="tfn1-ol-0-0-8805"><label>a</label><p>Data presented as the mean &#x00B1; standard deviation.</p></fn>
<fn id="tfn2-ol-0-0-8805"><label>b</label><p>Computed with paired-sample t-test.</p></fn>
<fn id="tfn3-ol-0-0-8805"><label>c</label><p>Computed with univariate logistic regression. SER, signal enhancement ratio.</p></fn>
</table-wrap-foot>
</table-wrap>
<table-wrap id="tIII-ol-0-0-8805" position="float">
<label>Table III.</label>
<caption><p>Diagnostic performance differentiating between malignant and benign lesions.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="bottom">Parameter selection</th>
<th align="center" valign="bottom">Sensitivity</th>
<th align="center" valign="bottom">Specificity</th>
<th align="center" valign="bottom">Accuracy</th>
<th align="center" valign="bottom">AUC</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Morphology</td>
<td align="center" valign="top">0.57</td>
<td align="center" valign="top">0.78</td>
<td align="center" valign="top">0.70</td>
<td align="center" valign="top">0.68</td>
</tr>
<tr>
<td align="left" valign="top">Kinetics</td>
<td align="center" valign="top">0.79</td>
<td align="center" valign="top">0.89</td>
<td align="center" valign="top">0.85</td>
<td align="center" valign="top">0.84</td>
</tr>
<tr>
<td align="left" valign="top">Texture</td>
<td align="center" valign="top">0.53</td>
<td align="center" valign="top">0.81</td>
<td align="center" valign="top">0.71</td>
<td align="center" valign="top">0.67</td>
</tr>
<tr>
<td align="left" valign="top">Morphology&#x002B;texture&#x002B;kinetics</td>
<td align="center" valign="top">0.81</td>
<td align="center" valign="top">0.91</td>
<td align="center" valign="top">0.87</td>
<td align="center" valign="top">0.86</td>
</tr>
<tr>
<td align="left" valign="top">ADC</td>
<td align="center" valign="top">0.78</td>
<td align="center" valign="top">0.90</td>
<td align="center" valign="top">0.84</td>
<td align="center" valign="top">0.83</td>
</tr>
<tr>
<td align="left" valign="top">ADC&#x002B;kinetics</td>
<td align="center" valign="top">0.84</td>
<td align="center" valign="top">0.93</td>
<td align="center" valign="top">0.89</td>
<td align="center" valign="top">0.88</td>
</tr>
<tr>
<td align="left" valign="top">ADC&#x002B;morphology&#x002B;kinetics&#x002B;texture</td>
<td align="center" valign="top">0.85</td>
<td align="center" valign="top">0.94</td>
<td align="center" valign="top">0.90</td>
<td align="center" valign="top">0.90</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="tfn4-ol-0-0-8805"><p>ADC, apparent diffusion coefficient; AUC, area under curve.</p></fn>
</table-wrap-foot>
</table-wrap>
</floats-group>
</article>
