Multimodal image analysis in tissue diagnostics for skin melanoma
Authors: Guo S., Pfeifenbring S., Meyer T., Ernst G., von Eggeling F., Maio V., Massi D., Cicchi R., Pavone F.S., Popp J., Bocklitz T.
Autors Affiliation: Institute of Physical Chemistry and Abbe Center of Photonics, Friedrich Schiller University Jena, Helmholtzweg 4, Jena, D-07743, Germany; Leibniz Institute of Photonic Technology, Albert-Einstein-Straße 9, Jena, D-07745, Germany; InfectoGnostics, Forschungscampus Jena, Philosophenweg 7, Jena, D-07743, Germany; Department of Otorhinolaryngology, Jena University Hospital, Jena, Germany; Division of Pathology, Department of Medical and Surgical Critical Care, University of Florence, Viale G.B. Morgagni 85, Florence, 50139, Italy; National Institute of Optics-National Research Council (INO-CNR), Via Nello Carrara 1, Sesto Fiorentino, 50019, Italy; European Laboratory for Non-Linear Spectroscopy (LENS), University of Florence, Via Nello Carrara 1, Sesto Fiorentino, 50019, Italy; Department of Physics, University of Florence, Via Giovanni Sansone 1, Sesto Fiorentino, 50019, Italy
Abstract: Early diagnosis is a corner stone for a successful treatment of most diseases including melanoma, which cannot be achieved by traditional histopathological inspection. In this respect, multimodal imaging, the combination of TPEF and SHG, features a high diagnostic potential as an alternative approach. Multimodal imaging generates molecular contrast, but to use this technique in clinical practice, the optical signals must be translated into diagnostic relevant information. This translation requires automatic image analysis techniques. Within this contribution, we established an analysis pipeline for multimodal images to achieve melanoma diagnostics of skin tissue. The first step of the image analysis was the pre-treatment, where the mosaicking artifacts were corrected and a standardization was performed. Afterwards, the local histogram-based first-order texture features and the local gray-level co-occurrence matrix (GLCM) texture features were extracted in multiple scales. Thereafter, we constructed a local hierarchical statistical model to distinguish melanoma, normal epithelium, and other tissue types. The results demonstrated the capability of multimodal imaging combined with image analysis to differentiate different tissue types. Furthermore, we compared the histogram and the GLCM-based texture feature sets according to the Fisher’s discriminant ratio (FDR) and the prediction of the classification, which demonstrated that the histogram-based texture features are superior to the GLCM features for the given task. Finally, we performed a global classification to achieve a patient diagnostics with the clinical diagnosis as ground truth. The agreement of the prediction and the clinical results demonstrated the great potential of multimodal imaging for melanoma diagnostics. Multimodal imaging was applied for tissue diagnostics of skin melanoma with the help of automatic image analysis procedures. Normal, melanoma, and other skin tissues were classified based on multiscale pixel-wise texture features calculated from first-order histogram and Gray-Level Co-Occurrence Matrix of the multimodal images. Texture features based on first-order histogram were superior to those based on Gray-Level Co-Occurrence Matrix with respect to computational complexity, classification accuracy, and Fisher’s discriminant ratio.
Journal/Review: JOURNAL OF CHEMOMETRICS
Volume: 32 (1) Pages from: e2963-1 to: e2963-17
More Information: Thuringer Ministerium fur Wirtschaft, Wissenschaft und Digitale Gesellschaft; Thuringer Aufbaubank; Federal Ministry of Education and Research, Germany (BMBF); German Science Foundation, Grant/Award Number: BO 4700/1-1, PO 563/30-1 STA 295/11-1; Fonds der Chemischen Industrie; Carl-Zeiss Foundation; Leibniz association; Italian Ministry for Education, University and Research; Italian Ministry of Health, Grant/Award Number: GR-2011-02349626; EC Horizon 2020, Grant/Award Number: 654148; COST action Raman4Clinics, Grant/Award Number: COST-STSM-ECOST-STSM-BM1401-020316-071905; China Scholarship Council (CSC)KeyWords: Image analysis; Multimodal imaging; Skin cancer diagnostics; Texture featuresDOI: 10.1002/cem.2963Citations: 4data from “WEB OF SCIENCE” (of Thomson Reuters) are update at: 2021-02-28References taken from IsiWeb of Knowledge: (subscribers only)Connecting to view paper tab on IsiWeb: Click hereConnecting to view citations from IsiWeb: Click here