End-to-End Multi-task Learning Architecture for Brain Tumor Analysis with Uncertainty Estimation in MRI Images

M. Nazir, S. Shakil, and K. Khurshid, “Role of deep learning in brain tumor detection and classification (2015 to 2020): A review,” Comput. Med. Imaging Graph., vol. 91, no. May, 2021, https://doi.org/10.1016/j.compmedimag.2021.101940.

Article  Google Scholar 

D. Hee Lee and S. N. Yoon, “Application of artificial intelligence-based technologies in the healthcare industry: Opportunities and challenges,” Int. J. Environ. Res. Public Health, vol. 18, no. 1, pp. 1–18, 2021, https://doi.org/10.3390/ijerph18010271.

S. Ahuja, B. K. Panigrahi, and T. K. Gandhi, “Enhanced performance of Dark-Nets for brain tumor classification and segmentation using colormap-based superpixel techniques,” Mach. Learn. with Appl., vol. 7, no. March 2021, p. 100212, 2022, https://doi.org/10.1016/j.mlwa.2021.100212.

S. Vidyadharan, B. V. V. S. N. Prabhakar Rao, Y. Perumal, K. Chandrasekharan, and V. Rajagopalan, “Deep Learning Classifies Low- and High-Grade Glioma Patients with High Accuracy, Sensitivity, and Specificity Based on Their Brain White Matter Networks Derived from Diffusion Tensor Imaging,” Diagnostics, vol. 12, no. 12, 2022, https://doi.org/10.3390/diagnostics12123216.

J. Lee, D. Shin, S. H. Oh, and H. Kim, “Method to Minimize the Errors of AI: Quantifying and Exploiting Uncertainty of Deep Learning in Brain Tumor Segmentation,” Sensors, vol. 22, no. 6, 2022, https://doi.org/10.3390/s22062406.

X. He, W. Xu, J. Yang, J. Mao, S. Chen, and Z. Wang, “Deep Convolutional Neural Network With a Multi-Scale Attention Feature Fusion Module for Segmentation of Multimodal Brain Tumor,” Front. Neurosci., vol. 15, no. November, pp. 1–9, Nov. 2021, https://doi.org/10.3389/fnins.2021.782968.

Article  CAS  Google Scholar 

D. Xu, X. Zhou, X. Niu, and J. Wang, “Automatic segmentation of low-grade glioma in MRI image based on UNet++ model,” J. Phys. Conf. Ser., vol. 1693, no. 1, 2020, https://doi.org/10.1088/1742-6596/1693/1/012135.

Z. Liu et al., “Deep learning based brain tumor segmentation: a survey,” Complex Intell. Syst., vol. 9, no. 1, pp. 1001–1026, 2022,  https://doi.org/10.1007/s40747-022-00815-5.

Article  Google Scholar 

K. T. Islam, S. Wijewickrema, and S. O’leary, “A Deep Learning Framework for Segmenting Brain Tumors Using MRI and Synthetically Generated CT Images,” Sensors, vol. 22, no. 2, 2022, https://doi.org/10.3390/s22020523.

W. W. Lin, J. W. Lin, T. M. Huang, T. Li, M. H. Yueh, and S. T. Yau, “A novel 2-phase residual U-net algorithm combined with optimal mass transportation for 3D brain tumor detection and segmentation,” Sci. Rep., vol. 12, no. 1, pp. 1–16, 2022, https://doi.org/10.1038/s41598-022-10285-x.

Article  CAS  Google Scholar 

T. Kalaiselvi, S. T. Padmapriya, P. Sriramakrishnan, and K. Somasundaram, “Deriving tumor detection models using convolutional neural networks from MRI of human brain scans,” Int. J. Inf. Technol., pp. 2–7, 2020, https://doi.org/10.1007/s41870-020-00438-4.

A. Veeramuthu et al., “MRI Brain Tumor Image Classification Using a Combined Feature and Image-Based Classifier,” Front. Psychol., vol. 13, no. March, pp. 1–12, 2022, https://doi.org/10.3389/fpsyg.2022.848784.

Article  Google Scholar 

S. Montaha, S. Azam, A. K. M. R. H. Rafid, M. Z. Hasan, A. Karim, and A. Islam, “TimeDistributed-CNN-LSTM: A Hybrid Approach Combining CNN and LSTM to Classify Brain Tumor on 3D MRI Scans Performing Ablation Study,” IEEE Access, vol. 10, pp. 60039–60059, 2022, https://doi.org/10.1109/ACCESS.2022.3179577.

Article  Google Scholar 

K. R. Laukamp et al., “Automated Meningioma Segmentation in Multiparametric MRI: Comparable Effectiveness of a Deep Learning Model and Manual Segmentation,” Clin. Neuroradiol., vol. 31, no. 2, pp. 357–366, 2021, https://doi.org/10.1007/s00062-020-00884-4.

Article  PubMed  Google Scholar 

R. A. Zeineldin, M. E. Karar, J. Coburger, C. R. Wirtz, and O. Burgert, “DeepSeg: deep neural network framework for automatic brain tumor segmentation using magnetic resonance FLAIR images,” Int. J. Comput. Assist. Radiol. Surg., vol. 15, no. 6, pp. 909–920, 2020, https://doi.org/10.1007/s11548-020-02186-z.

Article  PubMed  PubMed Central  Google Scholar 

M. Brain, T. Segmentation, Y. Chen, M. Yin, Y. Li, and Q. Cai, “CSU-Net : A CNN-Transformer Parallel Network for,” pp. 1–12, 2022.

M. Aggarwal, A. K. Tiwari, M. P. Sarathi, and A. Bijalwan, “An early detection and segmentation of Brain Tumor using Deep Neural Network,” BMC Med. Inform. Decis. Mak., vol. 23, no. 1, pp. 1–12, 2023, https://doi.org/10.1186/s12911-023-02174-8.

Article  Google Scholar 

Y. Wang and X. Ye, “U-Net multi-modality glioma MRIs segmentation combined with attention,” 2023 Int. Conf. Intell. Supercomput. BioPharma, ISBP 2023, pp. 82–85, 2023, https://doi.org/10.1109/ISBP57705.2023.10061312.

G. Cheng, J. Cheng, M. Luo, L. He, Y. Tian, and R. Wang, “Effective and efficient multitask learning for brain tumor segmentation,” J. Real-Time Image Process., vol. 17, no. 6, pp. 1951–1960, Dec. 2020, https://doi.org/10.1007/s11554-020-00961-4.

Article  Google Scholar 

C. Zhou, C. Ding, X. Wang, Z. Lu, and D. Tao, “One-Pass Multi-Task Networks With Cross-Task Guided Attention for Brain Tumor Segmentation,” IEEE Trans. Image Process., vol. 29, pp. 4516–4529, 2020, https://doi.org/10.1109/TIP.2020.2973510.

Article  Google Scholar 

D.-K. Ngo, M.-T. Tran, S.-H. Kim, H.-J. Yang, and G.-S. Lee, “Multi-Task Learning for Small Brain Tumor Segmentation from MRI,” Appl. Sci., vol. 10, no. 21, p. 7790, Nov. 2020, https://doi.org/10.3390/app10217790.

Article  CAS  Google Scholar 

P. Mlynarski, H. Delingette, A. Criminisi, and N. Ayache, “Deep learning with mixed supervision for brain tumor segmentation,” J. Med. Imaging, vol. 6, no. 03, p. 1, 2019, https://doi.org/10.1117/1.jmi.6.3.034002.

Article  Google Scholar 

L. Weninger, Q. Liu, and D. Merhof, “Multi-task learning for brain tumor segmentation,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 11992 LNCS, pp. 327–337, 2020, https://doi.org/10.1007/978-3-030-46640-4_31.

A. A. Mossa and U. Çevik, “Ensemble learning of multiview CNN models for survival time prediction of brain tumor patients using multimodal MRI scans,” Turkish J. Electr. Eng. Comput. Sci., vol. 29, no. 2, pp. 616–631, 2021, https://doi.org/10.3906/ELK-2002-175.

Article  Google Scholar 

S. Rajput, R. Agravat, M. Roy, and M. S. Raval, “Glioblastoma Multiforme Patient Survival Prediction,” in Lecture Notes in Electrical Engineering, 2022, vol. 784 LNEE, pp. 47–58. https://doi.org/10.1007/978-981-16-3880-0_6.

C. Russo, S. Liu, and A. Di Ieva, “Impact of Spherical Coordinates Transformation Pre-processing in Deep Convolution Neural Networks for Brain Tumor Segmentation and Survival Prediction,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 12658 LNCS, pp. 295–306, 2021, https://doi.org/10.1007/978-3-030-72084-1_27.

G. Kaur, P. S. Rana, and V. Arora, “Automated Neural Network-based Survival Prediction of Glioblastoma Patients Using Pre-operative MRI and Clinical Data,” IETE J. Res., 2023, https://doi.org/10.1080/03772063.2023.2217142.

Article  Google Scholar 

M. T. Tran, H. J. Yang, S. H. Kim, and G. S. Lee, “Prediction of Survival of Glioblastoma Patients Using Local Spatial Relationships and Global Structure Awareness in FLAIR MRI Brain Images,” IEEE Access, vol. 11, no. March, pp. 37437–37449, 2023, https://doi.org/10.1109/ACCESS.2023.3266771.

Article  Google Scholar 

M. Nazir et al., “Multi-task learning architecture for brain tumor detection and segmentation in MRI images,” J. Electron. Imaging, vol. 31, no. 05, pp. 035001–7, Aug. 2022, https://doi.org/10.1117/1.JEI.31.5.051606.

Article  Google Scholar 

K. Tan, W. Huang, X. Liu, J. Hu, and S. Dong, “A multi-modal fusion framework based on multi-task correlation learning for cancer prognosis prediction,” Artif. Intell. Med., vol. 126, no. March 2021, p. 102260, 2022, https://doi.org/10.1016/j.artmed.2022.102260.

F. Gao, H. Yoon, T. Wu, and X. Chu, “A Feature Transfer Enabled Multi-Task Deep Learning Model on Medical Imaging,” Expert Syst. Appl., vol. 143, p. 112957, Jun. 2019, https://doi.org/10.1016/j.eswa.2019.112957.

Article  Google Scholar 

F. Su, H.-Y. Shang, and J.-Y. Wang, “Low-Rank Deep Convolutional Neural Network for Multitask Learning,” Comput. Intell. Neurosci., vol. 2019, pp. 1–10, May 2019, https://doi.org/10.1155/2019/7410701.

Article  Google Scholar 

I. Misra, A. Shrivastava, A. Gupta, and M. Hebert, “Cross-stitch Networks for Multi-task Learning,” Apr. 2016.

S. Vandenhende, S. Georgoulis, and L. Van Gool, “MTI-Net: Multi-scale Task Interaction Networks for Multi-task Learning,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12349 LNCS, 2020, pp. 527–543. https://doi.org/10.1007/978-3-030-58548-8_31.

P. Guo, C.-Y. Lee, and D. Ulbricht, “Learning to Branch for Multi-Task Learning,” 37th Int. Conf. Mach. Learn. ICML 2020, vol. PartF16814, pp. 3812–3821, Jun. 2020.

S. Ruder, J. Bingel, I. Augenstein, and A. Søgaard, “Latent Multi-Task Architecture Learning,” Proc. AAAI Conf. Artif. Intell., vol. 33, pp. 4822–4829, Jul. 2019, https://doi.org/10.1609/aaai.v33i01.33014822.

Article  Google Scholar 

X. Liu, P. He, W. Chen, and J. Gao, “Multi-Task Deep Neural Networks for Natural Language Understanding,” in Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019, pp. 4487–4496. https://doi.org/10.18653/v1/P19-1441.

M. Crawshaw, “Multi-Task Learning with Deep Neural Networks: A Survey,” Sep. 2020.

E. On, “Mnist i,” no. 1998, pp. 1–7, 2018.

M. Nazir, S. Shakil, and K. Khurshid, “Role of deep learning in brain tumor detection and classification (2015 to 2020): A review,” Comput. Med. Imaging Graph., vol. 91, no. April, p. 101940, Jul. 2021, https://doi.org/10.1016/j.compmedimag.2021.101940.

A. Gurunathan and B. Krishnan, “A Hybrid CNN-GLCM Classifier For Detection And Grade Classification Of Brain Tumor,” Brain Imaging Behav., pp. 1410–1427, 2022, https://doi.org/10.1007/s11682-021-00598-2.

“Kaggle.” https://www.kaggle.com/

“Colab Pro plans.” https://colab.research.google.com/signup

“Jupyter (IDE).” https://jupyter.org/

H. Mzoughi et al., “Deep Multi-Scale 3D Convolutional Neural Network (CNN) for MRI Gliomas Brain Tumor Classification,” J. Digit. Imaging, vol. 33, no. 4, pp. 903–915, 2020, https://doi.org/10.1007/s10278-020-00347-9.

Article  PubMed  PubMed Central  Google Scholar 

P. Natekar, A. Kori, and G. Krishnamurthi, “Demystifying Brain Tumor Segmentation Networks: Interpretability and Uncertainty Analysis,” Front. Comput. Neurosci., vol. 14, no. February, pp. 1–12, 2020, https://doi.org/10.3389/fncom.2020.00006.

Article  Google Scholar 

B. Ghoshal, A. Tucker, B. Sanghera, and W. Lup Wong, “Estimating uncertainty in deep learning for reporting confidence to clinicians in medical image segmentation and diseases detection,” Comput. Intell., vol. 37, no. 2, pp. 701–734, 2021, https://doi.org/10.1111/coin.12411.

S. Hu, D. Worrall, S. Knegt, B. Veeling, H. Huisman, and M. Welling, “Supervised Uncertainty Quantification for Segmentation with Multiple Annotations,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 11765 LNCS, pp. 137–145, 2019, https://doi.org/10.1007/978-3-030-32245-8_16.

S. Chakrabarty et al., “BrainTumorNet: multi-task learning for joint segmentation of high-grade glioma and brain metastases from MR images,” in Medical Imaging 2021: Image Processing, Feb. 2021, no. February, p. 13. https://doi.org/10.1117/12.2580100.

M. Rezaei, H. Yang, and C. Meinel, “Instance Tumor Segmentation using Multitask Convolutional Neural Network,” in 2018 International Joint Conference on Neural Networks (IJCNN), Jul. 2018, vol. 2018-July, pp. 1–8. https://doi.org/10.1109/IJCNN.2018.8489105.

H. Huang et al., “A Deep Multi-Task Learning Framework for Brain Tumor Segmentation,” Front. Oncol., vol. 11, no. June, pp. 1–16, Jun. 2021, https://doi.org/10.3389/fonc.2021.690244.

Article  Google Scholar 

M. A. Naser and M. J. Deen, “Brain tumor segmentation and grading of lower-grade glioma using deep learning in MRI images,” Comput. Biol. Med., vol. 121, p. 103758, 2020, https://doi.org/10.1016/j.compbiomed.2020.103758.

Article  PubMed  Google Scholar 

L. Pei, L. Vidyaratne, M. M. Rahman, and K. M. Iftekharuddin, “Context aware deep learning for brain tumor segmentation, subtype classification, and survival prediction using radiology images,” Sci. Rep., vol. 10, no. 1, pp. 1–11, 2020, https://doi.org/10.1038/s41598-020-74419-9.

Article  CAS  Google Scholar 

C. Pitarch and V. Ribas, “AI-Based Glioma Grading for a Trustworthy Diagnosis : An Analytical Pipeline for Improved Reliability,” pp. 1–28, 2023.

T. Chen, L. Hu, and Q. Lu, “A computer-aided diagnosis system for brain tumors based on artificial intelligence algorithms,” no. July, 2023, https://doi.org/10.3389/fnins.2023.1120781.

X. Guan et al., “3D AGSE-VNet: an automatic brain tumor MRI data segmentation framework,” BMC Med. Imaging, vol. 22, no. 1, pp. 1–18, 2022, https://doi.org/10.1186/s12880-021-00728-8.

Article  Google Scholar 

J. Liang, C. Yang, M. Zeng, and X. Wang, “TransConver : transformer and convolution parallel network for developing automatic brain tumor segmentation in MRI images,” vol. 12, no. 4, pp. 2397–2415, 2022, https://doi.org/10.21037/qims-21-919.

Y. Deng, Y. Hou, J. Yan, and D. Zeng, “ELU-Net: An Efficient and Lightweight U-Net for Medical Image Segmentation,” IEEE Access, vol. 10, pp. 35932–35941, 2022, https://doi.org/10.1109/ACCESS.2022.3163711.

Article  Google Scholar 

M. J. Ali, T. Akram, H. Saleem, and B. Raza, “Glioma Segmentation using Ensemble of 2D / 3D U-Nets and Survival Prediction using Multiple Features Fusion Glioma Segmentation using Ensemble of 2D / 3D U-Nets and Survival Prediction using Multiple Features Fusion,” no. November, 2020, https://doi.org/10.13140/RG.2.2.28118.47681.

M. Islam, V. S. Vibashan, V. J. M. Jose, N. Wijethilake, U. Utkarsh, and H. Ren, “Brain Tumor Segmentation and Survival Prediction Using 3D Attention UNet,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11992 LNCS, 2020, pp. 262–272. https://doi.org/10.1007/978-3-030-46640-4_25.

H. Huang, W. Zhang, Y. Fang, J. Hong, S. Su, and X. Lai, “Overall Survival Prediction for Gliomas Using a Novel Compound Approach,” vol. 11, no. August, pp. 1–20, 2021, https://doi.org/10.3389/fonc.2021.724191.

D. Zhang et al., “Exploring Task Structure for Brain Tumor Segmentation from Multi-Modality MR Images,” IEEE Trans. Image Process., vol. 29, pp. 9032–9043, 2020, https://doi.org/10.1109/TIP.2020.3023609.

Article  Google Scholar 

D. Zhang, G. Huang, Q. Zhang, J. Han, J. Han, and Y. Yu, “Cross-modality deep feature learning for brain tumor segmentation,” Pattern Recognit., vol. 110, no. xxxx, p. 107562, 2021, https://doi.org/10.1016/j.patcog.2020.107562.

K. Hu et al., “Brain Tumor Segmentation Using Multi-Cascaded Convolutional Neural Networks and Conditional Random Field,” IEEE Access, vol. 7, pp. 92615–92629, 2019, https://doi.org/10.1109/ACCESS.2019.2927433.

Article 

留言 (0)

沒有登入
gif