CT synthesis with deep learning for MR-only radiotherap planning: a review

Johansson A, Karlsson M, Nyholm T. Ct substitute derived from mri sequences with ultrashort echo time. Med Phys. 2011;38(5):2708–14.

Article  Google Scholar 

Andreasen D, Van Leemput K, Hansen RH, Andersen JA, Edmund JM. Patch-based generation of a pseudo ct from conventional mri sequences for mri-only radiotherapy of the brain. Med Phys. 2015;42(4):1596–605.

Article  Google Scholar 

Dowling JA, Lambert J, Parker J, Salvado O, Fripp J, Capp A, Wratten C, Denham JW, Greer PB. An atlas-based electron density mapping method for magnetic resonance imaging (mri)-alone treatment planning and adaptive mri-based prostate radiation therapy. Int J Radiat Oncol Biol Phys. 2012;83(1):5–11.

Article  Google Scholar 

Lee J, Carass A, Jog A, Zhao C, Prince JL (2017) Multi-atlas-based ct synthesis from conventional mri with patch-based refinement for mri-based radiotherapy planning. In: Medical Imaging 2017: Image Processing, vol 10133, SPIE, pp 434–439

Jiang C, Zhang Q, Fan R, Hu Z. Super-resolution ct image reconstruction based on dictionary learning and sparse representation. Sci Reports. 2018;8(1):8799.

Google Scholar 

Huynh T, Gao Y, Kang J, Wang L, Zhang P, Lian J, Shen D. Estimating ct image from mri data using structured random forest and auto-context model. IEEE Trans Med Imaging. 2015;35(1):174–83.

Article  Google Scholar 

He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 770–778

Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: Medical image computing and computer-assisted intervention—MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, Springer, pp 234–241

Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. Advances in neural information processing systems, 27

Isola P, Zhu J-Y, Zhou T, Efros AA (2017) Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1125–1134

Zhu J-Y, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE international conference on computer vision, pp 2223–2232

Park T, Efros AA, Zhang R, Zhu J-Y (2020) Contrastive learning for unpaired image-to-image translation. In: Computer Vision–ECCV 2020: 16th European conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part IX 16, Springer, pp 319–345

Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) Attention is all you need. Advances in neural information processing systems, 30

Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Dehghani M, Minderer M, Heigold G, Gelly S. et al. (2020) An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929

Esser P, Rombach R, Ommer B (2021) Taming transformers for high-resolution image synthesis. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 12873–12883

Ho J, Jain A, Abbeel P. Denoising diffusion probabilistic models. Adv Neural Inform Process Syst. 2020;33:6840–51.

Google Scholar 

Song J, Meng C, Ermon S (2020) Denoising diffusion implicit models. arXiv preprint arXiv:2010.02502

Sasaki H, Willcocks CG, Breckon TP (2021) Unit-ddpm: Unpaired image translation with denoising diffusion probabilistic models. arXiv preprint arXiv:2104.05358

Su X, Song J, Meng C, Ermon S (2022) Dual diffusion implicit bridges for image-to-image translation. arXiv preprint arXiv:2203.08382

Ramkumar M, Kalirajan K, Kumar UP, Surya P. Deep volcanic residual u-net for nodal metastasis (Nmet) identification from lung cancer. Biomed Eng Lett. 2023;14(2):221–233.

Google Scholar 

Valanarasu JMJ, Oza P, Hacihaliloglu I, Patel VM (2021) Medical transformer: Gated axial-attention for medical image segmentation. In: Medical image computing and computer assisted intervention–MICCAI 2021: 24th international conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part I 24, Springer, pp 36–46

Guo Y, Zhou Y. Ms-CFNet: a multi-scale clinical studying-based and feature extraction-guided network for breast fibroadenoma segmentation in ultrasonography. Biomed Eng Lett. 2023;14:173–184.

Google Scholar 

Deng L, Zhang Y, Wang J, Huang S, Yang X. Improving performance of medical image alignment through super-resolution. Biomed Eng Lett. 2023;13(3):397–406.

Article  Google Scholar 

Deng L, Zou Y, Yang X, Wang J, Huang S. L2nlf: a novel linear-to-nonlinear framework for multi-modal medical image registration. Biomed Eng Lett. 2024;14:1–13.

Article  Google Scholar 

Liu J, Pasumarthi S, Duffy B, Gong E, Datta K, Zaharchuk G (2023) One model to synthesize them all: Multi-contrast multi-scale transformer for missing data imputation. IEEE transactions on medical imaging.

Li Y, Zhou T, He K, Zhou Y, Shen D (2023) Multi-scale transformer network with edge-aware pre-training for cross-modality mr image synthesis. IEEE transactions on medical imaging.

Nie D, Cao X, Gao Y, Wang L, Shen D (2016) Estimating ct image from mri data using 3d fully convolutional networks. In: Deep learning and data labeling for medical applications: first international workshop, LABELS 2016, and second international workshop, DLMIA 2016, Held in conjunction with MICCAI 2016, Athens, Greece, October 21, 2016, Proceedings 1, Springer, pp 170–178

Han X. Mr-based synthetic ct generation using a deep convolutional neural network method. Med Phys. 2017;44(4):1408–19.

Article  Google Scholar 

Li Y, Li W, He P, Xiong J, Xia J, Xie Y (2019) Ct synthesis from MRI images based on deep learning methods for mri-only radiotherapy. In: 2019 international conference on medical imaging physics and engineering (ICMIPE), . IEEE, pp 1–6

Bahrami A, Karimian A, Fatemizadeh E, Arabi H, Zaidi H. A new deep convolutional neural network design with efficient learning capability: Application to ct image synthesis from mri. Med Phys. 2020;47(10):5158–71.

Article  Google Scholar 

Xiang L, Wang Q, Nie D, Zhang L, Jin X, Qiao Y, Shen D. Deep embedding convolutional neural network for synthesizing CT image from t1-weighted MR image. Med Image Anal. 2018;47:31–44.

Article  Google Scholar 

Zhao Y, Liao S, Guo Y, Zhao L, Yan Z, Hong S, Hermosillo G, Liu T, Zhou XS, Zhan Y (2018) Towards MR-only radiotherapy treatment planning: synthetic CT generation using multi-view deep convolutional neural networks. In: Medical image computing and computer assisted intervention–MICCAI 2018: 21st International Conference, Granada, Spain, September 16-20, 2018, Proceedings, Part I, Springer, pp 286–294

Li Y, Xu S, Chen H, Sun Y, Bian J, Guo S, Lu Y, Qi Z. CT synthesis from multi-sequence MRI using adaptive fusion network. Compt Biol Med. 2023;157:1067310673106738.

Google Scholar 

Zhao S, Geng C, Guo C, Tian F, Tang X. Saru: A self-attention resunet to generate synthetic CT images for MR-only BNCT treatment planning. Med Phys. 2023;50(1):117–27.

Article  Google Scholar 

Emami H, Dong M, Nejad-Davarani SP, Glide-Hurst CK. Generating synthetic CTs from magnetic resonance images using generative adversarial networks. Med phys. 2018;45(8):3627–36.

Article  Google Scholar 

Ranjan A, Lalwani D, Misra R. Gan for synthesizing CT from t2-weighted MRI data towards MR-guided radiation treatment. Magn Reson Mater Phys Biol Med. 2022;35(3):449–57.

Article  Google Scholar 

Nie D, Trullo R, Lian J, Petitjean C, Ruan S, Wang Q, Shen D (2017) Medical image synthesis with context-aware generative adversarial networks. In: medical image computing and computer assisted intervention- MICCAI 2017: 20th international conference, Quebec City, QC, Canada, September 11-13, 2017, Proceedings, Part III 20, 2017, Springer, pp 417–425

Mendes J, Pereira T, Silva F, Frade J, Morgado J, Freitas C, Negrão E, De Lima BF, Da Silva MC, Madureira AJ, et al. Lung CT image synthesis using gans. Expert Syst Appl. 2023;215: 119350.

Article  Google Scholar 

Arabi H, Zeng G, Zheng G, Zaidi H. Novel adversarial semantic structure deep learning for MRI-guided attenuation correction in brain pet/MRI. Eur J Nucl Med Mol Imaging. 2019;46:2746–59.

Article  Google Scholar 

Lei Y, Harms J, Wang T, Liu Y, Shu H-K, Jani AB, Curran WJ, Mao H, Liu T, Yang X. MRI-only based synthetic CT generation using dense cycle consistent generative adversarial networks. Med Phys. 2019;46(8):3565–81.

Article  Google Scholar 

Vajpayee R, Agrawal V, Krishnamurthi G. Structurally-constrained optical-flow-guided adversarial generation of synthetic CT for MR-only radiotherapy treatment planning. Sci Rep. 2022;12(1):14855.

Article  Google Scholar 

Klages P, Benslimane I, Riyahi S, Jiang J, Hunt M, Deasy JO, Veeraraghavan H, Tyagi N. Patch-based generative adversarial neural network models for head and neck MR-only planning. Med Phys. 2020;47(2):626–42.

Article  Google Scholar 

Qi M, Li Y, Wu A, Jia Q, Li B, Sun W, Dai Z, Lu X, Zhou L, Deng X, et al. Multi-sequence MR image-based synthetic CT generation using a generative adversarial network for head and neck MRI-only radiotherapy. Med Phys. 2020;47(4):1880–94.

Article  Google Scholar 

Joseph J, Prasanth R, Maret SA, Pournami P, Jayaraj P, Puzhakkal N (2022) CT image synthesis from MR image using edge-aware generative adversarial network. In: international conference on computer vision and image processing, Springer, pp 141–153

Park SH, Choi DM, Jung I-H, Chang KW, Kim MJ, Jung HH, Chang JW, Kim H, Chang WS. Clinical application of deep learning-based synthetic CT from real MRI to improve dose planning accuracy in gamma knife radiosurgery: a proof of concept study. Biomed Eng Lett. 2022;12(4):359–67.

Article  Google Scholar 

Wang J, Yan B, Wu X, Jiang X, Zuo Y, Yang Y. Development of an unsupervised cycle contrastive unpaired translation network for MRI-to-CT synthesis. J Appl Clin Med Phys. 2022;23(11):13775.

Article  Google Scholar 

Wolterink JM, Dinkla AM, Savenije MH, Seevinck PR, Berg CA, Išgum I (2017) Deep MR to CT synthesis using unpaired data. In: simulation and synthesis in medical imaging: second international workshop, Sashimi 2017, Held in conjunction with MICCAI 2017, Québec City, QC, Canada, September 10, 2017, Proceedings 2, Springer, pp 14–23.

Yang H, Sun J, Carass A, Zhao C, Lee J, Xu Z, Prince J. Unpaired brain MR-to-CT synthesis using a structure-constrained cyclegan. In: deep learning in medical image analysis and multimodal learning for clinical decision support: 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 20, 2018, Proceedings 4, 2018, . Springer, pp 174–182

Heinrich MP, Jenkinson M, Bhushan M, Matin T, Gleeson FV, Brady M, Schnabel JA. Mind: Modality independent neighbourhood descriptor for multi-modal deformable registration. Med Image Anal. 2012;16(7):1423–35.

Article  Google Scholar 

Yang H, Sun J, Carass A, Zhao C, Lee J, Prince JL, Xu Z. Unsupervised MR-to-CT synthesis using structure-constrained cyclegan. IEEE Trans Med Imaging. 2020;39(12):4249–61.

Article  Google Scholar 

Ge Y, Wei D, Xue Z, Wang Q, Zhou X, Zhan Y, Liao S (2019) Unpaired MR to CT synthesis with explicit structural constrained adversarial learning. In: 2019 IEEE 16th international symposium on biomedical imaging (ISBI 2019), pp 1096–1099, https://doi.org/10.1109/ISBI.2019.8759529

Song S, Zhang J, Hu W, Luo Y, Zhou X (2023) Spatially invariant and frequency-aware cyclegan for unsupervised MR-to-CT synthesis. In: international conference on artificial neural networks, Springer, pp 332–343

Phan VMH, Liao Z, Verjans JW, To M-S (2023) Structure-preserving synthesis: Maskgan for unpaired MR-CT translation. In: international conference on medical image computing and computer-assisted intervention, Springer, 56–65

Liu Y, Chen A, Shi H, Huang S, Zheng W, Liu Z, Zhang Q, Yang X. Ct synthesis from MRI using multi-cycle gan for head-and-neck radiation therapy. Comput Med Imaging Gr. 2021;91: 101953.

Article  Google Scholar 

Kang SK, An HJ, Jin H, Kim J-I, Chie EK, Park JM, Lee JS. Synthetic CT generation from weakly paired MR images using cycle-consistent gan for MR-guided radiotherapy. Biomed Eng Lett. 2021;11(3):263–71.

Article  Google Scholar 

Sun B, Jia S, Jiang X, Jia F. Double u-net cyclegan for 3d MR to CT image synthesis. Int J Comput Assist Radiol Surg. 2023;18(1):149–56.

Article  Google Scholar 

Jiangtao W, Xinhong W, Xiao J, Bing Y, Lei Z, Yidong Y (2021) MRI to CT synthesis using contrastive learning. In: 2021 IEEE international conference on medical imaging physics and engineering (ICMIPE), IEEE, pp 1–5

Zhong L, Chen Z, Shu H, Zheng K, Li Y, Chen W, Wu Y, Ma J, Feng Q, Yang W (2023) Multi-scale tokens-aware transformer network for multi-region and multi-sequence MR-to-CT synthesis in a single model. IEEE transactions on medical imaging.

Dalmaz O, Yurt M, Çukur T. Resvit: residual vision transformers for multimodal medical image synthesis. IEEE Trans Med Imaging. 2022;41(10):2598–614.

Article  Google Scholar 

Li Y, Xu S, Lu Y, Qi Z. CT synthesis from MRI with an improved multi-scale learning network. Front Phys. 2023;11:1088899.

Article  Google Scholar 

Zhao B, Cheng T, Zhang X, Wang J, Zhu H, Zhao R, Li D, Zhang Z, Yu G. CT synthesis from MR in the pelvic area using residual transformer conditional gan. Comput Med Imaging Gr. 2023;103:102150.

Article  Google Scholar 

Pan S, Abouei E, Wynne J, Chang C-W, Wang T, Qiu RL, Li Y, Peng J, Roper J, Patel P. et al. (2023) Synthetic CT generation from MRI using 3d transformer-based denoising diffusion model. Med Phys

Lyu Q, Wang G (2022) Conversion between CT and MRI images using diffusion and score-matching models. arXiv preprint arXiv:2209.12104

Özbey M, Dalmaz O, Dar SU, Bedel HA, Özturk Ş, Güngör A, Çukur T (2023) Unsupervised medical image translation with adversarial diffusion models. IEEE Transactions on Medical Imaging

Graf R, Schmitt J, Schlaeger S, Möller HK, Sideri-Lampretsa V, Sekuboyina A, Krieg SM, Wiestler B, Menze B, Rueckert D, et al. Denoising diffusion-based mri to ct image translation enables automated spinal segmentation. Eur Radiol Exp. 2023;7(1):70.

Article  Google Scholar 

Pan S, Wang T, Qiu RL, Axente M, Chang C-W, Peng J, Patel AB, Shelton J, Patel SA, Roper J, et al. 2d medical image synthesis using transformer-based denoising diffusion probabilistic model. Phys Med Biol. 2023;68(10):105004.

Article  Google Scholar 

留言 (0)

沒有登入
gif