Dovletov, Gurbandurdy; Pham, Duc Duy; Pauli, Josef; Gratz, Marcel; Quick, Harald H.:
Improved MRI-based Pseudo-CT Synthesis via Segmentation Guided Attention Networks
In: Proceedings of the 15th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOIMAGING) : Volume 2 / Gracani, Denis; Fred, Ana; Gamboa, Hugo (Hrsg.). - 15th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOIMAGING), 9-11 February 2022, Online - Setúbal: SciTePress, 2022, S. 131 - 140
2022Buchaufsatz/Kapitel in TagungsbandClosed access
InformatikMedizinFakultät für Ingenieurwissenschaften » Informatik und Angewandte Kognitionswissenschaft » Informatik » Intelligente SystemeForschungszentren » Erwin L. Hahn Institute for Magnetic Resonance Imaging (ELH)
Titel in Englisch:
Improved MRI-based Pseudo-CT Synthesis via Segmentation Guided Attention Networks
Autor*in:
Dovletov, GurbandurdyUDE
LSF ID
59921
ORCID
0000-0002-2401-8745ORCID iD
Sonstiges
der Hochschule zugeordnete*r Autor*in
;
Pham, Duc Duy;Pauli, JosefUDE
GND
1160971668
LSF ID
10142
ORCID
0000-0003-0363-6410ORCID iD
Sonstiges
der Hochschule zugeordnete*r Autor*in
;
Gratz, Marcel;Quick, Harald H.UDE
GND
124361897
LSF ID
47417
Sonstiges
der Hochschule zugeordnete*r Autor*in
Open Access?:
Closed access
Sprache des Textes:
Englisch
Schlagwort, Thema:
Image-to-Image Translation; Pseudo-CT; Attention Mechanism; U-Net; Generative Adversarial Network

Abstract in Englisch:

In this paper, we propose 2D MRI-based pseudo-CT (pCT) generation approaches that are inspired by U-Net and generative adversarial networks (GANs) and that additionally utilize coarse bone segmentation guided attention (SGA) mechanisms for better image synthesis. We first introduce and formulate SGA and its extended version (E-SGA), then we embed them into our baseline U-Net and conditional Wasserstein GAN (cWGAN) architectures. Since manual bone annotations are expensive, we derive coarse bone segmentations from CT/pCT images via thresholding and utilize them during the training phase to guide image-to-image translation attention networks. For inference, no additional segmentations are required. The performance of the proposed methods regarding the image generation quality is evaluated on the publicly available RIRE data set. Since MR and CT image pairs in this data set are not correctly aligned with each other, we also briefly describe the applied image registration procedure. The results of our experiments are compared to baseline U-Net and conditional Wasserstein GAN implementations and demonstrate improvements for bone regions.