Dovletov, Gurbandurdy; Karadeniz, Utku; Lörcks, Stefan; Pauli, Josef; Gratz, Marcel; Quick, Harald H.:
Bone-Aware Generative Adversarial Network with Supervised Attention Mechanism for MRI-Based Pseudo-CT Synthesis
In: Proceedings of the 17th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOIMAGING 2024) - 17th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOIMAGING 2024): Rome, Italy - Setúbal: SciTePress, 2024, Band 1, S. 223 - 235
2024Buchaufsatz/Kapitel in TagungsbandClosed access
InformatikFakultät für Ingenieurwissenschaften » Informatik und Angewandte Kognitionswissenschaft » Informatik » Intelligente SystemeForschungszentren » Erwin L. Hahn Institute for Magnetic Resonance Imaging (ELH)
Titel in Englisch:
Bone-Aware Generative Adversarial Network with Supervised Attention Mechanism for MRI-Based Pseudo-CT Synthesis
Autor*in:
Dovletov, GurbandurdyUDE
LSF ID
59921
ORCID
0000-0002-2401-8745ORCID iD
Sonstiges
der Hochschule zugeordnete*r Autor*in
;
Karadeniz, Utku;Lörcks, StefanUDE
LSF ID
59326
ORCID
0000-0003-3641-4734ORCID iD
Sonstiges
der Hochschule zugeordnete*r Autor*in
;
Pauli, JosefUDE
GND
1160971668
LSF ID
10142
ORCID
0000-0003-0363-6410ORCID iD
Sonstiges
der Hochschule zugeordnete*r Autor*in
;
Gratz, Marcel;Quick, Harald H.UDE
GND
124361897
LSF ID
47417
Sonstiges
der Hochschule zugeordnete*r Autor*in
Open Access?:
Closed access
Sprache des Textes:
Englisch
Schlagwort, Thema:
Deep Learning; Image-to-Image Translation; Pseudo-CT Synthesis; Attention Mechanisms; Attention U-Net; Generative Adversarial Network
Ressourcentyp:
Text

Abstract in Englisch:

Deep learning techniques offer the potential to learn the mapping function from MRI to CT domains, allowing the generation of synthetic CT images from MRI source data. However, these image-to-image translation methods often introduce unwanted artifacts and struggle to accurately reproduce bone structures due to the absence of bone-related information in the source data. This paper extends the recently introduced Attention U-Net with Extra Supervision (Att U-Net ES), which has shown promising improvements for the bone regions. Our proposed approach, a conditional Wasserstein GAN with Attention U-Net as the generator, leverages the network’s self-attention property while simultaneously including domain-specific knowledge (or bone awareness) in its learning process. The adversarial learning aspect of the proposed approach ensures that the attention gates capture both the overall shape and the fine-grained details of bone structures. We evaluate the proposed approach using cranial MR and CT images from the publicly available RIRE data set. Since the images are not aligned with each other, we also provide detailed information about the registration procedure. The obtained results are compared to Att U-Net ES, baseline U-Net and Attention U-Net, and their GAN extensions.