Weakly Supervised Intracranial Hemorrhage Segmentation using Head-Wise Gradient-Infused Self-Attention Maps from a Swin Transformer in Categorical Learning

Amirhossein Rasoulian1Orcid, Soorena Salari1Orcid, Yiming Xiao1Orcid
1: Department of Computer Science and Software Engineering, Concordia University, Montreal, QC, Canada
Publication date: 2023/08/29
https://doi.org/10.59275/j.melba.2023-553a
PDF · Code · arXiv

Abstract

Intracranial hemorrhage (ICH) is a life-threatening medical emergency that requires timely and accurate diagnosis for effective treatment and improved patient survival rates. While deep learning techniques have emerged as the leading approach for medical image analysis and processing, the most commonly employed supervised learning often requires large, high-quality annotated datasets that can be costly to obtain, particularly for pixel/voxel-wise image segmentation. To address this challenge and facilitate ICH treatment decisions, we introduce a novel weakly supervised method for ICH segmentation, utilizing a Swin transformer trained on an ICH classification task with categorical labels. Our approach leverages a hierarchical combination of head-wise gradient-infused self-attention maps to generate accurate image segmentation. Additionally, we conducted an exploratory study on different learning strategies and showed that binary ICH classification has a more positive impact on self-attention maps compared to full ICH subtyping. With a mean Dice score of 0.44, our technique achieved similar ICH segmentation performance as the popular U-Net and Swin-UNETR models with full supervision and outperformed a similar weakly supervised approach using GradCAM, demonstrating the excellent potential of the proposed framework in challenging medical image segmentation tasks. Our code is available at https://github.com/HealthX-Lab/HGI-SAM

Keywords

Weak Supervision · Image Segmentation · Swin Transformer · Intracranial Hemorrhage · Self-attention

Bibtex @article{melba:2023:012:rasoulian, title = "Weakly Supervised Intracranial Hemorrhage Segmentation using Head-Wise Gradient-Infused Self-Attention Maps from a Swin Transformer in Categorical Learning", author = "Rasoulian, Amirhossein and Salari, Soorena and Xiao, Yiming", journal = "Machine Learning for Biomedical Imaging", volume = "2", issue = "MLCN 2022 special issue", year = "2023", pages = "338--360", issn = "2766-905X", doi = "https://doi.org/10.59275/j.melba.2023-553a", url = "https://melba-journal.org/2023:012" }
RISTY - JOUR AU - Rasoulian, Amirhossein AU - Salari, Soorena AU - Xiao, Yiming PY - 2023 TI - Weakly Supervised Intracranial Hemorrhage Segmentation using Head-Wise Gradient-Infused Self-Attention Maps from a Swin Transformer in Categorical Learning T2 - Machine Learning for Biomedical Imaging VL - 2 IS - MLCN 2022 special issue SP - 338 EP - 360 SN - 2766-905X DO - https://doi.org/10.59275/j.melba.2023-553a UR - https://melba-journal.org/2023:012 ER -

2023:012 cover