Intracranial hemorrhage (ICH) is a life-threatening medical emergency that requires timely and accurate diagnosis for effective treatment and improved patient survival rates. While deep learning techniques have emerged as the leading approach for medical image analysis and processing, the most commonly employed supervised learning often requires large, high-quality annotated datasets that can be costly to obtain, particularly for pixel/voxel-wise image segmentation. To address this challenge and facilitate ICH treatment decisions, we introduce a novel weakly supervised method for ICH segmentation, utilizing a Swin transformer trained on an ICH classification task with categorical labels. Our approach leverages a hierarchical combination of head-wise gradient-infused self-attention maps to generate accurate image segmentation. Additionally, we conducted an exploratory study on different learning strategies and showed that binary ICH classification has a more positive impact on self-attention maps compared to full ICH subtyping. With a mean Dice score of 0.44, our technique achieved similar ICH segmentation performance as the popular U-Net and Swin-UNETR models with full supervision and outperformed a similar weakly supervised approach using GradCAM, demonstrating the excellent potential of the proposed framework in challenging medical image segmentation tasks. Our code is available at https://github.com/HealthX-Lab/HGI-SAM
Weak Supervision · Image Segmentation · Swin Transformer · Intracranial Hemorrhage · Self-attention
@article{melba:2023:012:rasoulian,
title = "Weakly Supervised Intracranial Hemorrhage Segmentation using Head-Wise Gradient-Infused Self-Attention Maps from a Swin Transformer in Categorical Learning",
author = "Rasoulian, Amirhossein and Salari, Soorena and Xiao, Yiming",
journal = "Machine Learning for Biomedical Imaging",
volume = "2",
issue = "MLCN 2022 special issue",
year = "2023",
pages = "338--360",
issn = "2766-905X",
doi = "https://doi.org/10.59275/j.melba.2023-553a",
url = "https://melba-journal.org/2023:012"
}
TY - JOUR
AU - Rasoulian, Amirhossein
AU - Salari, Soorena
AU - Xiao, Yiming
PY - 2023
TI - Weakly Supervised Intracranial Hemorrhage Segmentation using Head-Wise Gradient-Infused Self-Attention Maps from a Swin Transformer in Categorical Learning
T2 - Machine Learning for Biomedical Imaging
VL - 2
IS - MLCN 2022 special issue
SP - 338
EP - 360
SN - 2766-905X
DO - https://doi.org/10.59275/j.melba.2023-553a
UR - https://melba-journal.org/2023:012
ER -