Enhancing Interpretability of Vertebrae Fracture Grading using Human-interpretable Prototypes

Poulami Sinhamahapatra1,2Orcid, Suprosanna Shit2Orcid, Anjany Sekuboyina2Orcid, Malek El Husseini2Orcid, David Schinz2Orcid, Nicolas Lenhart2, Bjoern Menze3Orcid, Jan Kirschke2Orcid, Karsten Roscher1Orcid, Stephan Guennemann2Orcid
1: Fraunhofer IKS, Germany, 2: Technical Univeristy of Munich, Germany, 3: University of Zurich, Switzerland
Publication date: 2024/07/31
https://doi.org/10.59275/j.melba.2024-258b
PDF · arXiv

Abstract

Vertebral fracture grading classifies the severity of vertebral fractures, which is a challenging task in medical imaging and has recently attracted Deep Learning (DL) models. Only a few works attempted to make such models human-interpretable despite the need for transparency and trustworthiness in critical use cases like DL-assisted medical diagnosis. Moreover, such models either rely on post-hoc methods or additional annotations. In this work, we propose a novel interpretable-by-design method, ProtoVerse, to find relevant sub-parts of vertebral fractures (prototypes) that reliably explain the model’s decision in a human-understandable way. Specifically, we introduce a novel diversity-promoting loss to mitigate prototype repetitions in small datasets with intricate semantics. We have experimented with the VerSe’19 dataset and outperformed the existing prototype-based method. Further, our model provides superior interpretability against the post-hoc method. Importantly, expert radiologists validated the visual interpretability of our results, showing clinical applicability.

Keywords

Machine Learning · Interpretability · Explainability

Bibtex @article{melba:2024:015:sinhamahapatra, title = "Enhancing Interpretability of Vertebrae Fracture Grading using Human-interpretable Prototypes", author = "Sinhamahapatra, Poulami and Shit, Suprosanna and Sekuboyina, Anjany and El Husseini, Malek and Schinz, David and Lenhart, Nicolas and Menze, Bjoern and Kirschke, Jan and Roscher, Karsten and Guennemann, Stephan", journal = "Machine Learning for Biomedical Imaging", volume = "2", issue = "July 2024 issue", year = "2024", pages = "977--1002", issn = "2766-905X", doi = "https://doi.org/10.59275/j.melba.2024-258b", url = "https://melba-journal.org/2024:015" }
RISTY - JOUR AU - Sinhamahapatra, Poulami AU - Shit, Suprosanna AU - Sekuboyina, Anjany AU - El Husseini, Malek AU - Schinz, David AU - Lenhart, Nicolas AU - Menze, Bjoern AU - Kirschke, Jan AU - Roscher, Karsten AU - Guennemann, Stephan PY - 2024 TI - Enhancing Interpretability of Vertebrae Fracture Grading using Human-interpretable Prototypes T2 - Machine Learning for Biomedical Imaging VL - 2 IS - July 2024 issue SP - 977 EP - 1002 SN - 2766-905X DO - https://doi.org/10.59275/j.melba.2024-258b UR - https://melba-journal.org/2024:015 ER -

2024:015 cover