Alternative Learning Paradigms for Image Quality Transfer

Ahmed Karam Eldaly1,2Orcid, Matteo Figini1Orcid, Daniel C. Alexander1Orcid
1: Centre for Medical Image Computing, Department of Computer Science, University College London, UK, 2: Department of Computer Science, University of Exeter, UK
Publication date: 2024/11/12
https://doi.org/10.59275/j.melba.2024-1656
PDF

Abstract

Image Quality Transfer (IQT) aims to enhance the contrast and resolution of low-quality medical images, e.g. obtained from low-power devices, with rich information learned from higher quality images. In contrast to existing IQT methods in the literature which adopt supervised learning frameworks, in this work, we propose two novel formulations of the IQT problem. The first approach uses an unsupervised learning framework, whereas the second is a combination of both supervised and unsupervised learning. The unsupervised learning approach considers a sparse representation (SRep) and dictionary learning model, which we call IQT-SRep, whereas the combination of supervised and unsupervised learning ap- proach is based on deep dictionary learning (DDL), which we call IQT-DDL. The IQT-SRep approach trains two dictionaries using a sparse representation model using pairs of low- and high-quality volumes. Subsequently, the sparse representation of a low-quality block, in terms of the low-quality dictionary, can be directly used to recover the corresponding high-quality block using the high-quality dictionary. On the other hand, the IQT-DDL ap- proach explicitly learns a high-resolution dictionary to upscale the input volume, while the entire network, including high dictionary generator, is simultaneously optimised to take full advantage of deep learning methods. The two models are evaluated using a low-field mag- netic resonance imaging (MRI) application aiming to recover high-quality images akin to those obtained from high-field scanners. Experiments comparing the proposed approaches against state-of-the-art supervised deep learning IQT method (IQT-DL) identify that the two novel formulations of the IQT problem can avoid bias associated with supervised meth- ods when tested using out-of-distribution data that differs from the distribution of the data the model was trained on. This highlights the potential benefit of these novel paradigms for IQT.

Keywords

Image Quality Transfer · Supervised Learning · Unsupervised Learning · Sparse Representation · Dictionary Learning · Deep Dictionary Learning · Deep Learning · Out-of-Distribution · In-distribution

Bibtex @article{melba:2024:027:eldaly, title = "Alternative Learning Paradigms for Image Quality Transfer", author = "Eldaly, Ahmed Karam and Figini, Matteo and Alexander, Daniel C.", journal = "Machine Learning for Biomedical Imaging", volume = "3", issue = "November 2024 issue", year = "2024", pages = "2195--2222", issn = "2766-905X", doi = "https://doi.org/10.59275/j.melba.2024-1656", url = "https://melba-journal.org/2024:027" }
RISTY - JOUR AU - Eldaly, Ahmed Karam AU - Figini, Matteo AU - Alexander, Daniel C. PY - 2024 TI - Alternative Learning Paradigms for Image Quality Transfer T2 - Machine Learning for Biomedical Imaging VL - 3 IS - November 2024 issue SP - 2195 EP - 2222 SN - 2766-905X DO - https://doi.org/10.59275/j.melba.2024-1656 UR - https://melba-journal.org/2024:027 ER -

2024:027 cover