Image Quality Transfer (IQT) aims to enhance the contrast and resolution of low-quality medical images, e.g. obtained from low-power devices, with rich information learned from higher quality images. In contrast to existing IQT methods in the literature which adopt supervised learning frameworks, in this work, we propose two novel formulations of the IQT problem. The first approach uses an unsupervised learning framework, whereas the second is a combination of both supervised and unsupervised learning. The unsupervised learning approach considers a sparse representation (SRep) and dictionary learning model, which we call IQT-SRep, whereas the combination of supervised and unsupervised learning ap- proach is based on deep dictionary learning (DDL), which we call IQT-DDL. The IQT-SRep approach trains two dictionaries using a sparse representation model using pairs of low- and high-quality volumes. Subsequently, the sparse representation of a low-quality block, in terms of the low-quality dictionary, can be directly used to recover the corresponding high-quality block using the high-quality dictionary. On the other hand, the IQT-DDL ap- proach explicitly learns a high-resolution dictionary to upscale the input volume, while the entire network, including high dictionary generator, is simultaneously optimised to take full advantage of deep learning methods. The two models are evaluated using a low-field mag- netic resonance imaging (MRI) application aiming to recover high-quality images akin to those obtained from high-field scanners. Experiments comparing the proposed approaches against state-of-the-art supervised deep learning IQT method (IQT-DL) identify that the two novel formulations of the IQT problem can avoid bias associated with supervised meth- ods when tested using out-of-distribution data that differs from the distribution of the data the model was trained on. This highlights the potential benefit of these novel paradigms for IQT.
Image Quality Transfer · Supervised Learning · Unsupervised Learning · Sparse Representation · Dictionary Learning · Deep Dictionary Learning · Deep Learning · Out-of-Distribution · In-distribution
@article{melba:2024:027:eldaly,
title = "Alternative Learning Paradigms for Image Quality Transfer",
author = "Eldaly, Ahmed Karam and Figini, Matteo and Alexander, Daniel C.",
journal = "Machine Learning for Biomedical Imaging",
volume = "2",
issue = "November 2024 issue",
year = "2024",
pages = "2195--2222",
issn = "2766-905X",
doi = "https://doi.org/10.59275/j.melba.2024-1656",
url = "https://melba-journal.org/2024:027"
}
TY - JOUR
AU - Eldaly, Ahmed Karam
AU - Figini, Matteo
AU - Alexander, Daniel C.
PY - 2024
TI - Alternative Learning Paradigms for Image Quality Transfer
T2 - Machine Learning for Biomedical Imaging
VL - 2
IS - November 2024 issue
SP - 2195
EP - 2222
SN - 2766-905X
DO - https://doi.org/10.59275/j.melba.2024-1656
UR - https://melba-journal.org/2024:027
ER -