LNQ 2023 challenge: Benchmark of weakly-supervised techniques for mediastinal lymph node quantification

Reuben Dorent1Orcid, Roya Khajavi1, Tagwa Idris2Orcid, Erik Ziegler3Orcid, Bhanusupriya Somarouthu2,3Orcid, Heather Jacene1,4Orcid, Ann LaCasce4, Jonathan Deissler5, Jan Ehrhardt6,7, Sofija Engelson6Orcid, Stefan M. Fischer8,9,10Orcid, Yun Gu11Orcid, Heinz Handels6,7Orcid, Satoshi Kasai12Orcid, Satoshi Kondo13, Klaus Maier-Hein5,14Orcid, Julia A. Schnabel8,9,10,15Orcid, Guotai Wang16,17Orcid, Litingyu Wang16, Tassilo Wald5,14Orcid, Guang-Zhong Yang11Orcid, Hanxiao Zhang11Orcid, Minghui Zhang11, Steve Pieper18Orcid, Gordon Harris2,3Orcid, Ron Kikinis1Orcid, Tina Kapur1Orcid
1: Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA, 2: Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA, 3: Yunu, Inc., Cary, NC, USA, 4: Dana-Farber Cancer Institute, Boston, MA, USA, 5: Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany, 6: Institute of Medical Informatics, University of Lübeck, Lübeck, Germany, 7: German Research Center for Artificial Intelligence, Lübeck, Germany, 8: Technical University Munich, Munich, Germany, 9: Institute of Machine Learning in Biomedical Imaging, Helmholtz Munich, Munich, Germany, 10: Munich Center of Machine Learning (MCML), Munich, Germany, 11: Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China, 12: Niigata University of Health and Welfare, Niigata, Japan, 13: Muroran Institute of Technology, Hokkaido, Japan, 14: University of Heidelberg, Heidelberg, Germany, 15: School of Biomedical Engineering and Imaging Sciences, King’s College London, London, UK, 16: University of Electronic Science and Technology of China, Chengdu, China, 17: Shanghai AI laboratory, Shanghai, China, 18: Isomics Inc, Cambridge, MA, USA
Publication date: 2025/01/29
https://doi.org/10.59275/j.melba.2025-d482
PDF · Challenge · arXiv

Abstract

Accurate assessment of lymph node size in 3D CT scans is crucial for cancer staging, therapeutic management, and monitoring treatment response. Existing state-of-the-art segmentation frameworks in medical imaging often rely on fully annotated datasets. However, for lymph node segmentation, these datasets are typically small due to the extensive time and expertise required to annotate the numerous lymph nodes in 3D CT scans. Weakly-supervised learning, which leverages incomplete or noisy annotations, has recently gained interest in the medical imaging community as a potential solution. Despite the variety of weakly-supervised techniques proposed, most have been validated only on private datasets or small publicly available datasets. To address this limitation, the Mediastinal Lymph Node Quantification (LNQ) challenge was organized in conjunction with the 26th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2023). This challenge aimed to advance weakly-supervised segmentation methods by providing a new, partially annotated dataset and a robust evaluation framework. A total of 16 teams from 5 countries submitted predictions to the validation leaderboard, and 6 teams from 3 countries participated in the evaluation phase. The results highlighted both the potential and the current limitations of weakly-supervised approaches. On one hand, weakly-supervised approaches obtained relatively good performance with a median Dice score of 61.0%. On the other hand, top-ranked teams, with a median Dice score exceeding 70%, boosted their performance by leveraging smaller but fully annotated datasets to combine weak supervision and full supervision. This highlights both the promise of weakly-supervised methods and the ongoing need for high-quality, fully annotated data to achieve higher segmentation performance.

Keywords

Machine Learning · Image Segmentation · Weak Supervision · Lymph Node

Bibtex @article{melba:2025:001:dorent, title = "LNQ 2023 challenge: Benchmark of weakly-supervised techniques for mediastinal lymph node quantification", author = "Dorent, Reuben and Khajavi, Roya and Idris, Tagwa and Ziegler, Erik and Somarouthu, Bhanusupriya and Jacene, Heather and LaCasce, Ann and Deissler, Jonathan and Ehrhardt, Jan and Engelson, Sofija and Fischer, Stefan M. and Gu, Yun and Handels, Heinz and Kasai, Satoshi and Kondo, Satoshi and Maier-Hein, Klaus and Schnabel, Julia A. and Wang, Guotai and Wang, Litingyu and Wald, Tassilo and Yang, Guang-Zhong and Zhang, Hanxiao and Zhang, Minghui and Pieper, Steve and Harris, Gordon and Kikinis, Ron and Kapur, Tina", journal = "Machine Learning for Biomedical Imaging", volume = "3", issue = "MICCAI 2023 LNQ challenge special issue", year = "2025", pages = "1--15", issn = "2766-905X", doi = "https://doi.org/10.59275/j.melba.2025-d482", url = "https://melba-journal.org/2025:001" }
RISTY - JOUR AU - Dorent, Reuben AU - Khajavi, Roya AU - Idris, Tagwa AU - Ziegler, Erik AU - Somarouthu, Bhanusupriya AU - Jacene, Heather AU - LaCasce, Ann AU - Deissler, Jonathan AU - Ehrhardt, Jan AU - Engelson, Sofija AU - Fischer, Stefan M. AU - Gu, Yun AU - Handels, Heinz AU - Kasai, Satoshi AU - Kondo, Satoshi AU - Maier-Hein, Klaus AU - Schnabel, Julia A. AU - Wang, Guotai AU - Wang, Litingyu AU - Wald, Tassilo AU - Yang, Guang-Zhong AU - Zhang, Hanxiao AU - Zhang, Minghui AU - Pieper, Steve AU - Harris, Gordon AU - Kikinis, Ron AU - Kapur, Tina PY - 2025 TI - LNQ 2023 challenge: Benchmark of weakly-supervised techniques for mediastinal lymph node quantification T2 - Machine Learning for Biomedical Imaging VL - 3 IS - MICCAI 2023 LNQ challenge special issue SP - 1 EP - 15 SN - 2766-905X DO - https://doi.org/10.59275/j.melba.2025-d482 UR - https://melba-journal.org/2025:001 ER -

2025:001 cover