Conventional computer vision pipelines typically treat low-level enhancement and high-level semantic tasks as isolated processes, focusing on optimizing enhancement for perceptual quality rather than computational utility, neglecting semantic task requirements. To bridge this gap, this paper proposes an integrated joint optimization architecture that aligns the objectives of enhancement tasks with the practical needs of semantic tasks. Specifically, the architecture ensures that medical image segmentation (the semantic task) benefits directly from super-resolution pre-processing (the enhancement task). This integrated architecture fundamentally differs from conventional sequential frameworks by enabling joint training of super-resolution and segmentation networks. Guided by its own content reconstruction loss and semantic loss transferred from segmentation, the super-resolution network prioritizes semantically significant regions for segmentation-driven reconstruction. Comprehensive comparative and ablation studies demonstrate that the network, trained jointly, markedly enhances segmentation performance in low-resolution images, even outperforming those directly from referenced high-resolution images. The code is available at https://github.com/kldys/JOANet
基金:
STI2030-Major Projects [2022ZD0204600]; Sichuan Science and Technology Program [2024NSFSC0505]; Huzhou Science and Technology Program [2023GZ13]
第一作者机构:[1]Univ Elect Sci & Technol China UESTC, Sichuan Canc Hosp & Inst, Sch Life Sci & Technol, Chengdu 610054, Peoples R China
共同第一作者:
通讯作者:
推荐引用方式(GB/T 7714):
Qiu Cheng-Hao,Zhang Xian-Shi,Li Yong-Jie.JOANet: An Integrated Joint Optimization Architecture Making Medical Image Segmentation Really Helped by Super-Resolution Pre-Processing[J].IEEE TRANSACTIONS ON IMAGE PROCESSING.2025,34:7008-7023.doi:10.1109/TIP.2025.3620627.
APA:
Qiu, Cheng-Hao,Zhang, Xian-Shi&Li, Yong-Jie.(2025).JOANet: An Integrated Joint Optimization Architecture Making Medical Image Segmentation Really Helped by Super-Resolution Pre-Processing.IEEE TRANSACTIONS ON IMAGE PROCESSING,34,
MLA:
Qiu, Cheng-Hao,et al."JOANet: An Integrated Joint Optimization Architecture Making Medical Image Segmentation Really Helped by Super-Resolution Pre-Processing".IEEE TRANSACTIONS ON IMAGE PROCESSING 34.(2025):7008-7023