Predicting the prognosis of HER2-positive breast cancer patients by fusing pathological whole slide images and clinical features using multiple instance learning
机构：[1]School of Computer Science, Southwest Petroleum University, Chengdu 610500, China.[2]Institute of Applied Physics and Computational Mathematics, China Academy of Engineering Physics, Beijing 100094, China.[3]Institute of Clinical Pathology, Key Laboratory of Transplant Engineering and Immunology, NHC, West China Hospital, Sichuan University, Chengdu 610041, China.四川大学华西医院
In 2022, breast cancer will become an important factor affecting women's public health and HER2 positivity for approximately 15-20$ \% $ invasive breast cancer cases. Follow-up data for HER2-positive patients are rare, and research on prognosis and auxiliary diagnosis is still limited. In light of the findings obtained from the analysis of clinical features, we have developed a novel multiple instance learning (MIL) fusion model that integrates hematoxylin-eosin (HE) pathological images and clinical features to accurately predict the prognostic risk of patients. Specifically, we segmented the HE pathology images of patients into patches, clustered them by K-means, aggregated them into a bag feature-level representation through graph attention networks (GATs) and multihead attention networks, and fused them with clinical features to predict the prognosis of patients. We divided West China Hospital (WCH) patients (n = 1069) into a training cohort and internal validation cohort and used The Cancer Genome Atlas (TCGA) patients (n = 160) as an external test cohort. The 3-fold average C-index of the proposed OS-based model was 0.668, the C-index of the WCH test set was 0.765, and the C-index of the TCGA independent test set was 0.726. By plotting the Kaplan-Meier curve, the fusion feature (P = 0.034) model distinguished high- and low-risk groups more accurately than clinical features (P = 0.19). The MIL model can directly analyze a large number of unlabeled pathological images, and the multimodal model is more accurate than the unimodal models in predicting Her2-positive breast cancer prognosis based on large amounts of data.
基金：
Natural Science Foundation of Sichuan, China (2023NSFSC1393);
Scientific Research Starting Project of SWPU (2021QHZ001); Sichuan Nanchong Science and
Technology Bureau (SXQHJH046); West China Hospital of Sichuan University-University of
Electronic Science and Technology of China Medical-Industrial Integration Interdisciplinary Talent
Training Fund (ZYGX2022YGRH015); 1.3.5 Project for Disciplines of Excellence, West China
Hospital, Sichuan University (ZYJC21035) and Fund of Sichuan Provincial Department of Science
and Technology (2023YFH0095).
语种：
外文
PubmedID：
中科院(CAS)分区：
出版当年[2023]版：
大类|4 区工程技术
小类|4 区数学与计算生物学
最新[2023]版：
大类|4 区工程技术
小类|4 区数学与计算生物学
第一作者：
第一作者机构：[1]School of Computer Science, Southwest Petroleum University, Chengdu 610500, China.
通讯作者：
推荐引用方式(GB/T 7714)：
Wang Yifan,Zhang Lu,Li Yan,et al.Predicting the prognosis of HER2-positive breast cancer patients by fusing pathological whole slide images and clinical features using multiple instance learning[J].Mathematical biosciences and engineering : MBE.2023,20(6):11196-11211.doi:10.3934/mbe.2023496.
APA：
Wang Yifan,Zhang Lu,Li Yan,Wu Fei,Cao Shiyu&Ye Feng.(2023).Predicting the prognosis of HER2-positive breast cancer patients by fusing pathological whole slide images and clinical features using multiple instance learning.Mathematical biosciences and engineering : MBE,20,(6)
MLA：
Wang Yifan,et al."Predicting the prognosis of HER2-positive breast cancer patients by fusing pathological whole slide images and clinical features using multiple instance learning".Mathematical biosciences and engineering : MBE 20..6(2023):11196-11211
