dorsal/arxiv
View SchemaHandling Missing Modalities in Multimodal Survival Prediction for Non-Small Cell Lung Cancer
| Authors | Filippo Ruffini, Camillo Maria Caruso, Claudia Tacconi, Lorenzo Nibid, Francesca Miccolis, Marta Lovino, Carlo Greco, Edy Ippolito, Michele Fiore, Alessio Cortellini, Bruno Beomonte Zobel, Giuseppe Perrone, Bruno Vincenzi, Claudio Marrocco, Alessandro Bria, Elisa Ficarra, Sara Ramella, Valerio Guarrasi, Paolo Soda |
|---|---|
| Categories | |
| ArXiv ID | 2601.10386vv1 |
| URL | https://arxiv.org/abs/2601.10386 |
| License | http://creativecommons.org/licenses/by-nc-sa/4.0/ |
Abstract
Accurate survival prediction in Non-Small Cell Lung Cancer (NSCLC) requires the integration of heterogeneous clinical, radiological, and histopathological information. While Multimodal Deep Learning (MDL) offers a promises for precision prognosis and survival prediction, its clinical applicability is severely limited by small cohort sizes and the presence of missing modalities, often forcing complete-case filtering or aggressive imputation. In this work, we present a missing-aware multimodal survival framework that integrates Computed Tomography (CT), Whole-Slide Histopathology (WSI) Images, and structured clinical variables for overall survival modeling in unresectable stage II-III NSCLC. By leveraging Foundation Models (FM) for modality-specific feature extraction and a missing-aware encoding strategy, the proposed approach enables intermediate multimodal fusion under naturally incomplete modality profiles. The proposed architecture is resilient to missing modalities by design, allowing the model to utilize all available data without being forced to drop patients during training or inference. Experimental results demonstrate that intermediate fusion consistently outperforms unimodal baselines as well as early and late fusion strategies, with the strongest performance achieved by the fusion of WSI and clinical modalities (73.30 C-index). Further analyses of modality importance reveal an adaptive behavior in which less informative modalities, i.e., CT modality, are automatically down-weighted and contribute less to the final survival prediction.
{
"annotation_id": "e143d768-784a-4761-9c0f-af807006e132",
"date_created": "2026-02-17T05:53:24.173000Z",
"date_modified": "2026-02-17T05:53:24.173000Z",
"file_hash": "18185771a0daa4461d12c10b163099c0f0f5eaf998d80afeff5b142f11cf7d92",
"private": false,
"record": {
"abstract": "Accurate survival prediction in Non-Small Cell Lung Cancer (NSCLC) requires the integration of heterogeneous clinical, radiological, and histopathological information. While Multimodal Deep Learning (MDL) offers a promises for precision prognosis and survival prediction, its clinical applicability is severely limited by small cohort sizes and the presence of missing modalities, often forcing complete-case filtering or aggressive imputation. In this work, we present a missing-aware multimodal survival framework that integrates Computed Tomography (CT), Whole-Slide Histopathology (WSI) Images, and structured clinical variables for overall survival modeling in unresectable stage II-III NSCLC. By leveraging Foundation Models (FM) for modality-specific feature extraction and a missing-aware encoding strategy, the proposed approach enables intermediate multimodal fusion under naturally incomplete modality profiles. The proposed architecture is resilient to missing modalities by design, allowing the model to utilize all available data without being forced to drop patients during training or inference. Experimental results demonstrate that intermediate fusion consistently outperforms unimodal baselines as well as early and late fusion strategies, with the strongest performance achieved by the fusion of WSI and clinical modalities (73.30 C-index). Further analyses of modality importance reveal an adaptive behavior in which less informative modalities, i.e., CT modality, are automatically down-weighted and contribute less to the final survival prediction.",
"arxiv_id": "2601.10386",
"authors": [
"Filippo Ruffini",
"Camillo Maria Caruso",
"Claudia Tacconi",
"Lorenzo Nibid",
"Francesca Miccolis",
"Marta Lovino",
"Carlo Greco",
"Edy Ippolito",
"Michele Fiore",
"Alessio Cortellini",
"Bruno Beomonte Zobel",
"Giuseppe Perrone",
"Bruno Vincenzi",
"Claudio Marrocco",
"Alessandro Bria",
"Elisa Ficarra",
"Sara Ramella",
"Valerio Guarrasi",
"Paolo Soda"
],
"categories": [
"cs.CV",
"cs.AI",
"cs.MM"
],
"license": "http://creativecommons.org/licenses/by-nc-sa/4.0/",
"title": "Handling Missing Modalities in Multimodal Survival Prediction for Non-Small Cell Lung Cancer",
"url": "https://arxiv.org/abs/2601.10386",
"version": "v1"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "27af7840-4471-45ce-81ad-17da64d4af92",
"id": "arXiv Dataset",
"type": "Model",
"variant": "snapshot-2026-01-17",
"version": "0.1.0"
},
"user_id": 1000002
}