| Title: |
Reassessing the Role of Machine Learning in Clinical Prediction: A Benchmark of Predicting Walking Function after Spinal Cord Injury |
| Authors: |
Bugajska, Julia; Lukas, Louis; id_orcid:0 000-0001-9307-0945; Rupp, Rüdiger; Weidner, Norbert; Schubert, Martin; Röhrich, Frank; Waldmann, Josina; Kalke, Yorck B.; Abel, Rainer; Maier, Doris; Chhabra, Harvinder S.; Liebscher, Thomas; Curt, Armin; Brüningk, Sarah Catharina; Jutzeler, Catherine |
| Source: |
Journal of Neurotrauma |
| Publisher Information: |
Mary Ann Liebert |
| Publication Year: |
2026 |
| Collection: |
ETH Zürich Research Collection |
| Subject Terms: |
benchmarking; machine learning; recovery prediction; traumatic spinal cord injury |
| Description: |
In light of growing biomedical data, machine learning (ML) models offer tremendous potential for personalized prediction in medicine. However, the additional value provided by these computational tools should always be critically evaluated. Using the example of predicting walking ability after spinal cord injury (SCI), we highlight a popular scenario in which data-driven predictions are feasible but not clinically meaningful, as the task can be performed equally well by humans. We asked 11 human observers from diverse backgrounds (five researchers without clinical training but proven knowledge of SCI and the International Standards for Neurological Classification of SCI [ISNCSCI], and six neurologists experienced in SCI) to predict walking ability following SCI based on acute phase neurological status assessed by the ISNCSCI motor and sensory scores (≤40 days after injury [DAI]). Following an established clinical prediction rule, walking ability was defined by a binary label derived from the indoor walking ability subitem of the Spinal Cord Independence Measure. We compared the performance of human observers with extreme gradient boosting and logistic regression-based models, which represent popular approaches in clinical literature on SCI. Using 794 patients from the European Multicenter Study about SCI, we show that all approaches provide similar, excellent performance at population level (area under the receiver operating characteristic 0.93–0.95; accuracy 0.88–0.90). Importantly, predictions combined from multiple neurologists (accuracy: 0.89) were comparable with model-based predictions (accuracy: 0.88–0.90), whereas individual neurologists (accuracy: 0.79 [0.01]; mean [standard deviation]) were marginally outperformed by computational approaches (accuracy: 0.88–0.90), particularly for more heterogeneous incomplete injuries. Individual SCI researchers performed equally well compared with neurologists (accuracy: 0.78 [0.02]). Our results show that prediction of walking function following SCI, if described ... |
| Document Type: |
article in journal/newspaper |
| File Description: |
application/application/pdf |
| Language: |
English |
| Relation: |
info:eu-repo/grantAgreement/SNF/Ambizione/186101; info:eu-repo/grantAgreement/SNF/Interdisziplinäres Projekt/200275; https://hdl.handle.net/20.500.11850/796517 |
| DOI: |
10.3929/ethz-c-000796517 |
| Availability: |
https://hdl.handle.net/20.500.11850/796517; https://doi.org/10.3929/ethz-c-000796517 |
| Rights: |
info:eu-repo/semantics/openAccess ; http://creativecommons.org/licenses/by/4.0/ ; Creative Commons Attribution 4.0 International |
| Accession Number: |
edsbas.2FE1BC6C |
| Database: |
BASE |