| Description: |
Objectives: Tree-based models, such as random forest and XGBoost, are increasingly being used for clinical prediction, but certain aspects of their behavior are often overlooked. This article aims to illustrate these aspects and discuss the implications of plug-and-play use of tree-based models for clinical prediction. We focus on their ability to learn smooth, monotonic (ie, consistent predictor effect where an increase in predictor leads to an increase in predicted risk), and additive predictor-outcome associations (ie, each predictor independently and additively contributes to the outcome) and how they behave when making predictions outside the range of observed data (extrapolation). Study Design and Setting: We illustrated the behavior of plug-and-play use of tree-based models in a simulation study where we sampled predictors from standard normal distributions and binary outcomes determined by the logistic function of the predictors, and translate this into potential clinical implications in a real-world clinical example of post-radiotherapy toxicity prediction. To show the generalizability of our findings, we also assessed the model's behavior in a publicly available dataset of patients with head and neck cancer. For each analysis we visualized the learned predictor-outcome associations across different sample sizes. Results: In the simulation study, the models show stepwise fluctuations in their learned continuous predictor-outcome associations, which is caused by the inherent categorization of continuous predictors in a decision tree. Even with a large data size, the associations were not smooth or monotonic. Furthermore, because tree-based models can only split orthogonally to the axes, they struggle to learn an additive effect. Additionally, tree-based models extrapolate in a somewhat unintuitive way, by predicting a constant value beyond the observed data, regardless of further increases in predictor values. Using the clinical example and case study, we highlight that the learned associations are ... |