| Title: |
Automatically Assessing Children’s Internalizing and Externalizing Behavior From Face and Head Dynamics During Parent-Child Interaction |
| Authors: |
Valtakari, Niilo V.; Hessels, Roy S.; Salah, Albert Ali; Onal Ertugrul, Itir; Sub Social and Affective Computing; Leerstoel Kemner; Helmholtz Institute; Experimental Psychology (onderzoeksprogramma PF) |
| Publication Year: |
2026 |
| Subject Terms: |
child psychopathology; computer vision; machine learning; nonverbal behavior; parent-child interaction; Clinical Psychology; Psychiatry and Mental health; SDG 3 - Good Health and Well-being |
| Description: |
Research on the automated assessment of mental disorders has primarily focused on adult participants and on behaviors on the individual level. We propose an approach to automatically assess the severity of children’s behavioral, emotional, and social problems from videos of face-to-face parent-child interaction. Children’s behavioral, emotional, and social problems were quantified using the Child Behavior Checklist (CBCL), focusing on the two broad categories “internalizing” and “externalizing” and the more specific categories “anxious”, “withdrawn”, and “aggressive”. Our experimental data comes from a cohort of 81 8- to 10-year-old children and their parents. We constructed features to represent the nonverbal face and head behaviors of the parents and children, combined them with the children’s symptom scores, and then fed these data to binary classifiers to make broad estimations of symptom severity. Prediction performance was good only for anxiety scores, although the prediction of withdrawal and internalizing scores did show some promise as well. We moreover identified the behaviors that were most informative in the context of predicting anxiety and withdrawal and investigated how they were influenced by symptom severity and topic of conversation. Our results exemplify how machine learning and computer vision can be used to gain further insights into child psychopathology. |
| Document Type: |
article in journal/newspaper |
| File Description: |
application/pdf |
| Language: |
English |
| ISSN: |
2043-8087 |
| Relation: |
https://dspace.library.uu.nl/handle/1874/481085 |
| Availability: |
https://dspace.library.uu.nl/handle/1874/481085 |
| Rights: |
info:eu-repo/semantics/OpenAccess |
| Accession Number: |
edsbas.9363E41 |
| Database: |
BASE |