| Title: |
Says Who? How Different Ground Truth Measures of Emotion Impact Student Affective Modeling |
| Language: |
English |
| Authors: |
Andres Felipe Zambrano; Nidhi Nasiar; Jaclyn Ocumpaugh; Alex Goslen; Jiayi Zhang; Jonathan Rowe; Jordan Esiason; Jessica Vandenberg; Stephen Hutt |
| Source: |
International Educational Data Mining Society. 2024. |
| Availability: |
International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/ |
| Peer Reviewed: |
Y |
| Page Count: |
13 |
| Publication Date: |
2024 |
| Sponsoring Agency: |
National Science Foundation (NSF), Division of Information and Intelligent Systems (IIS) |
| Contract Number: |
2016943; 2016993 |
| Document Type: |
Speeches/Meeting Papers; Reports - Research |
| Education Level: |
Junior High Schools; Middle Schools; Secondary Education |
| Descriptors: |
Psychological Patterns; Measurement Techniques; Observation; Middle School Students; Game Based Learning; Artificial Intelligence; Identification |
| Abstract: |
Research into student affect detection has historically relied on ground truth measures of emotion that utilize one of three sources of data: (1) self-report data, (2) classroom observations, or (3) sensor data that is retrospectively labeled. Although a few studies have compared sensor- and observation-based approaches to student affective modeling, less work has explored the relationship between self-report and classroom observations. In this study, we use both recurring self-reports (SR) and classroom observation (BROMP) to measure student emotion during a study involving middle school students interacting with a game-based learning environment for microbiology education. We use supervised machine learning to develop two sets of affect detectors corresponding to SR and BROMP-based measures of student emotion, respectively. We compare the two sets of detectors in terms of their most relevant features, as well as correlations of their output with measures of student learning and interest. Results show that highly predictive features in the SR detectors are different from those selected for BROMP-based detectors. The associations with interest and motivation measures show that while SR detectors captured underlying motivations, the BROMP detectors seemed to capture more in-the-moment information about the student's experience. Evidence suggests that there is benefit of using both sources of data to model different components of student affect. [For the complete proceedings, see ED675485.] |
| Abstractor: |
As Provided |
| Entry Date: |
2025 |
| Accession Number: |
ED675677 |
| Database: |
ERIC |