| Abstract: |
Background: One area that has been dramatically changed by artificial intelligence (AI) is educational environments. Chatbots, Recommender Systems, Adaptive Learning Systems and Large Language Models have been emerging as practical tools for facilitating learning. However, using such tools appropriately is challenging. In this regard, the construct of metacognitive learning resilience has been receiving growing attention, especially in the face of uncertainties and adversities associated with AI-supported learning. Objectives: The current research aimed to develop and evaluate the psychometric properties of the AI-Integrated Metacognitive Learning Resilience Scale (AIIMLR Scale). This scale was developed to assess students' ability to cognitively and emotionally manage learning challenges in AI-enhanced learning settings. Methods: This study, which had a mixed-method research design, was performed in Jordan in 2025. A pool of items, developed based on a systematic review of theoretical literature and semi-structured interviews, was used. Then, content validation and the pilot phase were used to modify items. Exploratory factor analysis (EFA), confirmatory factor analysis (CFA), exploratory graph analysis (EGA) and Random Forest Modelling (RFM) were used to assess construct validity of this scale. In addition, Cronbach's alpha (a) and McDonald's omega (?) were used to assess reliability. Finally, the intraclass correlation coefficient (ICC) was performed in addition to evaluating test--retest reliability. Results and Conclusions: EFA results revealed six factors: Self-Awareness and Metacognitive Regulation in AI-Mediated Learning; Cognitive Adaptability in Dynamic AI-Based Learning Contexts; Emotional Stability During AI-Integrated Learning Challenges; Strategic Perseverance in AI-Supported Problem-Solving; Motivational Resilience Amid AI-Driven Learning Difficulties; and Reflective Recalibration of Learning through AI Feedback. These six factors collectively explained 66.21% of the total variance. CFA fit indices (CFI = 0.917, RMSEA = 0.079) and reliability indicators, including Cronbach's alpha (0.897-0.948), McDonald's omega (0.892-0.950) and Composite Reliability (CR: 0.888-0.954), were all within acceptable ranges. Moreover, convergent and discriminant validity were confirmed using the Average Variance Extracted (AVE). The measurement invariance test across gender indicated that the scale maintains stable measurement properties for both males and females. Findings suggest that the AIIMLR Scale is a valid and reliable tool for assessing metacognitive learning resilience in AI-enhanced educational settings. |