| Title: |
Comparing and Combining IRTree Models and Anchoring Vignettes in Addressing Response Styles |
| Language: |
English |
| Authors: |
Mingfeng Xue (ORCID 0000-0002-4801-3754); Ping Chen (ORCID 0000-0002-2920-4205) |
| Source: |
Journal of Educational Measurement. 2025 62(2):225-247. |
| Availability: |
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us |
| Peer Reviewed: |
Y |
| Page Count: |
23 |
| Publication Date: |
2025 |
| Document Type: |
Journal Articles; Reports - Research |
| Descriptors: |
Item Response Theory; Models; Comparative Analysis; Vignettes; Response Style (Tests); Data Use; Test Items; Performance; Test Reliability; Accuracy |
| DOI: |
10.1111/jedm.12437 |
| ISSN: |
0022-0655; 1745-3984 |
| Abstract: |
Response styles pose great threats to psychological measurements. This research compares IRTree models and anchoring vignettes in addressing response styles and estimating the target traits. It also explores the potential of combining them at the item level and total-score level (ratios of extreme and middle responses to vignettes). Four models were evaluated: three multidimensional IRTree models with different levels of using vignette data and a nominal response model (NRM) addressing extreme and midpoint response styles with item-level vignette responses. Simulation results indicated that the IRTree model using item-level vignette responses outperformed others in estimating the target trait and response styles to different extents, with performance improving as the number of vignettes increased. Empirical findings further demonstrated that models using item-level vignette information yielded higher reliability and closely aligned target trait estimates. These results underscore the value of integrating anchoring vignettes with IRTree models to enhance estimation accuracy and control for response styles. |
| Abstractor: |
As Provided |
| Entry Date: |
2025 |
| Accession Number: |
EJ1475941 |
| Database: |
ERIC |