Reliability and Validity of an Adapted and Translated Version of the Mullen Scales of Early Learning (AT-MSEL) in Rural Guatemala.
| Title: | Reliability and Validity of an Adapted and Translated Version of the Mullen Scales of Early Learning (AT-MSEL) in Rural Guatemala. |
|---|---|
| Authors: | Colbert AM; Children's Hospital Colorado, Aurora, Colorado.; University of Colorado, Aurora, Colorado.; Lamb MM; University of Colorado, Aurora, Colorado.; Asturias EJ; Children's Hospital Colorado, Aurora, Colorado.; University of Colorado, Aurora, Colorado.; Muñoz FM; Baylor College of Medicine, Houston, Texas.; Bauer D; University of Colorado, Aurora, Colorado.; Arroyave P; Fundación para la Salud Integral de los Guatemaltecos, Retalhuleu, Guatemala.; Hernández S; Fundación para la Salud Integral de los Guatemaltecos, Retalhuleu, Guatemala.; Martínez MA; Fundación para la Salud Integral de los Guatemaltecos, Retalhuleu, Guatemala.; Paniagua-Avila A; Fundación para la Salud Integral de los Guatemaltecos, Retalhuleu, Guatemala.; Olson D; Children's Hospital Colorado, Aurora, Colorado.; University of Colorado, Aurora, Colorado.; Calvimontes DM; Fundación para la Salud Integral de los Guatemaltecos, Retalhuleu, Guatemala.; Bolaños GA; Fundación para la Salud Integral de los Guatemaltecos, Retalhuleu, Guatemala.; El Sahly HM; Baylor College of Medicine, Houston, Texas.; Connery AK; Children's Hospital Colorado, Aurora, Colorado.; University of Colorado, Aurora, Colorado. |
| Source: | Child: care, health and development [Child Care Health Dev] 2020 May; Vol. 46 (3), pp. 327-335. Date of Electronic Publication: 2020 Feb 03. |
| Publication Type: | Journal Article; Research Support, N.I.H., Extramural |
| Language: | English |
| Journal Info: | Publisher: Blackwell Scientific Publications Country of Publication: England NLM ID: 7602632 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1365-2214 (Electronic) Linking ISSN: 03051862 NLM ISO Abbreviation: Child Care Health Dev Subsets: MEDLINE |
| Imprint Name(s): | Original Publication: Oxford, Blackwell Scientific Publications. |
| MeSH Terms: | Child Development* ; Learning* ; Motor Skills*; Child, Preschool ; Cohort Studies ; Female ; Guatemala ; Humans ; Infant ; Male ; Neuropsychological Tests ; Psychometrics ; Reproducibility of Results ; Rural Population ; Translations |
| Abstract: | Background: A growing literature base supports the use of tests developed in high-income countries to assess children in low resource settings when carefully translated, adapted, and applied. Evaluation of psychometric properties of adapted and translated measures within populations is necessary. The current project sought to evaluate the reliability and validity of an adapted and translated version of the Mullen Scales of Early Learning (AT-MSEL) in rural Guatelama.; Methods: The reliability and validity of the AT-MSEL in rural Guatemala were analyzed for children ages 0-5 years.; Results: Interrater reliability coefficients (ICC = 0.99-1.0) and internal consistency (Cronbach's alpha = 0.91-0.93) were excellent for all subscales. General linear models utilizing paired data showed consistency between standard scores (p < 0.0001). Mean raw scores increased with chronological age, as expected. Across age groups, subscales were significantly, positively correlated with one another (p < 0.05 - < 0.001) with one exception, visual reception and expressive language at the 0-10 month age range (p = 0.43).; Conclusions: The AT- MSEL showed strong psychometric properties in a sample of young children in rural Guatemala. Findings demonstrate that the AT-MSEL can be used validly and reliably within this specific population of children. This work supports the concept that tests developed in high-income countries can be used to assess children in low resource settings when carefully translated, adapted and applied.; (© 2020 John Wiley & Sons Ltd.) |
| References: | Asturias, E. J., Heinrichs, G., Domek, G., Brett, J., Shick, E., Cunningham, M., … Berman, S. (2015). The Center for Human Development in Guatemala: An innovative model for global population health. Manuscript: Advances in Pediatrics.; Azari, N., Soleimani, F., Vameghi, R., Sajedi, F., Shahshahani, S., Karimi, H., … Gharib, M. (2017). A Psychometric Study of the Bayley Scales of Infant and Toddler Development in Persian Language Children. Iranian Journal of Child Neurology, 11(1), 50-56. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/28277556.; Bangirana, P., Giordani, B., John, C. C., Page, C., Opoka, R. O., & Boivin, M. J. (2009). Immediate neuropsychological and behavioral benefits of computerized cognitive rehabilitation in Ugandan pediatric cerebral malaria survivors. Journal of Developmental and Behavioral Pediatrics, 310-318. https://doi.org/10.1097/DBP.0b013e3181b0f01b.; Bangirana, P., Opoka, R. O., Boivin, M. J., Idro, R., Hodges, J. S., Romero, R. A., … John, C. C. (2014). Severe Malarial Anemia is Associated With Long-term Neurocognitive Impairment. Clinical Infectious Diseases, 59(3), 336-344. https://doi.org/10.1093/cid/ciu293.; Black, M. M., Walker, S. P., Fernald, L. C. H., Andersen, C. T., DiGirolamo, A. M., Lu, C., … Grantham-McGregor, S. (2017). Early childhood development coming of age: science through the life course. The Lancet, 77-90. https://doi.org/10.1016/S0140-6736(16)31389-7.; Bodeau-Livinec, F., Davidson, L. L., Zoumenou, R., Massougbodji, A., Cot, M., & Boivin, M. J. (2019). Neurocognitive testing in West African children 3-6 years of age: Challenges and implications for data analyses. Brain Research Bulletin, 145(December 2017), 129-135. https://doi.org/10.1016/j.brainresbull.2018.04.001.; Boivin, M. J., Bangirana, P., Nakasujja, N., Page, C. F., Shohet, C., Givon, D., … Klein, P. S. (2013). A Year-Long Caregiver Training Program Improves Cognition in Preschool Ugandan Children with Human Immunodeficiency Virus. The Journal of Pediatrics, 163(5), 1409-1416.e5. https://doi.org/10.1016/J.JPEDS.2013.06.055.; Boivin, M. J., & Giordani, B. (2009). Neuropsychological assessment of African children: evidence for a universal brain/behavior omnibus within a coconstructivist paradigm. Progress in Brain Research, 113-135. https://doi.org/10.1016/S0079-6123(09)17808-1.; Bornman, J., Romski, M., Tonsing, K., Sevcik, R., White, R., Barton-Hulsey, A., & Morwane, R. (2018). Adapting and translating the Mullen Scales of Early Learning for the South African context. The South African Journal of Communication Disorders, 65(1), 1-9. https://doi.org/10.4102/sajcd.v65i1.571.; Bornman, J., Sevcik, R. A., Romski, M. A., & Pae, H. K. (2010). Successfully translating language and culture when adapting assessment measures. Journal of Policy and Practice in Intellectual Disabilities, 7(2), 111-118. https://doi.org/10.1111/j.1741-1130.2010.00254.x.; Cassepp-Borges, V., Balbinotti, M. A. A., & Teodoro, M. L. M. (2010). Tradução e validação de conteúdo: Uma proposta para a adaptação de instrumentos. Instrumentação psicológica: Fundamentos e práticas, 506-520.; Chernoff, M. C., Laughton, B., Ratswana, M., Familiar, I., Fairlie, L., Vhembo, T., … Boivin, M. J. (2018). Validity of Neuropsychological Testing in Young African Children Affected by HIV. Journal of Pediatric Infectious Diseases, 13(3), 185-201. https://doi.org/10.1055/s-0038-1637020.; Cicchetti, D. V., & Sparrow, S. S. (1990). Assessment of adaptive behavior in young children. In J. H. Johnson, & J. Goldman (Eds.), Developmental assessment in clinical child psychology: A handbook (pp. 173-196). Elmsford, NY, US: Pergamon Press.; Connery, A. K., Berrios-Siervo, G., Arroyave, P., Bauer, D., Hernandez, S., Paniagua-Avila, A., … E. (2019). Responding to the Zika Epidemic: Preparation of a Neurodevelopmental Testing Protocol to Evaluate Young Children in Rural Guatemala. The American Journal of Tropical Medicine and Hygiene, 100(2), 438-444. https://doi.org/10.4269/ajtmh.18-0713.; Connery, A. K., Colbert, A. M., Lamb, M. M., Hernández, S., Martínez, M. A., Bauer, D., … Munoz, F. M. (2019). Receptive Language Skills Among Young Children in Rural Guatemala: The Relationship Between the Test de Vocabulario en Imagenes Peabody and a Translated and Adapted Version of the Mullen Scales of Early Learning. Child: Care, Health and Development, 702-708, cch.12702. https://doi.org/10.1111/cch.12702.; Erkut, S. (2010). Developing multiple language versions of instruments for intercultural research. Child Development Perspectives, 4(1), 19-24. https://doi.org/10.1111/j.1750-8606.2009.00111.x.; Fernald, L. C., Prado, E., Kariger, P., & Raikes, A. (2017). A Toolkit for Measuring Early Childhood Development in Low and Middle-Income Countries.; Fernald, L. C. H., Weber, A., Galasso, E., & Ratsifandrihamanana, L. (2011). Socioeconomic gradients and child development in a very low income population: Evidence from Madagascar. Developmental Science, 14(4), 832-847. https://doi.org/10.1111/j.1467-7687.2010.01032.x.; Geisinger, K. F. (1994). Cross-cultural normative assessment: Translation and adaptation issues influencing the normative interpretation of assessment instruments. Psychological Assessment, 6, 304-312. Retrieved from. https://pdfs.semanticscholar.org/752d/6252fd46453bc18cd1311b91e50d2fd5442b.pdf.; Gladstone, M., Lancaster, G. A., Umar, E., Nyirenda, M., Kayira, E., van den Broek, N. R., & Smyth, R. L. (2010). The Malawi Developmental Assessment Tool (MDAT): The Creation, Validation, and Reliability of a Tool to Assess Child Development in Rural African Settings. PLoS Medicine, 7(5), e1000273. https://doi.org/10.1371/journal.pmed.1000273.; Gudmundsson, E. (2009). Guidelines for translating and adapting psychological instruments. Nordic Psychology, 61(2), 29-45. https://doi.org/10.1027/1901-2276.61.2.29.; Hagan, J. F., Duncan, P. M., & Shaw, J. (2008). Bright Futures: Guidelines for Health Supervision of Infants, Children, and Adolescents, 3rd edi. Pocket Guide. The American Academy of Pediatrics., 116, 241-248. https://doi.org/10.1007/s00340-013-5682-0.; Hambleton, R. K. (2004). Issues, designs, and technical guidelines for adapting tests into multiple languages and cultures. In Adapting Educational and Psychological Tests for Cross-Cultural Assessment (pp. 3-38). https://doi.org/10.4324/9781410611758.; Hambleton, R. K., & Patsula, L. (1999). Increasing the Validity of Adapted Tests: Myths to be Avoided and Guidelines for Improving Test Adaptation Practices. Journal of Applied Testing Technology, 53(9), 1689-1699. https://doi.org/10.1017/CBO9781107415324.004.; Hambleton, R. K., & Swaminathan, H. (1987). Item response theory. principles and applications.; Hanlon, C., Medhin, G †, Worku, B., Tomlinson, M., Alem, A, Dewey, M.||, … Hanlon, C. (2016). Adapting the Bayley Scales of Infant and Toddler Development in Ethiopia: Evaluation of Reliability and Validity, 699-708. https://doi.org/10.1111/cch.12371.; Heckman, J. J. (2008). The case for investing in disadvantaged young children. CESifo DICE Report, 3-8. https://doi.org/10.1111/j.1467-9353.2007.00359.x.; Holding, P., Anum, A., van de Vijver, F. J. R., Vokhiwa, M., Bugase, N., Hossen, T., … Gomes, M. (2018). Can we measure cognitive constructs consistently within and across cultures? Evidence from a test battery in Bangladesh, Ghana, and Tanzania. Applied Neuropsychology: Child, 7(1), 1-13. https://doi.org/10.1080/21622965.2016.1206823.; ITC (2017). The ITC Guidelines for Translating and Adapting Tests.; Koura, K. G., Boivin, M. J., Davidson, L. L., Ouédraogo, S., Zoumenou, R., Alao, M. J., … Bodeau-Livinec, F. (2013). Usefulness of child development assessments for low-resource settings in francophone Africa. Journal of Developmental and Behavioral Pediatrics: JDBP, 34(7), 486-493. https://doi.org/10.1097/DBP.0b013e31829d211c.; Krogh, M. T., & Vaever, M. S. (2016). Development and aging. Bayley-III: Cultural differences and language scale validity in a Danish sample. https://doi.org/10.1111/sjop.12333.; McConnell, S. R. (2000). Assessment in Early Intervention and Early Childhood Special Education. Topics in Early Childhood Special Education, 20(1), 43-48. https://doi.org/10.1177/027112140002000108.; Milfont, T. L., & Fischer, R. (2010). Testing measurement invariance across groups: Applications in cross-cultural research. International Journal of Psychological Research, 3(1), 111-121. https://doi.org/10.1007/s11135-007-9143-x.; Mitchell, J. M., Tomlinson, M., Bland, R. M., Houle, B., Stein, A., & Rochat, T. J. (2017). Confirmatory factor analysis of the Kaufman assessment battery in a sample of primary school-aged children in rural South Africa. South Africa Journal of Psychology, 1-19. https://doi.org/10.1177/0081246317741822.; Mullen, E. (1995). Mullen scales of early learning. Bloomington, MN: Pearson. https://doi.org/10.1007/978-3-319-56782-2_1570-2.; Olson, D., Lamb, M. M., Lopez, M. R., Paniagua-Avila, M. A., Zacarias, A., Samayoa-Reyes, G., … Asturias, E. J. (2017). A rapid epidemiological tool to measure the burden of norovirus infection and disease in resource-limited settings. Open Forum Infectious Diseases, 4(2). https://doi.org/10.1093/ofid/ofx049.; Paxson, C., & Schady, N. (2007). Cognitive Development among Young Children in Ecuador. The Journal of Human Resources, XLII(1), 49-84. https://doi.org/10.3368/jhr.; Paxson, C. H., & Schady, N. (2005). Cognitive development among young children in. Ecuador: The Roles of Wealth, Health, and Parenting. SSRN. https://doi.org/10.2139/ssrn.753548.; Pena, E. D. (2013). Lost in Translation: Methodological Considerations in Cross-Cultural Research. Child Development, 78(4), 1255-1264.; Ranjitkar, S., Kvestad, I., Strand, T. A., Ulak, M., Shrestha, M., Chandyo, R. K., … Hysing, M. (2018). Acceptability and reliability of the Bayley Scales of infant and Toddler Development-III Among Children in Bhaktapur, Nepal. Frontiers in Psychology, 9(JUL), 1265. https://doi.org/10.3389/fpsyg.2018.01265.; Reise, S. P., Widaman, K. F., & Pugh, R. H. (1993). Confirmatory Factor Analysis and Item Response Theory: Two Approaches for Exploring Measurement Invariance. Psychological Bulletin, 114(3), 552-566. Retrieved from. https://www3.nd.edu/~kyuan/courses/sem/readpapers/Reise-etal-PB93.pdf, https://doi.org/10.1037/0033-2909.114.3.552.; Romski, M. A., Bornman, J., Sevcik, R. A., Tönsing, K., Barton-Hulsey, A., Morwane, R., … White, R. (2018a). Language assessment for children with a range of neurodevelopmental disorders across four languages in South Africa. American Journal of Speech-Language Pathology, 602-615. https://doi.org/10.1044/2017_AJSLP-17-0035.; Romski, M. A., Bornman, J., Sevcik, R. A., Tönsing, K., Barton-Hulsey, A., Morwane, R., … White, R. (2018b). Language assessment for children with a range of neurodevelopmental disorders across four languages in South Africa. American Journal of Speech-Language Pathology, 27(2), 602-615. https://doi.org/10.1044/2017_AJSLP-17-0035.; Rubio-Codina, M., Attanasio, O., Meghir, C., Varela, N., & Grantham-McGregor, S. (2015). The Socio-Economic Gradient of Child Development Children 6-42 Months in Bogota. The Journal of Human Resources, 11. https://doi.org/10.3368/jhr.50.2.464.; Ruiseñor-Escudero, H., Familiar, I., Nyakato, M., Kutessa, A., Namukooli, J., Ssesanga, T., … team, the I. P. (2019). Building capacity in neurodevelopment assessment of children in sub-Saharan Africa: A quality assurance model to implement standardized neurodevelopment testing. Child Neuropsychology, 25(4), 466-481. https://doi.org/10.1080/09297049.2018.1497588.; Schady, N., Behrman, J., Caridad Araujo, M., Azuero, R., Bernal, R., Bravo, D., … Vakis, R. (2015). Wealth Gradients in Early Childhood Cognitive Development in Five Latin American Countries. The Journal of Human Resources. https://doi.org/10.3368/jhr.50.2.446.; Semrud-Clikeman, M., Romero, R. A. A., Prado, E. L., Shapiro, E. G., Bangirana, P., & John, C. C. (2016). Selecting measures for the neurodevelopmental assessment of children in low- and middle-income countries. Child Neuropsychology, 1-42. https://doi.org/10.1080/09297049.2016.1216536.; Sireci, S. G. (2004). Using bilinguals to evaluate the comparability of different language versions of a test. In Adapting Educational and Psychological Tests for Cross-Cultural Assessment (pp. 117-138). https://doi.org/10.4324/9781410611758.; Cicchetti, D. V, & Sparrow, S. A. (1981). Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behavior. American Journal of Mental Deficiency, 86(2), 127-137. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/7315877.; Van De Vijver, F. J. R., & Poortinga, Y. H. (2004). Conceptual and methodological issues in adapting tests. In Adapting Educational and Psychological Tests for Cross-Cultural Assessment (pp. 39-63). https://doi.org/10.4324/9781410611758.; Wehby, G. L., & McCarthy, A. M. (2013). Economic gradients in early child neurodevelopment: A multi-country study. Social Science & Medicine, 86-95. https://doi.org/10.1016/j.socscimed.2012.11.038. |
| Grant Information: | HHSN272201300015I United States AI NIAID NIH HHS |
| Contributed Indexing: | Keywords: child development; developing countries; early assessment; reliability; validity |
| Entry Date(s): | Date Created: 20200125 Date Completed: 20210709 Latest Revision: 20210709 |
| Update Code: | 20260130 |
| DOI: | 10.1111/cch.12748 |
| PMID: | 31978249 |
| Database: | MEDLINE |
Journal Article; Research Support, N.I.H., Extramural