| Title: |
Deconstruction of Holistic Rubrics into Analytic Rubrics for Large-Scale Assessments of Students' Reasoning of Complex Science Concepts |
| Language: |
English |
| Authors: |
Jescovitch, Lauren N.; Scott, Emily E.; Cerchiara, Jack A.; Doherty, Jennifer H.; Wenderoth, Mary Pat; Merrill, John E.; Urban-Lurain, Mark; Haudek, Kevin C. |
| Source: |
Practical Assessment, Research & Evaluation. Aug 2019 24(7). |
| Availability: |
Center for Educational Assessment. 813 North Pleasant Street, Amherst, MA 01002. e-mail: pare@umass.edu; Tel: 413-577-2180; Web site: https://scholarworks.umass.edu/pare |
| Peer Reviewed: |
Y |
| Page Count: |
13 |
| Publication Date: |
2019 |
| Sponsoring Agency: |
National Science Foundation (NSF) |
| Contract Number: |
DUE1660643; DUE1661263 |
| Document Type: |
Journal Articles; Reports - Research |
| Education Level: |
Higher Education; Postsecondary Education |
| Descriptors: |
Scoring Rubrics; Measurement; Logical Thinking; Scientific Concepts; Holistic Approach; Undergraduate Students; Physiology; Student Evaluation; Responses; Systems Approach |
| ISSN: |
1531-7714 |
| Abstract: |
Constructed responses can be used to assess the complexity of student thinking and can be evaluated using rubrics. The two most typical rubric types used are holistic and analytic. Holistic rubrics may be difficult to use with expert-level reasoning that has additive or overlapping language. In an attempt to unpack complexity in holistic rubrics at a large scale, we have developed a systematic approach called deconstruction. We define deconstruction as the process of converting a holistic rubric into defining individual conceptual components that can be used for analytic rubric development and application. These individual components can then be recombined into the holistic score which keeps true to the holistic rubric purpose, while maximizing the benefits and minimizing the shortcomings of each rubric type. This paper outlines the deconstruction process and presents a case study that shows defined concept definitions for a hierarchical holistic rubric developed for an undergraduate physiology-content reasoning context. These methods can be used as one way for assessment developers to unpack complex student reasoning, which may ultimately improve reliability and validation of assessments that are targeted at uncovering large-scale complex scientific reasoning. |
| Abstractor: |
As Provided |
| Entry Date: |
2019 |
| Accession Number: |
EJ1228291 |
| Database: |
ERIC |