| Title: |
Category Scoring Techniques from National Assessment: Applications to Free Response Items from Career and Occupational Development. |
| Authors: |
Phillips, Donald L.; Education Commission of the States, Denver, CO. National Assessment of Educational Progress. |
| Peer Reviewed: |
N |
| Page Count: |
18 |
| Publication Date: |
2025 |
| Document Type: |
Reports - Research |
| Descriptors: |
Elementary Secondary Education; Essay Tests; Guides; National Surveys; Occupational Tests; Reliability; Scoring; Young Adults |
| Assessment and Survey Identifiers: |
National Assessment of Educational Progress |
| Abstract: |
The Career and Occupational Development (COD) assessment of the National Assessment of Educational Progress (NAEP) was made up of about 70 percent free response exercises requiring hand scoring. This paper describes the techniques used in developing the "scoring guides" for these exercises and summarizes the results of two empirical studies of the application of these scoring guides. The guides used in the hand scoring were sets of nominal (descriptive) category systems. No attempt was made to arrange the categories along any ordinal continuum according to either quality or content. However, categories were considered to be either acceptable or unacceptable. The readers were given a scoring guide in which each category is given a descriptive title and illustrated by a number of sample responses. (RC) Primary type of information provided by report: Procedures (Scoring). |
| Accession Number: |
ED133350 |
| Database: |
ERIC |