Construct validity of computer scored constructed response items in undergraduate introductory biology courses

TitleConstruct validity of computer scored constructed response items in undergraduate introductory biology courses
Publication TypeBook Chapter
Year of Publication2020
AuthorsYou, H, Haudek, K, Merrill, J, Urban-Lurain, M
Book TitleRasch Measurement: Applications in Quantitative Educational Research
Chapter12
Edition1
Pagination223-240
PublisherSpringer Singapore
CitySingapore
Abstract“Psychometrically sound” assessments possess the ability to make valid inferences of students’ conceptual understanding. However, there is a lack of validated assessments in college biology education. This study assesses the psychometric properties of the constructed response (CR) biology questions to establish construct validity and reliability. We used a polytomous Rasch Partial Credit Model to validate the eight CR items. Responses from 437 students were scored by automated scoring models that were trained on data scored by experts. All items reflected unidimensional construct of biology and local independency. The findings suggest that the instrument is a promising and valid tool to assess undergraduates’ biology concepts from introductory biology courses, but needs further revision to strengthen the psychometric properties, adding more items for low performing students and improving person reliability. The significance of this study lies in its potential to contribute to creating more valid and reliable CR assessments through Rasch calibration.
DOI10.1007/978-981-15-1800-3_12

thumbnail of small NSF logo in color without shading

This material is based upon work supported by the National Science Foundation (DUE grants: 1438739, 1323162, 1347740, 0736952 and 1022653). Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the NSF.