AACR Publications

We are pleased to share with you some of our academic publications and other recent efforts to disseminate important developments and research to the broader community. Some publications may be downloadable directly from us, while others may be accessed through the Journal publisher provided in the links. Please feel free to contact the author(s) if you have specific questions about any of the work listed here.

2019

Sieke, S. A., McIntosh, B. B., Steele, M. M., & Knight, J. K.. (2019). Characterizing Students’ Ideas about the Effects of a Mutation in a Noncoding Region of DNA. CBE-Life Sciences Education, 18(2). presented at the 06/2019. doi:10.1187/cbe.18-09-0173
Haudek, K. C., Osborne, J., & Wilson, C. D.. (2019). Using Automated Analysis to Assess Middle School Students' Competence with Scientific Argumentation. In National Conference on Measurement in Education. presented at the 03/2019, Toronto, Ontario, Canada: NCME.

2018

2017

Carter, K., & Prevost, L.. (2017). Investigating text analysis models for assessing student understanding of structure and function. In Transforming Research in Undergraduate STEM Education (TRUSE).
Lyford, A. (2017). Understanding Undergraduate Learning in Statistics through Machine Learning Algorithms. In Mathematics Association of America Southeastern Section 96th Annual Meeting. Mercer University.
Sbeglia, G., & Nehm, R. H.. (2017). Does Evolution Acceptance Differ across Biological Scales? A Rasch Analysis of the I- SEA. In National Association for Research in Science Education (NARST) 2017 Annual International Conference.
Sieke, S., & Knight, J.. (2017). Identifying and analyzing student misconceptions about the effects of a non-coding mutation. In Society for the Advacement of Biology Education Research National Conference.
Smith, M. (2017). Using Evidence to Transform Undergraduate Teaching. In Teaching as Research National Conference.
Tornabene, R., Nehm, R. H., & Schmiemann, P.. (2017). Testing the Impact of Situational Features on Measures of Biology Students' Genetics Understanding. In National Association for Research in Science Education (NARST) 2017 Annual International Conference.
Wang, X., Colton, J., Sbeglia, G., Finch, S., & Nehm, R. H.. (2017). Longitudinal Learning Dynamics and the Conceptual Restructuring of Evolutionary Understanding. In National Association for Research in Science Education (NARST) 2017 Annual International Conference.

2016

Prevost, L. B., Smith, M. K., & Knight, J. K.. (2016). Using student writing and lexical analysis to reveal student thinking about the role of stop codons in the central dogma. CBE - Life Sciences Education, 15(4), pii: ar65. presented at the 12/2016. doi:10.1187/cbe.15-12-0267
Ha, M., & Nehm, R. H.. (2016). Predicting the Accuracy of Computer Scoring of Text: Probabilistic, Multi-Model, and Semantic Similarity Approaches. In National Assocation for Research in Science Teaching Annual Conference. presented at the 04/2016, Baltimore, MD: NARST.
Lemons, P. P., McCourt, J., Knight, J., Merrill, J. E., Nehm, R. H., Prevost, L., et al.. (2016). A community of enhanced assessment facilitates reformed teaching. In AAAS Envisioning the Future of Undergraduate STEM Education. presented at the 04/2016, Washington, DC: American Association for the Advancement of Science. Retrieved from http://www.enfusestem.org/projects/a-community-of-enhanced-assessment-facilitates-reformed-teaching/
Moscarella, R. A., Haudek, K. C., Knight, J. K., Mazur, A., Pelletreau, K. N., Prevost, L. B., et al.. (2016). Automated Analysis Provides Insights into Students’ Challenges Understanding the Processes Underlying the Flow of Genetic Information. In National Assocation for Research in Science Teaching Annual Conference. presented at the 04/2016, Baltimore, MD: NARST.
Steele, M., Merrill, J. E., Haudek, K. C., & Urban-Lurain, M.. (2016). The Development of Constructed Response Astronomy Assessment Items. In National Assocation for Research in Science Teaching Annual Conference. presented at the 04/2016, Baltimore, MD: NARST. Retrieved from http://matthewmsteele.github.io/NARST2016/
Stuhlsatz, M., Wilson, C. D., Buck-Bracey, Z., Urban-Lurain, M., Merrill, J. E., & Haudek, K. C.. (2016). Applying Automated Analysis to Develop a Cost-Effective Measure of Science Teacher Pedagogical Content Knowledge. In National Assocation for Research in Science Teaching Annual Conference. presented at the 04/2016, Baltimore, MD: NARST.
Various-Authors, M. (2016). Automated Analysis of Written Assessments in STEM: Methodological Issues. In National Assocation for Research in Science Teaching Annual Conference. presented at the 04/2016, Baltimore, MD: NARST.
Ha, M., & Nehm, R. H.. (2016). The Impact of Misspelled Words on Automated Computer Scoring: A Case Study of Scientific Explanations. Journal of Science Education and Technology. doi:10.1007/s10956-015-9598-9
Nehm, R. H. (2016). Keynote address. In ERIDOB European Researchers in the Didactics of Biology Conference.
Smith, M. (2016). Transforming the Classroom and Helping Others to Adopt Teaching Innovations. In Australian Physiological Society. Australian Physiological Society.

2015

Chen, J., Ha, M., & Nehm, R. H.. (2015). Measuring semantic similarity in written text: Applications to learning and assessment. In NARST 2015 Annual International Conference. presented at the 04/2015.
Ha, M., & Nehm, R. H.. (2015). Exploring students' evolutionary explanations across natural, sexual, and artificial selection secenarios. In NARST 2015 Annual International Conference. presented at the 04/2015.
Ha, M., & Nehm, R. H.. (2015). Assessment item "Cover Stories", semantic similarity and successful computerized scoring of open-ended text. In NARST 2015 Annual International Conference. presented at the 04/2015.
Carter, K., & Prevost, L.. (2015). Assessing student understanding of core principle structure and function. In Society for Advancement of Biology Education Research Annual Meeting.
Crumbs, T., McCourt, J. S., & Lemons, P. P.. (2015). Analysis of Teachers' Thinking about Pedagogical Practices in College Biology Courses. In University of Georgia Research Experiences for Undergraduates Poster Session.
Ha, M., Baldwin, B., & Nehm, R. H.. (2015). The long-term impacts of short-term professional development: science teachers and evolution. Evolution Education and Outreach, 8, 23. doi:doi:10.1186/s12052-015-0040-9
Kaplan, J. J. (2015). Everyone Knows What a Histogram Is: Or Do They?. In Department of Statistics, University of Auckland, Invited Seminar.
Knight, J. K. K. (2015). Changing learning by using student ideas to drive instruction. In University of Colorado, Internal Faculty Seminar.
Knight, J. K. K. (2015). Changing learning by using student ideas to drive instruction. In University of Georgia, Invited Faculty Seminar.
Lemons, P. P. (2015). Designing Research-Based Learning Environments for Students and Faculty. In Department of Education and Professional Studies, Science and Technology Education Group, King's College, Invited Talk.
Mazur, A., Moscarella, R. A., Urban-Lurain, M., & Merrill, J.. (2015). Student writing reveals misconceptions in the Central Dogma of Biology. In The Mid-Michigan Symposium for Undergraduate Research Experiences.
Nehm, R. H. (2015). Evolution Challenges: Integrating Research and Practice in Teaching and Learning about Evolution. Science & Education, 24, 481-485. doi:10.1007/s11191-014-9705-y
Prevost, L. B. (2015). Assessing Student Writing Using Text Analysis: Understanding the Central Dogma. In Virginia Polytechnic Institute and State University, Invited Seminar.
Prevost, L. (2015). Assessing student ecological understanding using text analysis and machine learning. In The Ecological Society of America Annual Meeting.
Prevost, L. (2015). Assessing student biological understanding using text analysis and machine learning. . In The Gordon Research Conference on Undergraduate Biology Education Research. .
Romero, M., Carter, K., & Prevost, L.. (2015). Assessing writing about matter and energy: Comparing text analysis and machine learning. . In Society for Advancement of Biology Education Research Annual Meeting.
Steele, M., Park, M., & Urban-Lurain, M.. (2015). AACR: Automated Analysis of Constructed Response Physics and Astronomy Questions. In American Association of Physics Teachers Summer Meeting.

2014

Kaplan, J. J., Haudek, K. C., Ha, M., Rogness, N., & Fisher, D.. (2014). Using Lexical Analysis Software to Assess Student Writing in Statistics. Technology Innovations in Statistics Education. presented at the 10/2014. Retrieved from http://escholarship.org/uc/item/57r90703
Corley, L., Olwine, J., Noyes, K., Cooper, M., Haudek, K. C., & Urban-Lurain, M.. (2014). Automated Analysis of Students’ Constructed Explanations in Chemistry. Biennial Conference on Chemical Education. presented at the 08/2014, Grand Valley State University: BCCE.
Kaplan, J. J., Gabrosek, J., Curtiss, P., & Malone, C. J.. (2014). Everyone Knows What a Histogram Is, or Do They?: How Non-Statisticians Read Histograms. Joint Statistical Meetings. presented at the 08/2014, Boston, MA: American Statistics Association.
Moharreri, K., Ha, M., & Nehm, R. H.. (2014). EvoGrader: an online formative assessment tool for automatically evaluating written evolutionary explanations. Evolution: Education and Outreach, 7(1), 15. presented at the 08/2014. doi:10.1186/s12052-014-0015-2
Prevost, L. B. (2014). Exploring students' mental models of matter and energy transformation through lexical analysis of written assessments. Ecological Society of America annual meeting. presented at the 08/2014, Sacramento, CA: ESA.
Prevost, L. B. (2014). Assessing students'ability to trace matter and energy using lexical analysis of written assessments. Society for Advancement of Biology Education Research annual meeting. presented at the 07/2014, Minneapolis, MN: SABER.
Voreis, J. S., Andrews, T. M., Federer, M. Rector, Knight, J. K., Merrill, J. E., Merrill, S., et al.. (2014). Investigating the Impact of Faculty Learning Communities on Biology Instructors. Society for the Advancement of Biology Education Research (SABER) Annual Meeting. presented at the 07/2014, Minneapolis, MN: SABER.
Weston, M., Haudek, K. C., Prevost, L. B., Merrill, J., & Urban-Lurain, M.. (2014). Examining the Impact of Question Surface Features on Students' Answers to Constructed Response Questions in Biology. MSU University Undergraduate Research and Arts Forum. presented at the 04/2014, East Lansing, MI: MSU UURAF.
Weston, M., Haudek, K. C., Prevost, L. B., Merrill, J. E., & Urban-Lurain, M.. (2014). Examining the Impact of Question Surface Features on Students’ Answers to Constructed Response Questions in Biology. CREATE4STEM mini-conference. presented at the 02/2014, Michigan State University, East Lansing, MI: CREATE4STEM. Retrieved from http://conference.create4stem.msu.edu/

2013

Beggrow, E. B., Ha, M., Nehm, R. H., Pearl, D., & Boone, W. J.. (2013). Assessing Scientific Practices Using Machine-Learning Methods: How Closely Do They Match Clinical Interview Performance?. Journal of Science Education and Technology. presented at the 07/2013. doi:DOI 10.1007/s10956-013-9461-9
Prevost, L. B., Haudek, K. C., Norton-Henry, E., Berry, M. C., & Urban-Lurain, M.. (2013). Using Computerized Lexical Analysis of Student Writing to Facilitate Just-in-Time-Teaching in Large Enrollment Biology Courses. Society for the Advancement of Biology Education Research (SABER) Annual Meeting. presented at the 07/2013, Minneapolis, MN: SABER.
Haudek, K. C., Urban-Lurain, M., & Russell, A. A.. (2013). Exploring Computerized Lexical Analysis to Predict Calibrated Peer Review Ratings of Student Writing in Chemistry. In National Association on Research in Science Teaching. presented at the 04/2013, Rio Grande, Puerto Rico: NARST.
Prevost, L. B., Knight, J., Smith, M. K., & Urban-Lurain, M.. (2013). Student writing reveals their heterogeneous thinking about the origin of genetic variation in populations. In National Association on Research in Science Teaching. presented at the 04/2013, Rio Grande, Puerto Rico: NARST.
Weston, M., Parker, J. M., & Urban-Lurain, M.. (2013). Comparing Formative Feedback Reports: Human and Automated Text Analysis of Constructed Response Questions in Biology. In National Association on Research in Science Teaching. presented at the 04/2013, Rio Grande, Puerto Rico: NARST.
Lira, C. T., & Elliott, J. R.. (2013). Facilitating Learning in Thermodynamics and Computations Using Technology. Annual Meeting of the American Institute of Chemical Engineers. San Franscisco, CA: AIChE.

2012

Prevost, L. B., Haudek, K. C., Urban-Lurain, M., & Merrill, J. E.. (2012). Examining student constructed explanations of thermodynamics using lexical analysis. In Frontiers in Education. presented at the 10/2012, Seattle, WA: Frontiers in Education.
Haudek, K. C., Prevost, L. B., Merrill, J. E., & Urban-Lurain, M.. (2012). Lexical and qualitative analysis of students’ written responses and interviews explaining chemical functional group behavior in cellular biology. Society for the Advancement of Biology Education Research (SABER) Annual Meeting. presented at the 07/2012, National Meeting of the Society for Advancement of Biology Education Research: SABER.
Prevost, L. B., Knight, J., Smith, M. K., Haudek, K. C., Merrill, J. E., & Urban-Lurain, M.. (2012). Using Lexical Analysis to Explore Students’ Written Responses to Genetics Concept Assessment-Derived Items. Society for the Advancement of Biology Education Research (SABER) Annual Meeting. presented at the 07/2012, National Meeting of the Society for the Advancement of Biology Education Research: SABER.
Weston, M., Haudek, K. C., Prevost, L. B., Lyons, C., Urban-Lurain, M., Merrill, J. E., & Parker, J. M.. (2012). How are students interpreting constructed response questions? Using computerized lexical analysis to identify key concepts in student writing. Society for the Advancement of Biology Education Research (SABER) Annual Meeting. presented at the 07/2012, Minneapolis, MN: SABER.
Prevost, L. B. (2012). Insight into Student Thinking in STEM: Lessons Learned from Lexical Analysis of Student Writing. Transforming Research in Undergraduate STEM Education. presented at the 06/2012, St. Paul, MN: TRUSE.
Urban-Lurain, M. (2012). Insight into Student Thinking in STEM: Lessons Learned from Lexical Analysis of Student Writing. Michigan State University; East Lansing, MI. presented at the 05/2012.
Nehm, R. H., & Haertig, H.. (2012). Human vs. Computer Diagnosis of Students’ Natural Selection. Journal of Science Education and Technology, 21(1), 56-73. doi:10.1007/s10956-011-9282-7
Nehm, R. H., Ha, M., & Mayfield, E.. (2012). Transforming Biology Assessment with Machine Learning: Automated Scoring of Written Evolutionary Explanations. Journal of Science Educational Technology, 21(1). doi:10.1007/s10956-011-9300-9

2011

Haudek, K. C., Kaplan, J. J., Knight, J., Long, T., Merrill, J. E., Munn, A., et al.. (2011). Harnessing Technology to Improve Formative Assessment of Student Conceptions in STEM: Forging a National Network. CBE - Life Sciences Education, 10, 149-155. presented at the Summer. doi:10.1187/cbe.11-03-0019
Ha, M., & Nehm, R. H.. (2011). Comparative Efficacy of Two Computer-assisted Scoring Tools for Evolution Assessment. In National Association of Research in Science Teaching. presented at the April 3-6, 2011, Orlando, FL.
Ladue, N., Sibley, D. F., Goldwater, M., Libarkin, J. C., & Gentner, D.. (2011). Causality in Analogies Generated by Expert and Novice Geoscientists. In Geological Society of American Annual Meeting. presented at the 10/2011, Minneapolis, MN.
Urban-Lurain, M. (2011). Insight into Student Thinking in STEM: Lessons Learned from Lexical Analysis of Student Writing. presented at the 10/2011, Center for Engineering Education Research; Michigan State University.
Merrill, J. E., Lyons, C., Jones, S., Moscarella, R. A., Haudek, K. C., & Urban-Lurain, M.. (2011). Computerized Lexical Analysis Reveals: Complexity of Student Ideas in Biology. presented at the 07/2011, Minneapolis, MN: Society for Advancement of Biology Education Research (SABER) Annual Meeting.
Jones, S., Long, T., Kostelnik, K., & Urban-Lurain, M.. (2011). Making connections: Can lexical analysis reveal students' thinking about key genetics concepts?. University Undergraduate Research and Arts Forum (UURAF). Michigan State University East Lansing, MI. presented at the 04/2011, Michigan State University.
Lyons, C., Jones, S., Merrill, J. E., Urban-Lurain, M., & Haudek, K. C.. (2011). Moving Across Scales: Using Lexical Analysis to Reveal Student Reasoning about Photosynthesis. In National Association of Research on Science Teaching. presented at the 04/2011, Orlando, FL.
Merrill, J. E., Haudek, K. C., & Urban-Lurain, M.. (2011). Computerized Analysis of Student Writing and Student Ideas about Scientific Concepts. Network for Academic Renewal Conference. presented at the 03/2011, Miami, FL: AAC&U and PKAL .
Urban-Lurain, M. (2011). Automated Analysis Of Student Writing Reveals Student Thinking: An Innovative Assessment Methodology Built On Community Goals. 241st ACS National Meeting & Exposition. presented at the 03/2011, Anaheim, CA: American Chemical Society.

2010

Haudek, K. C., Moscarella, R. A., Urban-Lurain, M., & Merrill, J. E.. (2010). Beyond Multiple Choice: Using Automated Analysis to Evaluate Student Writing About Biology. Michigan State University. presented at the 10/2010, Michigan State University: MSU STEM Education day.
Lyons, C., Merrill, J. E., & Urban-Lurain, M.. (2010). Beyond Multiple Choice: Heterogeneous Thinking About Photosynthesis is Revealed by Automated Analysis of Student Writing. Michigan State University. presented at the 10/2010, Michigan State University STEM Education Day.
Sibley, D. F., Gentner, D., & Libarkin, J. C.. (2010). Analogical reasoning and global change literacy. In Geological Society of American Annual Meeting. presented at the 10/2010, Denver, CO.
Haudek, K. C., Moscarella, R. A., Urban-Lurain, M., & Merrill, J. E.. (2010). Beyond Multiple Choice: Developing Automated Analysis of Constructed Responses. presented at the 05/2010, Michigan State University: MSU SOTL symposium.
Urban-Lurain, M., Moscarella, R. A., Haudek, K. C., Giese, E., Merrill, J. E., & Sibley, D. F.. (2010). Insight into student thinking in STEM: Lessons learned from lexical analysis of student writing. NARST Annual International Conference. Philadelphia, PA: National Association for Research on Science Teaching.

2009

Haudek, K. C., Moscarella, R. A., Urban-Lurain, M., Merrill, J. E., Sweeder, R., & Richmond, G.. (2009). Using lexical analysis software to understand student knowledge transfer between chemistry and biology. National Association of Research in Science Teaching Annual Conference. presented at the April 17-21, Garden Grove, CA: National Assocation for Research in Science Teaching.
Giese, E., & Sibley, D. F.. (2009). Students' analogies as instructional and assessment tools in earth systems science. In The Geological Society of America (GSA) Annual Meeting. presented at the 10/2009, Portland, OR: GSA.
Phillis, R., Barlow, J. Z., & Fitzgerald, J.. (2009). Creating Reasoning Problems for In-Class Learning. The American Biology Teacher, 71(4). presented at the 04/2009. doi:10.1662/005.071.0405
Haudek, K. C., Moscarella, R. A., Urban-Lurain, M., & Merrill, J. E.. (2009). Computer Scoring of Essay Questions. presented at the 03/2009, Biology Leadership Conference.

2008

Moscarella, R. A., Urban-Lurain, M., Merritt, B., Long, T., Richmond, G., Merrill, J. E., et al.. (2008). Understanding undergraduate students' conceptions in science: Using lexical analysis software to analyze students' constructed responses in biology. NARST 2008 Annual International Conference. presented at the March 30 - April, Baltimore, MD: National Association for Research in Science Teaching.
Smith, M. K., Wood, W. B., & Knight, J.. (2008). The genetics concept assessment: A new concept inventory for gauging student understanding of genetics. CBE Life Sci Educ, 7, 422-430. presented at the December 1, 2008. doi:10.1187/cbe.08-08-0045

thumbnail of small NSF logo in color without shading

This material is based upon work supported by the National Science Foundation (DUE grants: 1438739, 1323162, 1347740, 0736952 and 1022653). Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the NSF.