P280: Investigating evidence based on test consequences in chemistry education research [WITHDRAWN]

Author: Janelle A. Arjoon, University of South Florida, USA

Co-Author: Jennifer E. Lewis, University of South Florida, USA

Date: 8/4/14

Time: 4:00 PM4:20 PM

Room: LTT 103

Related Symposium: S13

Many of the instruments developed for research use by the chemical education community are relatively new, yet scores generated by these instruments may be used for decision-making. While psychometric evidence dictates the validity of test score interpretations, evidence about test consequences also informs validity (Standards for Educational and Psychological Testing, AERA, APA & NCME, 1999). The motivation for this study was to determine whether there are indications that our community considers test consequences. This talk presents our operationalization of consequential validity and results using a sample of instruments published in the Journal of Chemical Education between 2002 and 2013 and follow-up publications reporting the use of these instruments. Findings suggest that our community investigates evidence based on test consequences in different ways and support a general conclusion that our community can be encouraged to gather and report this type of evidence at the level of detail used in research studies.