Abstract: Quality control in assessment is of critical importance to ensure the reliability and validity of the scores produced by assessments, and the replicability and reproducibility of research findings. In this talk I will cover various aspects of quality control in high-stakes and low-stakes assessment scenarios. One specific problem will be discussed in detail, i.e., the detection of unintended intra-individual change during the assessment process, such as test speededness and item pre-knowledge in the high-stakes context and respondent disengagement in the low-stakes context. By bringing the traditional statistical quality control methods including change point analysis and CUSUM control chart into the framework of item response theory (IRT) modeling, new methods are developed to detect such response anomalies and protect validity of assessment scores.

This seminar will be livestreamed via Zoom https://umich.zoom.us/j/94350208889
There will be a virtual reception to follow