Share this page

The effect of differential motivation on IRT linking

By Marie-Anne Mittelhaëuser, Anton Béguin, Klaas Sijtsma

Abstract

The purpose of this study was to investigate whether simulated differential motivation between the stakes for operational tests and anchor items produces an invalid linking result if the Rasch model is used to link the operational tests. This was done for an external anchor design and a variation of a pretest design.

The study also investigated whether a constrained mixture Rasch model could identify latent classes in such a way that one latent class represented high-stakes responding while the other represented low-stakes responding.

The results indicated that for an external anchor design, the Rasch linking result was only biased when the motivation level differed between the subpopulations to which the anchor items were administered. However, the mixture Rasch model did not identify the classes representing low-stakes and high-stakes responding.

When a pretest design was used to link the operational tests by means of a Rasch model, the linking result was found to be biased in each condition. Bias increased as percentage of students showing low-stakes responding to the anchor items increased. The mixture Rasch model only identified the classes representing low-stakes and high-stakes responding under a limited number of conditions.

How to cite

Mittelhaëuser, M-A., Béguin, A. A., & Sijtsma, K. (2015). The effect of differential motivation on IRT linking. Journal of Educational Measurement, 52(3), 339–358.

Keywords

Connect with us

Contact our team

Email: research@aqa.org.uk

Press and media

For media enquiries please contact:

Email: cmellis@aqa.org.uk

Tel: 01483 477 911

Mob: 07795 020 690

Out of hours: 01483 556194

Join us

Work with us to advance education and enable students and teachers to reach their potential.

Apply now