國立虎尾科技大學 |

Extending an IRT Mixture Model to Detect Random Responders on Non-Cognitive Polytomously Scored Assessments.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	Extending an IRT Mixture Model to Detect Random Responders on Non-Cognitive Polytomously Scored Assessments./
Author:	Swanson, Mandalyn R.
Description:	1 online resource (153 pages)
Notes:	Source: Dissertation Abstracts International, Volume: 76-09(E), Section: A.
Subject:	Higher education. -
Online resource:	click for full text (PQDT)
ISBN:	9781321741339

Extending an IRT Mixture Model to Detect Random Responders on Non-Cognitive Polytomously Scored Assessments.
Swanson, Mandalyn R.

Extending an IRT Mixture Model to Detect Random Responders on Non-Cognitive Polytomously Scored Assessments. - 1 online resource (153 pages)

Source: Dissertation Abstracts International, Volume: 76-09(E), Section: A.

Thesis (Ph.D.)--James Madison University, 2015.

Includes bibliographical references

This study represents an attempt to distinguish two classes of examinees -- random responders and valid responders -- on non-cognitive assessments in low-stakes testing. The majority of existing literature regarding the detection of random responders in low-stakes settings exists in regard to cognitive tests that are dichotomously scored. However, evidence suggests that random responding occurs on non-cognitive assessments, and as with cognitive measures, the data derived from such measures are used to inform practice. Thus, a threat to test score validity exists if examinees' response selections do not accurately reflect their underlying level on the construct being assessed. As with cognitive tests, using data from measures in which students did not give their best effort could have negative implications for future decisions. Thus, there is a need for a method of detecting random responders on non-cognitive assessments that are polytomously scored.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2018

Mode of access: World Wide Web

ISBN: 9781321741339Subjects--Topical Terms:

1148448
Higher education.
Index Terms--Genre/Form:

554714
Electronic books.

Extending an IRT Mixture Model to Detect Random Responders on Non-Cognitive Polytomously Scored Assessments.
LDR:03603ntm a2200361K 4500 001 913772
005 20180622095237.5
006 m o u
007 cr mn||||a|a||
008 190606s2015 xx obm 000 0 eng d
020 $a 9781321741339
035 $a (MiAaPQ)AAI3702696
035 $a (MiAaPQ)jmu:10152
035 $a AAI3702696
040 $a MiAaPQ $b eng $c MiAaPQ
100 1 $a Swanson, Mandalyn R. $3 1186747
245 1 0 $a Extending an IRT Mixture Model to Detect Random Responders on Non-Cognitive Polytomously Scored Assessments.
264 0 $c 2015
300 $a 1 online resource (153 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertation Abstracts International, Volume: 76-09(E), Section: A.
500 $a Adviser: Dena A. Pastor.
502 $a Thesis (Ph.D.)--James Madison University, 2015.
504 $a Includes bibliographical references
520 $a This study represents an attempt to distinguish two classes of examinees -- random responders and valid responders -- on non-cognitive assessments in low-stakes testing. The majority of existing literature regarding the detection of random responders in low-stakes settings exists in regard to cognitive tests that are dichotomously scored. However, evidence suggests that random responding occurs on non-cognitive assessments, and as with cognitive measures, the data derived from such measures are used to inform practice. Thus, a threat to test score validity exists if examinees' response selections do not accurately reflect their underlying level on the construct being assessed. As with cognitive tests, using data from measures in which students did not give their best effort could have negative implications for future decisions. Thus, there is a need for a method of detecting random responders on non-cognitive assessments that are polytomously scored.
520 $a This dissertation provides an overview of existing techniques for identifying low-motivated or amotivated examinees within low-stakes cognitive testing contexts including motivation filtering, response time effort, and item response theory mixture modeling, with particular attention paid to an IRT mixture model referred to in this dissertation as the Random Responders model -- Graded Response model (RRM-GRM). Two studies, a simulation and an applied study, were conducted to explore the utility of the RRM-GRM for detecting and accounting for random responders on non-cognitive instruments in low-stakes testing settings. The findings from the simulation study show considerable bias and RMSE in parameter estimates and bias in theta estimates when the proportion of random responders is greater than 5%. Use of the RRM-GRM with the same data sets provides parameter estimates with minimal to no bias and RMSE and theta estimates that are essentially bias free. The applied study demonstrated that when fitting the RRM-GRM to authentic data, 5.6% of the responders were identified as random responders. Respondents classified as random responders were found to have higher odds of being males and of having lower scores on importance of the test, as well as lower average total scores on the UMUM-15 measure used in the study. Limitations of the RRM-GRM technique are discussed.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2018
538 $a Mode of access: World Wide Web
650 4 $a Higher education. $3 1148448
650 4 $a Educational psychology. $3 555103
650 4 $a Cognitive psychology. $3 556029
650 4 $a Behavioral psychology. $3 1179418
655 7 $a Electronic books. $2 local $3 554714
690 $a 0745
690 $a 0525
690 $a 0633
690 $a 0384
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a James Madison University. $b Graduate Psychology-Assessment and Measurement. $3 1186748
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3702696 $z click for full text (PQDT)