國立虎尾科技大學 |

A New Item Response Theory Model for Estimating Person Ability and Item Parameters for Multidimensional Rank Order Responses.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	A New Item Response Theory Model for Estimating Person Ability and Item Parameters for Multidimensional Rank Order Responses./
Author:	Seybert, Jacob.
Description:	1 online resource (148 pages)
Notes:	Source: Dissertation Abstracts International, Volume: 75-04(E), Section: B.
Subject:	Cognitive psychology. -
Online resource:	click for full text (PQDT)
ISBN:	9781303625008

A New Item Response Theory Model for Estimating Person Ability and Item Parameters for Multidimensional Rank Order Responses.
Seybert, Jacob.

A New Item Response Theory Model for Estimating Person Ability and Item Parameters for Multidimensional Rank Order Responses. - 1 online resource (148 pages)

Source: Dissertation Abstracts International, Volume: 75-04(E), Section: B.

Thesis (Ph.D.)--University of South Florida, 2013.

Includes bibliographical references

The assessment of noncognitive constructs poses a number of challenges that set it apart from traditional cognitive ability measurement. Of particular concern is the influence of response biases and response styles that can influence the accuracy of scale scores. One strategy to address these concerns is to use alternative item presentation formats (such as multidimensional forced choice (MFC) pairs, triads, and tetrads) that may provide resistance to such biases. A variety of strategies for constructing and scoring these forced choice measured have been proposed, though they often require large sample sizes, are limited in the way that statements can vary in location, and (in some cases) require a separate precalibration phase prior to the scoring of forced-choice responses. This dissertation introduces new item response theory models for estimating item and person parameters from rank-order responses indicating preferences among two or more alternatives representing, for example, different personality dimensions. Parameters for this new model, called the Hyperbolic Cosine Model for Rank order responses (HCM-RANK), can be estimated using Markov chain Monte Carlo (MCMC) methods that allow for the simultaneous evaluation of item properties and person scores. The efficacy of the MCMC parameter estimation procedures for these new models was examined via three studies. Study 1 was a Monte Carlo simulation examining the efficacy of parameter recovery across levels of sample size, dimensionality, and approaches to item calibration and scoring. It was found that estimation accuracy improves with sample size, and trait scores and location parameters can be estimated reasonably well in small samples. Study 2 was a simulation examining the robustness of trait estimation to error introduced by substituting subject matter expert (SME) estimates of statement location for MCMC item parameter estimates and true item parameters. Only small decreases in accuracy relative to the true parameters were observed, suggesting that using SME ratings of statement location for scoring might be a viable short-term way of expediting MFC test deployment in field settings. Study 3 was included primarily to illustrate the use of the newly developed IRT models and estimation methods with real data. An empirical investigation comparing validities of personality measures using different item formats yielded mixed results and raised questions about multidimensional test construction practices that will be explored in future research. The presentation concludes with a discussion of MFC methods and potential applications in educational and workforce contexts.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2018

Mode of access: World Wide Web

ISBN: 9781303625008Subjects--Topical Terms:

556029
Cognitive psychology.
Index Terms--Genre/Form:

554714
Electronic books.

A New Item Response Theory Model for Estimating Person Ability and Item Parameters for Multidimensional Rank Order Responses.
LDR:03854ntm a2200313K 4500 001 913725
005 20180622095236.5
006 m o u
007 cr mn||||a|a||
008 190606s2013 xx obm 000 0 eng d
020 $a 9781303625008
035 $a (MiAaPQ)AAI3605762
035 $a (MiAaPQ)usf:12119
035 $a AAI3605762
040 $a MiAaPQ $b eng $c MiAaPQ
100 1 $a Seybert, Jacob. $3 1186679
245 1 2 $a A New Item Response Theory Model for Estimating Person Ability and Item Parameters for Multidimensional Rank Order Responses.
264 0 $c 2013
300 $a 1 online resource (148 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertation Abstracts International, Volume: 75-04(E), Section: B.
500 $a Adviser: Stephen Stark.
502 $a Thesis (Ph.D.)--University of South Florida, 2013.
504 $a Includes bibliographical references
520 $a The assessment of noncognitive constructs poses a number of challenges that set it apart from traditional cognitive ability measurement. Of particular concern is the influence of response biases and response styles that can influence the accuracy of scale scores. One strategy to address these concerns is to use alternative item presentation formats (such as multidimensional forced choice (MFC) pairs, triads, and tetrads) that may provide resistance to such biases. A variety of strategies for constructing and scoring these forced choice measured have been proposed, though they often require large sample sizes, are limited in the way that statements can vary in location, and (in some cases) require a separate precalibration phase prior to the scoring of forced-choice responses. This dissertation introduces new item response theory models for estimating item and person parameters from rank-order responses indicating preferences among two or more alternatives representing, for example, different personality dimensions. Parameters for this new model, called the Hyperbolic Cosine Model for Rank order responses (HCM-RANK), can be estimated using Markov chain Monte Carlo (MCMC) methods that allow for the simultaneous evaluation of item properties and person scores. The efficacy of the MCMC parameter estimation procedures for these new models was examined via three studies. Study 1 was a Monte Carlo simulation examining the efficacy of parameter recovery across levels of sample size, dimensionality, and approaches to item calibration and scoring. It was found that estimation accuracy improves with sample size, and trait scores and location parameters can be estimated reasonably well in small samples. Study 2 was a simulation examining the robustness of trait estimation to error introduced by substituting subject matter expert (SME) estimates of statement location for MCMC item parameter estimates and true item parameters. Only small decreases in accuracy relative to the true parameters were observed, suggesting that using SME ratings of statement location for scoring might be a viable short-term way of expediting MFC test deployment in field settings. Study 3 was included primarily to illustrate the use of the newly developed IRT models and estimation methods with real data. An empirical investigation comparing validities of personality measures using different item formats yielded mixed results and raised questions about multidimensional test construction practices that will be explored in future research. The presentation concludes with a discussion of MFC methods and potential applications in educational and workforce contexts.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2018
538 $a Mode of access: World Wide Web
650 4 $a Cognitive psychology. $3 556029
655 7 $a Electronic books. $2 local $3 554714
690 $a 0633
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a University of South Florida. $b Psychology. $3 1184916
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3605762 $z click for full text (PQDT)