國立虎尾科技大學 |

Measuring Multidimensional Science Learning : = Item Design, Scoring, and Psychometric Considerations.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	Measuring Multidimensional Science Learning :/
Reminder of title:	Item Design, Scoring, and Psychometric Considerations.
Author:	Castle, Courtney.
Description:	1 online resource (385 pages)
Notes:	Source: Dissertation Abstracts International, Volume: 79-08(E), Section: A.
Contained By:	Dissertation Abstracts International79-08A(E).
Subject:	Educational tests & measurements. -
Online resource:	click for full text (PQDT)
ISBN:	9780355832907

Measuring Multidimensional Science Learning : = Item Design, Scoring, and Psychometric Considerations.
Castle, Courtney.

Measuring Multidimensional Science Learning :Item Design, Scoring, and Psychometric Considerations. - 1 online resource (385 pages)

Source: Dissertation Abstracts International, Volume: 79-08(E), Section: A.

Thesis (Ph.D.)--Boston College, 2018.

Includes bibliographical references

The Next Generation Science Standards propose a multidimensional model of science learning, comprised of Core Disciplinary Ideas, Science and Engineering Practices, and Crosscutting Concepts (NGSS Lead States, 2013). Accordingly, there is a need for student assessment aligned with the new standards. Creating assessments that validly and reliably measure multidimensional science ability is a challenge for the measurement community (Pellegrino, et al., 2014). Multidimensional assessment tasks may need to go beyond typical item designs of standalone multiple-choice and short-answer items. Furthermore, scoring and modeling of student performance should account for the multidimensionality of the construct.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2018

Mode of access: World Wide Web

ISBN: 9780355832907Subjects--Topical Terms:

1180442
Educational tests & measurements.
Index Terms--Genre/Form:

554714
Electronic books.

Measuring Multidimensional Science Learning : = Item Design, Scoring, and Psychometric Considerations.
LDR:03839ntm a2200397Ki 4500 001 920317
005 20181130083526.5
006 m o u
007 cr mn||||a|a||
008 190606s2018 xx obm 000 0 eng d
020 $a 9780355832907
035 $a (MiAaPQ)AAI10786367
035 $a (MiAaPQ)bc:11655
035 $a AAI10786367
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Castle, Courtney. $3 1195073
245 1 0 $a Measuring Multidimensional Science Learning : $b Item Design, Scoring, and Psychometric Considerations.
264 0 $c 2018
300 $a 1 online resource (385 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertation Abstracts International, Volume: 79-08(E), Section: A.
500 $a Adviser: Henry Braun.
502 $a Thesis (Ph.D.)--Boston College, 2018.
504 $a Includes bibliographical references
520 $a The Next Generation Science Standards propose a multidimensional model of science learning, comprised of Core Disciplinary Ideas, Science and Engineering Practices, and Crosscutting Concepts (NGSS Lead States, 2013). Accordingly, there is a need for student assessment aligned with the new standards. Creating assessments that validly and reliably measure multidimensional science ability is a challenge for the measurement community (Pellegrino, et al., 2014). Multidimensional assessment tasks may need to go beyond typical item designs of standalone multiple-choice and short-answer items. Furthermore, scoring and modeling of student performance should account for the multidimensionality of the construct.
520 $a This research contributes to knowledge about best practices for multidimensional science assessment by exploring three areas of interest: 1) item design, 2) scoring rubrics, and 3) measurement models. This study investigated multidimensional scaffolding and response format by comparing alternative item designs on an elementary assessment of matter. Item variations had a different number of item prompts and/or response formats. Observations about student cognition and performance were collected during cognitive interviews and a pilot test. Items were scored using a holistic rubric and a multidimensional rubric, and interrater agreement was examined. Assessment data was scaled with multidimensional scores and holistic scores, using unidimensional and multidimensional Rasch models, and model-data fit was compared.
520 $a Results showed that scaffolding is associated with more thorough responses, especially among low ability students. Students tended to utilize different cognitive processes to respond to selected-response items and constructed-response items, and were more likely to respond to selected-response arguments.
520 $a Interrater agreement was highest when the structure of the item aligned with the structure of the scoring rubric. Holistic scores provided similar reliability and precision as multidimensional scores, but item and person fit was poorer. Multidimensional subscales had lower reliability, less precise student estimates than the unidimensional model, and interdimensional correlations were high. However, the multidimensional rubric and model provide nuanced information about student performance and better fit to the response data.
520 $a Recommendations about optimal combinations of scaffolding, rubric, and measurement models are made for teachers, policymakers, and researchers.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2018
538 $a Mode of access: World Wide Web
650 4 $a Educational tests & measurements. $3 1180442
650 4 $a Science education. $3 1151737
650 4 $a Elementary education. $3 1148439
655 7 $a Electronic books. $2 local $3 554714
690 $a 0288
690 $a 0714
690 $a 0524
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a Boston College. $b LSOE - Educational Research, Measurement and Evaluation. $3 1195074
773 0 $t Dissertation Abstracts International $g 79-08A(E).
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=10786367 $z click for full text (PQDT)