國立虎尾科技大學 |

An Experimental Study of Supervised Machine Learning Techniques for Minor Class Prediction Utilizing Kernel Density Estimation : = Factors Impacting Model Performance.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	An Experimental Study of Supervised Machine Learning Techniques for Minor Class Prediction Utilizing Kernel Density Estimation :/
Reminder of title:	Factors Impacting Model Performance.
Author:	Alfarwan, Abdullah Mana.
Description:	1 online resource (446 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 86-01, Section: B.
Contained By:	Dissertations Abstracts International86-01B.
Subject:	Educational tests & measurements. -
Online resource:	click for full text (PQDT)
ISBN:	9798383205914

An Experimental Study of Supervised Machine Learning Techniques for Minor Class Prediction Utilizing Kernel Density Estimation : = Factors Impacting Model Performance.
Alfarwan, Abdullah Mana.

An Experimental Study of Supervised Machine Learning Techniques for Minor Class Prediction Utilizing Kernel Density Estimation :Factors Impacting Model Performance. - 1 online resource (446 pages)

Source: Dissertations Abstracts International, Volume: 86-01, Section: B.

Thesis (Ph.D.)--Western Michigan University, 2024.

Includes bibliographical references

This dissertation examined classification outcome differences among four popular individual supervised machine learning (ISML) models (logistic regression, decision tree, support vector machine, and multilayer perceptron) when predicting minor class membership within imbalanced datasets. The study context and the theoretical population sampled focus on one aspect of the larger problem of student retention and dropout prediction in higher education (HE): identification.This study differs from current literature by implementing an experimental design approach with simulated student data that closely mirrors HE situational and student data. Specifically, this study tested the predictive ability of the four ISML classification models (CLS) under experimentally manipulated conditions. These included total sample size (TS), minor class proportion (MCP), training-to-testing sample size ratios (TTSS), and the application of bagging techniques during model training (BAG). Using this 4-between, 1-within mixed design, five different outcome measures (precision, recall/sensitivity, specificity, F1-score and AUC) were examined and analyzed individually.For each outcome measure, findings revealed multiple statistically significant interactions among classifier models and design variables. Simple effect analyses of these interactions highlighted how TS, MCP, TTSS, and BAG differentially affect different measures of classification performance such as precision, recall/sensitivity, specificity, F1-score, and AUC. For instance, the presence of interactions involving MCP underscores the importance of informed modeling of class distribution for enhancing overall model predictive capability and performance.Such insights regarding how the experimental variables can critically affect different measures of classification success advances our understanding of how these four ISML models might be optimized for the prediction of student-at-risk status within imbalanced datasets. This dissertation provides a framework for using these or similar ISML models more effectively in HE. It points toward the development of predictive modeling methods that are more useful and perhaps equitable by demonstrating empirically the impact of one of the most challenging aspects of implementing machine learning in HE: maximizing the accurate identification of the minority class. This work contributes to the use of machine learning in HE and will help inform its use in smaller and larger educational research communities by providing strategies for improving the prediction of student dropout.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2024

Mode of access: World Wide Web

ISBN: 9798383205914Subjects--Topical Terms:

1180442
Educational tests & measurements.
Subjects--Index Terms:

Individual supervised machine learningIndex Terms--Genre/Form:

554714
Electronic books.

An Experimental Study of Supervised Machine Learning Techniques for Minor Class Prediction Utilizing Kernel Density Estimation : = Factors Impacting Model Performance.
LDR:04073ntm a22003977 4500 001 1150513
005 20241028051510.5
006 m o d
007 cr bn ---uuuuu
008 250605s2024 xx obm 000 0 eng d
020 $a 9798383205914
035 $a (MiAaPQ)AAI31301194
035 $a AAI31301194
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Alfarwan, Abdullah Mana. $3 1477002
245 1 3 $a An Experimental Study of Supervised Machine Learning Techniques for Minor Class Prediction Utilizing Kernel Density Estimation : $b Factors Impacting Model Performance.
264 0 $c 2024
300 $a 1 online resource (446 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 86-01, Section: B.
500 $a Advisor: Applegate, Brooks.
502 $a Thesis (Ph.D.)--Western Michigan University, 2024.
504 $a Includes bibliographical references
520 $a This dissertation examined classification outcome differences among four popular individual supervised machine learning (ISML) models (logistic regression, decision tree, support vector machine, and multilayer perceptron) when predicting minor class membership within imbalanced datasets. The study context and the theoretical population sampled focus on one aspect of the larger problem of student retention and dropout prediction in higher education (HE): identification.This study differs from current literature by implementing an experimental design approach with simulated student data that closely mirrors HE situational and student data. Specifically, this study tested the predictive ability of the four ISML classification models (CLS) under experimentally manipulated conditions. These included total sample size (TS), minor class proportion (MCP), training-to-testing sample size ratios (TTSS), and the application of bagging techniques during model training (BAG). Using this 4-between, 1-within mixed design, five different outcome measures (precision, recall/sensitivity, specificity, F1-score and AUC) were examined and analyzed individually.For each outcome measure, findings revealed multiple statistically significant interactions among classifier models and design variables. Simple effect analyses of these interactions highlighted how TS, MCP, TTSS, and BAG differentially affect different measures of classification performance such as precision, recall/sensitivity, specificity, F1-score, and AUC. For instance, the presence of interactions involving MCP underscores the importance of informed modeling of class distribution for enhancing overall model predictive capability and performance.Such insights regarding how the experimental variables can critically affect different measures of classification success advances our understanding of how these four ISML models might be optimized for the prediction of student-at-risk status within imbalanced datasets. This dissertation provides a framework for using these or similar ISML models more effectively in HE. It points toward the development of predictive modeling methods that are more useful and perhaps equitable by demonstrating empirically the impact of one of the most challenging aspects of implementing machine learning in HE: maximizing the accurate identification of the minority class. This work contributes to the use of machine learning in HE and will help inform its use in smaller and larger educational research communities by providing strategies for improving the prediction of student dropout.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2024
538 $a Mode of access: World Wide Web
650 4 $a Educational tests & measurements. $3 1180442
650 4 $a Statistics. $3 556824
650 4 $a Higher education. $3 1148448
650 4 $a Educational evaluation. $3 555501
653 $a Individual supervised machine learning
653 $a Classification models
653 $a Logistic regression
653 $a Dropout
655 7 $a Electronic books. $2 local $3 554714
690 $a 0288
690 $a 0463
690 $a 0443
690 $a 0745
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a Western Michigan University. $b Educational Leadership, Research, & Technology. $3 1477003
773 0 $t Dissertations Abstracts International $g 86-01B.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31301194 $z click for full text (PQDT)