國立虎尾科技大學 |

Foundations of Trustworthy Deep Learning : = Fairness, Robustness, and Explainability.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	Foundations of Trustworthy Deep Learning :/
Reminder of title:	Fairness, Robustness, and Explainability.
Author:	Nanda, Vedant.
Description:	1 online resource (233 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 85-12, Section: B.
Contained By:	Dissertations Abstracts International85-12B.
Subject:	Computer science. -
Online resource:	click for full text (PQDT)
ISBN:	9798383180976

Foundations of Trustworthy Deep Learning : = Fairness, Robustness, and Explainability.
Nanda, Vedant.

Foundations of Trustworthy Deep Learning :Fairness, Robustness, and Explainability. - 1 online resource (233 pages)

Source: Dissertations Abstracts International, Volume: 85-12, Section: B.

Thesis (Ph.D.)--University of Maryland, College Park, 2024.

Includes bibliographical references

Deep Learning (DL) models, especially with the rise of the so-called foundation models, are increasingly used in real-world applications either as autonomous systems (e.g. facial recognition), as decision aids (e.g. medical imaging, writing assistants), and even to generate novel content (e.g. chatbots, image generators). This naturally results in concerns about the trustworthiness of these systems, for example, do the models systematically perform worse for certain subgroups? Are the outputs of these models reliable under perturbations to the inputs? This thesis aims to strengthen the foundations of DL models, so they can be trusted in deployment. I will cover three important aspects of trust: fairness, robustness, and explainability. I will argue that we need to expand the scope of each of these aspects when applying them to DL models and carefully consider possible tradeoffs between these desirable but sometimes conflicting notions of trust.Traditionally the fairness community has worked on mitigating biases in classical models such as Support Vector Machines (SVMs) and logistic regression. However, a lot of real-world applications where bias shows up in a myriad of ways involve much more complicated DL models. In the first part, I will present two works that show how thinking about fairness for deep learning (DL) introduces new challenges, especially due to their overparametrized nature and susceptibility to adversarial attacks.Robustness literature has focused largely on measuring the invariance of models to carefully constructed (adversarial attacks) or natural (distribution shifts) noise. In the second part, I will argue that to get truly robust models, we must focus on a more general notion of robustness: measuring the alignment of invariances of DL models with other models of perception such as humans. I will present two works that measure shared invariances between (1) DL models and humans, and (2) between DL models. Such measurements of robustness provide a measure of relative robustness, through which we can better understand the failure modes of DL models and work towards building truly robust systems.Finally, in the third part, I will show how even a small subset of randomly chosen neurons from a pre-trained representation can transfer very well to downstream tasks. We call this phenomenon diffused redundancy, which we observe in a variety of pre-trained representations. This finding challenges existing beliefs in the explainability literature that claim individual neurons learn disjoint semantically meaningful concepts.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2024

Mode of access: World Wide Web

ISBN: 9798383180976Subjects--Topical Terms:

573171
Computer science.
Subjects--Index Terms:

Deep LearningIndex Terms--Genre/Form:

554714
Electronic books.

Foundations of Trustworthy Deep Learning : = Fairness, Robustness, and Explainability.
LDR:03980ntm a22003977 4500 001 1150178
005 20241022111608.5
006 m o d
007 cr bn ---uuuuu
008 250605s2024 xx obm 000 0 eng d
020 $a 9798383180976
035 $a (MiAaPQ)AAI31147338
035 $a AAI31147338
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Nanda, Vedant. $3 1476614
245 1 0 $a Foundations of Trustworthy Deep Learning : $b Fairness, Robustness, and Explainability.
264 0 $c 2024
300 $a 1 online resource (233 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 85-12, Section: B.
500 $a Advisor: Dickerson, John P.;Gummadi, Krishna P.
502 $a Thesis (Ph.D.)--University of Maryland, College Park, 2024.
504 $a Includes bibliographical references
520 $a Deep Learning (DL) models, especially with the rise of the so-called foundation models, are increasingly used in real-world applications either as autonomous systems (e.g. facial recognition), as decision aids (e.g. medical imaging, writing assistants), and even to generate novel content (e.g. chatbots, image generators). This naturally results in concerns about the trustworthiness of these systems, for example, do the models systematically perform worse for certain subgroups? Are the outputs of these models reliable under perturbations to the inputs? This thesis aims to strengthen the foundations of DL models, so they can be trusted in deployment. I will cover three important aspects of trust: fairness, robustness, and explainability. I will argue that we need to expand the scope of each of these aspects when applying them to DL models and carefully consider possible tradeoffs between these desirable but sometimes conflicting notions of trust.Traditionally the fairness community has worked on mitigating biases in classical models such as Support Vector Machines (SVMs) and logistic regression. However, a lot of real-world applications where bias shows up in a myriad of ways involve much more complicated DL models. In the first part, I will present two works that show how thinking about fairness for deep learning (DL) introduces new challenges, especially due to their overparametrized nature and susceptibility to adversarial attacks.Robustness literature has focused largely on measuring the invariance of models to carefully constructed (adversarial attacks) or natural (distribution shifts) noise. In the second part, I will argue that to get truly robust models, we must focus on a more general notion of robustness: measuring the alignment of invariances of DL models with other models of perception such as humans. I will present two works that measure shared invariances between (1) DL models and humans, and (2) between DL models. Such measurements of robustness provide a measure of relative robustness, through which we can better understand the failure modes of DL models and work towards building truly robust systems.Finally, in the third part, I will show how even a small subset of randomly chosen neurons from a pre-trained representation can transfer very well to downstream tasks. We call this phenomenon diffused redundancy, which we observe in a variety of pre-trained representations. This finding challenges existing beliefs in the explainability literature that claim individual neurons learn disjoint semantically meaningful concepts.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2024
538 $a Mode of access: World Wide Web
650 4 $a Computer science. $3 573171
650 4 $a Information technology. $3 559429
653 $a Deep Learning
653 $a Explainability
653 $a Fairness
653 $a Robustness
653 $a Trustworthiness
655 7 $a Electronic books. $2 local $3 554714
690 $a 0984
690 $a 0800
690 $a 0489
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a University of Maryland, College Park. $b Computer Science. $3 1180862
773 0 $t Dissertations Abstracts International $g 85-12B.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31147338 $z click for full text (PQDT)