國立虎尾科技大學 |

Synthetic Data Generator : = Understanding Human Face & Body via Image Synthesis.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	Synthetic Data Generator :/
Reminder of title:	Understanding Human Face & Body via Image Synthesis.
Author:	Yin, Yu.
Description:	1 online resource (151 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 85-03, Section: B.
Contained By:	Dissertations Abstracts International85-03B.
Subject:	Computer engineering. -
Online resource:	click for full text (PQDT)
ISBN:	9798380156240

Synthetic Data Generator : = Understanding Human Face & Body via Image Synthesis.
Yin, Yu.

Synthetic Data Generator :Understanding Human Face & Body via Image Synthesis. - 1 online resource (151 pages)

Source: Dissertations Abstracts International, Volume: 85-03, Section: B.

Thesis (Ph.D.)--Northeastern University, 2023.

Includes bibliographical references

The synthesis of data has long been a valuable resource for training machine learning models, offering reliability and control while reducing the reliance on real-world data collection. This is particularly pertinent to the realms of human face and body synthesis, where concerns regarding model fairness and ethical deployment hold paramount importance. Nevertheless, the challenge persists in generating convincing, identity-preserving, and high-quality digitized humans within the domains of 2D and 3D image synthesis. This dissertation embarks on a comprehensive exploration of the potential to comprehend human behavior by recreating it, presenting its findings through three distinct and interconnected sections: 1) Enhancing 2D Image Generation: We delve into the realm of 2D image generation models and their symbiotic relationship with facial applications, such as landmark localization and face recognition tasks. A strong correlation is observed between super- resolution (SR) and the localization of minute facial features. We propose integrated frameworks that leverage mutual benefits between face alignment and SR, thereby amplifying the performance of both tasks. Furthermore, we highlight how face frontalization serves as an effective augmentation technique, enhancing face recognition accuracy under extreme pose scenarios. Additionally, we extend our exploration to encompass GAN inversion and editing techniques, facilitating the creation of more authentic and lifelike facial representations. 2) Advancing 3D Parametric Generation: Shifting focus to 3D parametric generation models, we explore their instrumental role in facilitating human body pose and shape estimation. In healthcare, technological advancements aimed at monitoring body and behavioral patterns during sleep and rest are imperative. Nonetheless, challenges emerge when accounting for occlusion caused by blankets during rest. Addressing this, we introduce an attention- based generation module to mitigate uncertainties arising from occluded body parts. This module generates uncovered modalities, iteratively refining the current estimations via a cyclic process. 3) Pioneering 3D Nerf-Based Generative Models: Our exploration further extends to the cutting- edge realm of 3D Nerf-based Generative models, focused on generating high-quality images with consistent 3D geometry fidelity. A novel and universally applicable method is presented, enabling precise fine-tuning of NeRF-GAN models. This groundbreaking approach yields remarkably detailed animations of real subjects from a single image, thus bridging the gap between data synthesis and high-fidelity animation. In essence, this dissertation contributes to the advancement of knowledge by unraveling the intricacies of human behavior through data synthesis. Through an integrated approach across 2D and 3D domains, it opens avenues for enhanced machine learning training, healthcare monitoring, and realistic animation, thereby bridging the gap between synthetic and real-world understanding.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2024

Mode of access: World Wide Web

ISBN: 9798380156240Subjects--Topical Terms:

569006
Computer engineering.
Subjects--Index Terms:

3D image synthesisIndex Terms--Genre/Form:

554714
Electronic books.

Synthetic Data Generator : = Understanding Human Face & Body via Image Synthesis.
LDR:04423ntm a22003977 4500 001 1148720
005 20240930100126.5
006 m o d
007 cr bn ---uuuuu
008 250605s2023 xx obm 000 0 eng d
020 $a 9798380156240
035 $a (MiAaPQ)AAI30637292
035 $a AAI30637292
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Yin, Yu. $3 1474760
245 1 0 $a Synthetic Data Generator : $b Understanding Human Face & Body via Image Synthesis.
264 0 $c 2023
300 $a 1 online resource (151 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 85-03, Section: B.
500 $a Advisor: Fu, Yun.
502 $a Thesis (Ph.D.)--Northeastern University, 2023.
504 $a Includes bibliographical references
520 $a The synthesis of data has long been a valuable resource for training machine learning models, offering reliability and control while reducing the reliance on real-world data collection. This is particularly pertinent to the realms of human face and body synthesis, where concerns regarding model fairness and ethical deployment hold paramount importance. Nevertheless, the challenge persists in generating convincing, identity-preserving, and high-quality digitized humans within the domains of 2D and 3D image synthesis. This dissertation embarks on a comprehensive exploration of the potential to comprehend human behavior by recreating it, presenting its findings through three distinct and interconnected sections: 1) Enhancing 2D Image Generation: We delve into the realm of 2D image generation models and their symbiotic relationship with facial applications, such as landmark localization and face recognition tasks. A strong correlation is observed between super- resolution (SR) and the localization of minute facial features. We propose integrated frameworks that leverage mutual benefits between face alignment and SR, thereby amplifying the performance of both tasks. Furthermore, we highlight how face frontalization serves as an effective augmentation technique, enhancing face recognition accuracy under extreme pose scenarios. Additionally, we extend our exploration to encompass GAN inversion and editing techniques, facilitating the creation of more authentic and lifelike facial representations. 2) Advancing 3D Parametric Generation: Shifting focus to 3D parametric generation models, we explore their instrumental role in facilitating human body pose and shape estimation. In healthcare, technological advancements aimed at monitoring body and behavioral patterns during sleep and rest are imperative. Nonetheless, challenges emerge when accounting for occlusion caused by blankets during rest. Addressing this, we introduce an attention- based generation module to mitigate uncertainties arising from occluded body parts. This module generates uncovered modalities, iteratively refining the current estimations via a cyclic process. 3) Pioneering 3D Nerf-Based Generative Models: Our exploration further extends to the cutting- edge realm of 3D Nerf-based Generative models, focused on generating high-quality images with consistent 3D geometry fidelity. A novel and universally applicable method is presented, enabling precise fine-tuning of NeRF-GAN models. This groundbreaking approach yields remarkably detailed animations of real subjects from a single image, thus bridging the gap between data synthesis and high-fidelity animation. In essence, this dissertation contributes to the advancement of knowledge by unraveling the intricacies of human behavior through data synthesis. Through an integrated approach across 2D and 3D domains, it opens avenues for enhanced machine learning training, healthcare monitoring, and realistic animation, thereby bridging the gap between synthetic and real-world understanding.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2024
538 $a Mode of access: World Wide Web
650 4 $a Computer engineering. $3 569006
650 4 $a Computer science. $3 573171
653 $a 3D image synthesis
653 $a Image generation models
653 $a Editing techniques
653 $a Geometry fidelity
653 $a Data synthesis
655 7 $a Electronic books. $2 local $3 554714
690 $a 0464
690 $a 0984
690 $a 0800
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a Northeastern University. $b Electrical and Computer Engineering. $3 1182193
773 0 $t Dissertations Abstracts International $g 85-03B.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=30637292 $z click for full text (PQDT)