國立虎尾科技大學 |

A Novel Framework and Design Methodologies for Optimal Animation Production Using Deep Learning.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	A Novel Framework and Design Methodologies for Optimal Animation Production Using Deep Learning./
Author:	Yu, Zixiao.
Description:	1 online resource (154 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 85-04, Section: B.
Contained By:	Dissertations Abstracts International85-04B.
Subject:	Computer science. -
Online resource:	click for full text (PQDT)
ISBN:	9798380612708

A Novel Framework and Design Methodologies for Optimal Animation Production Using Deep Learning.
Yu, Zixiao.

A Novel Framework and Design Methodologies for Optimal Animation Production Using Deep Learning. - 1 online resource (154 pages)

Source: Dissertations Abstracts International, Volume: 85-04, Section: B.

Thesis (Ph.D.)--Michigan State University, 2023.

Includes bibliographical references

In this dissertation, we introduce an innovative automatic animation production framework and its modules aimed at overcoming the inherent challenges in traditional animation production, including the requirement for a substantial investment of time, resources, and expertise. The motivation for this scholarly endeavor stems from a comprehensive analysis of standard animation processes and consultations with experienced animators. Through this investigation, we have ascertained that achieving a high degree of automation necessitates the digitization of the full spectrum of resources and relevant data. To this end, we have structured the production continuum into four distinct but interrelated segments: Action List Generation, Stage Performance, Auto Cinematography, and Video Generation.In the realm of Stage Performance, we propose an innovative Real-time Phoneme Recognition Network (RealPRNet) for real-time lip-sync animation generation. Designed to correlate incoming audio input with the corresponding viseme (visual representation of a phoneme) in real-time, RealPRNet employs a multifaceted approach incorporating spatial, discrete temporal, and cohesive temporal features of the audio data. Significantly, the architecture of RealPRNet incorporates a stacked long short-term memory (LSTM) block and exploits long short-term features to optimize phoneme recognition. RealPRNet offers substantial improvements in reducing phoneme error rate and increasing in visual performance.Next, we delve into the text-to-animation framework (T2A), a pivotal construct in our research. While extant auto cinematography paradigms largely hinge on rudimentary cinematographic principles (aesthetics), T2A offers a more nuanced approach. It amalgamates the input script's visual fidelity with the resultant video's aesthetic compliance, by concurrently harnessing both fidelity and aesthetic models. Our evaluative studies, conducted with animators, attest to the superior quality of the resulting animations vis-a-vis methodologies solely reliant on aesthetic models, while reducing the workload of manual animation production by approximately 74%.However, it is germane to note that Auto Cinematography, when solely premised on canonical rule-based optimization, often falls short of audience expectations. we introduce RT2A (Reinforcement learning-based Text to Animation), a pioneering architecture that synergistically merges reinforcement learning techniques into the realm of automated film direction. Within the RT2A framework, each choice concerning camera orientation and positioning is systematically documented and integrated into subsequent training cycles for the reinforcement learning agent. Utilizing a carefully constructed reward function, the algorithm is guided toward the optimization of camera configurations that emulate the stylistic decisions commonly employed by human directors. Quantitative analysis reveals that RT2A can achieve 50% improvement in audience-approved camera placements and an 80% increase in fidelity over benchmark camera placements.Furthermore, due to the recent trend of personalized animation content influenced by user-generated interactions, the unpredictability and complexity of open-world settings pose a substantial challenge for automated cinematography techniques. To tackle this, we extend our framework along with an adaptive automated cinematography approach based on Generative Adversarial Networks (AACOGAN). According to empirical analyses, AACOGAN significantly outperforms existing methods in capturing the dynamism of open-world interactions. The efficacy of AACOGAN is underscored by a 73% improvement in the correlation between user behaviors and camera trajectory adaptations, as well as a marked elevation-up to 32.9%-in the quality of multi-focus scenes. These metrics offer compelling evidence that our methodology not only refines cinematographic outputs but also considerably augments user immersion within these complex virtual environments.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2024

Mode of access: World Wide Web

ISBN: 9798380612708Subjects--Topical Terms:

573171
Computer science.
Subjects--Index Terms:

Automatic cinematographyIndex Terms--Genre/Form:

554714
Electronic books.

A Novel Framework and Design Methodologies for Optimal Animation Production Using Deep Learning.
LDR:05360ntm a22003737 4500 001 1143661
005 20240517104624.5
006 m o d
007 cr mn ---uuuuu
008 250605s2023 xx obm 000 0 eng d
020 $a 9798380612708
035 $a (MiAaPQ)AAI30689828
035 $a AAI30689828
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Yu, Zixiao. $3 1468417
245 1 2 $a A Novel Framework and Design Methodologies for Optimal Animation Production Using Deep Learning.
264 0 $c 2023
300 $a 1 online resource (154 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 85-04, Section: B.
500 $a Advisor: Ren, Jian.
502 $a Thesis (Ph.D.)--Michigan State University, 2023.
504 $a Includes bibliographical references
520 $a In this dissertation, we introduce an innovative automatic animation production framework and its modules aimed at overcoming the inherent challenges in traditional animation production, including the requirement for a substantial investment of time, resources, and expertise. The motivation for this scholarly endeavor stems from a comprehensive analysis of standard animation processes and consultations with experienced animators. Through this investigation, we have ascertained that achieving a high degree of automation necessitates the digitization of the full spectrum of resources and relevant data. To this end, we have structured the production continuum into four distinct but interrelated segments: Action List Generation, Stage Performance, Auto Cinematography, and Video Generation.In the realm of Stage Performance, we propose an innovative Real-time Phoneme Recognition Network (RealPRNet) for real-time lip-sync animation generation. Designed to correlate incoming audio input with the corresponding viseme (visual representation of a phoneme) in real-time, RealPRNet employs a multifaceted approach incorporating spatial, discrete temporal, and cohesive temporal features of the audio data. Significantly, the architecture of RealPRNet incorporates a stacked long short-term memory (LSTM) block and exploits long short-term features to optimize phoneme recognition. RealPRNet offers substantial improvements in reducing phoneme error rate and increasing in visual performance.Next, we delve into the text-to-animation framework (T2A), a pivotal construct in our research. While extant auto cinematography paradigms largely hinge on rudimentary cinematographic principles (aesthetics), T2A offers a more nuanced approach. It amalgamates the input script's visual fidelity with the resultant video's aesthetic compliance, by concurrently harnessing both fidelity and aesthetic models. Our evaluative studies, conducted with animators, attest to the superior quality of the resulting animations vis-a-vis methodologies solely reliant on aesthetic models, while reducing the workload of manual animation production by approximately 74%.However, it is germane to note that Auto Cinematography, when solely premised on canonical rule-based optimization, often falls short of audience expectations. we introduce RT2A (Reinforcement learning-based Text to Animation), a pioneering architecture that synergistically merges reinforcement learning techniques into the realm of automated film direction. Within the RT2A framework, each choice concerning camera orientation and positioning is systematically documented and integrated into subsequent training cycles for the reinforcement learning agent. Utilizing a carefully constructed reward function, the algorithm is guided toward the optimization of camera configurations that emulate the stylistic decisions commonly employed by human directors. Quantitative analysis reveals that RT2A can achieve 50% improvement in audience-approved camera placements and an 80% increase in fidelity over benchmark camera placements.Furthermore, due to the recent trend of personalized animation content influenced by user-generated interactions, the unpredictability and complexity of open-world settings pose a substantial challenge for automated cinematography techniques. To tackle this, we extend our framework along with an adaptive automated cinematography approach based on Generative Adversarial Networks (AACOGAN). According to empirical analyses, AACOGAN significantly outperforms existing methods in capturing the dynamism of open-world interactions. The efficacy of AACOGAN is underscored by a 73% improvement in the correlation between user behaviors and camera trajectory adaptations, as well as a marked elevation-up to 32.9%-in the quality of multi-focus scenes. These metrics offer compelling evidence that our methodology not only refines cinematographic outputs but also considerably augments user immersion within these complex virtual environments.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2024
538 $a Mode of access: World Wide Web
650 4 $a Computer science. $3 573171
650 4 $a Electrical engineering. $3 596380
653 $a Automatic cinematography
653 $a Deep learning
653 $a Optimal animation production
655 7 $a Electronic books. $2 local $3 554714
690 $a 0984
690 $a 0544
690 $a 0800
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a Michigan State University. $b Electrical Engineering - Doctor of Philosophy. $3 1187603
773 0 $t Dissertations Abstracts International $g 85-04B.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=30689828 $z click for full text (PQDT)