國立虎尾科技大學 |

An Approach of Lip Synchronization in ECA for E-Learning.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	An Approach of Lip Synchronization in ECA for E-Learning./
Author:	Singh, Rajveer.
Description:	1 online resource (114 pages)
Notes:	Source: Masters Abstracts International, Volume: 85-12.
Contained By:	Masters Abstracts International85-12.
Subject:	Computer science. -
Online resource:	click for full text (PQDT)
ISBN:	9798382903620

An Approach of Lip Synchronization in ECA for E-Learning.
Singh, Rajveer.

An Approach of Lip Synchronization in ECA for E-Learning. - 1 online resource (114 pages)

Source: Masters Abstracts International, Volume: 85-12.

Thesis (M.Sc.)--University of Windsor (Canada), 2024.

Includes bibliographical references

Embodied Conversational Agents (ECAs) are becoming more and more incorporated into diverse sectors such as customer service, healthcare, education, and entertainment. They are utilised to improve user experiences and make interactions more efficient. Lip synchronization and human-like expressions play a crucial role in enhancing user trust, satisfaction, and overall anthropomorphism of ECAs. By ensuring that the lips of an ECA correspond with its spoken words, lip synchronisation improves the naturalness and perceived realism of interactions. Through expression manipulation, ECAs may use their facial expressions to communicate intents and feelings, leading to more empathic and engaging conversations. When combined, these characteristics improve user engagement, understanding, and rapport in human-computer interactions by making ECAs more believable and successful overall. Their smooth integration improves the ECA's capacity to forge deep relationships and accomplish its communication objectives.This study presents a novel approach to achieve accurate lip synchronisation and facial expression manipulation utilising machine learning and 3D animation. The algorithm uses a pre-trained multilingual machine learning model for real-time phoneme representations for text-to-speech generation and lip synchronization. 3D object files are used for illustrating phonemes derived from the machine learning model. These files are utilised to interpolate between different lip forms and to monitor and map the motions of the lips. This process ensures precise synchronisation of the avatar's lip movements with the produced speech. Additionally, the algorithm incorporates ECA's facial expression manipulation enabling the ECA to express happiness, surprise, concern, etc. increasing audience engagement. Through the integration of the newly developed algorithm with the overall e-tutoring system architecture, this research contributes to the advancement of interactive online learning experiences.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2024

Mode of access: World Wide Web

ISBN: 9798382903620Subjects--Topical Terms:

573171
Computer science.
Subjects--Index Terms:

Lip synchronizationIndex Terms--Genre/Form:

554714
Electronic books.

An Approach of Lip Synchronization in ECA for E-Learning.
LDR:03340ntm a22003977 4500 001 1150215
005 20241022111616.5
006 m o d
007 cr bn ---uuuuu
008 250605s2024 xx obm 000 0 eng d
020 $a 9798382903620
035 $a (MiAaPQ)AAI31331172
035 $a AAI31331172
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Singh, Rajveer. $3 1476657
245 1 3 $a An Approach of Lip Synchronization in ECA for E-Learning.
264 0 $c 2024
300 $a 1 online resource (114 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Masters Abstracts International, Volume: 85-12.
500 $a Advisor: Yuan, X.
502 $a Thesis (M.Sc.)--University of Windsor (Canada), 2024.
504 $a Includes bibliographical references
520 $a Embodied Conversational Agents (ECAs) are becoming more and more incorporated into diverse sectors such as customer service, healthcare, education, and entertainment. They are utilised to improve user experiences and make interactions more efficient. Lip synchronization and human-like expressions play a crucial role in enhancing user trust, satisfaction, and overall anthropomorphism of ECAs. By ensuring that the lips of an ECA correspond with its spoken words, lip synchronisation improves the naturalness and perceived realism of interactions. Through expression manipulation, ECAs may use their facial expressions to communicate intents and feelings, leading to more empathic and engaging conversations. When combined, these characteristics improve user engagement, understanding, and rapport in human-computer interactions by making ECAs more believable and successful overall. Their smooth integration improves the ECA's capacity to forge deep relationships and accomplish its communication objectives.This study presents a novel approach to achieve accurate lip synchronisation and facial expression manipulation utilising machine learning and 3D animation. The algorithm uses a pre-trained multilingual machine learning model for real-time phoneme representations for text-to-speech generation and lip synchronization. 3D object files are used for illustrating phonemes derived from the machine learning model. These files are utilised to interpolate between different lip forms and to monitor and map the motions of the lips. This process ensures precise synchronisation of the avatar's lip movements with the produced speech. Additionally, the algorithm incorporates ECA's facial expression manipulation enabling the ECA to express happiness, surprise, concern, etc. increasing audience engagement. Through the integration of the newly developed algorithm with the overall e-tutoring system architecture, this research contributes to the advancement of interactive online learning experiences.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2024
538 $a Mode of access: World Wide Web
650 4 $a Computer science. $3 573171
650 4 $a Educational technology. $3 556755
653 $a Lip synchronization
653 $a Embodied Conversational Agents
653 $a Machine learning
653 $a E-learning
653 $a Animation
655 7 $a Electronic books. $2 local $3 554714
690 $a 0984
690 $a 0800
690 $a 0710
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a University of Windsor (Canada). $b COMPUTER SCIENCE. $3 1182526
773 0 $t Masters Abstracts International $g 85-12.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31331172 $z click for full text (PQDT)