國立虎尾科技大學 |

Enhancing Accessible Communication : = Assistive AR System in Bridging the Deaf and Hearing Divide.

紀錄類型:	書目-語言資料,手稿 : Monograph/item
正題名/作者:	Enhancing Accessible Communication :/
其他題名:	Assistive AR System in Bridging the Deaf and Hearing Divide.
作者:	Guo, Yunqi.
面頁冊數:	1 online resource (155 pages)
附註:	Source: Dissertations Abstracts International, Volume: 85-03, Section: A.
Contained By:	Dissertations Abstracts International85-03A.
標題:	Computer science. -
電子資源:	click for full text (PQDT)
ISBN:	9798380361033

Enhancing Accessible Communication : = Assistive AR System in Bridging the Deaf and Hearing Divide.
Guo, Yunqi.

Enhancing Accessible Communication :Assistive AR System in Bridging the Deaf and Hearing Divide. - 1 online resource (155 pages)

Source: Dissertations Abstracts International, Volume: 85-03, Section: A.

Thesis (Ph.D.)--University of California, Los Angeles, 2023.

Includes bibliographical references

Communication barriers between deaf and hearing individuals have led to difficulties in various real-world scenarios, including emergencies, online meetings, and daily interactions. Mobile and Augmented Reality (AR) systems hold promises for offering low-cost solutions for accessible communication. This dissertation aims to bridge the gap between sign language and other oral language users by leveraging assistive Augmented Reality (AR) glasses for everyday wear. We seek to address the full spectrum issues of sign capture, recognition, and language translation on AR glasses and mobile devices.Our approach first prioritizes the most urgent setting, emergency communication, before extending to more general settings such as daily, online, and learning interactions. We employ domain-specific models derived from sign language with three main components: 1) Capturing sign gestures on a mobile-glass setup using sign parameters; 2) Recognizing signs with lightweight models based on sign parameter correlations and constraints; and 3) Providing general bidirectional ASL-English translation using ASL grammar and word order correlation.In collaboration with ASL users, our evaluation results demonstrate that, starting from emergency communication scenarios, our domain-oriented models substantially reduce latency by one to two orders of magnitude compared to previous solutions, while maintaining accurate translations. Furthermore, the developed mobile and AR platforms enable sign language interactions across various settings, such as daily in-person communication, virtual communication, and sign language learning, thereby extending the system's applicability. Our research offers an innovative approach to promote accessible communication, fostering social inclusion, and minimizing communication-related inequalities between deaf and hearing individuals.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2024

Mode of access: World Wide Web

ISBN: 9798380361033Subjects--Topical Terms:

573171
Computer science.
Subjects--Index Terms:

Deaf studyIndex Terms--Genre/Form:

554714
Electronic books.

Enhancing Accessible Communication : = Assistive AR System in Bridging the Deaf and Hearing Divide.
LDR:03236ntm a22003857 4500 001 1146407
005 20240812064608.5
006 m o d
007 cr bn ---uuuuu
008 250605s2023 xx obm 000 0 eng d
020 $a 9798380361033
035 $a (MiAaPQ)AAI30686835
035 $a AAI30686835
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Guo, Yunqi. $3 1471794
245 1 0 $a Enhancing Accessible Communication : $b Assistive AR System in Bridging the Deaf and Hearing Divide.
264 0 $c 2023
300 $a 1 online resource (155 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 85-03, Section: A.
500 $a Advisor: Lu, Songwu.
502 $a Thesis (Ph.D.)--University of California, Los Angeles, 2023.
504 $a Includes bibliographical references
520 $a Communication barriers between deaf and hearing individuals have led to difficulties in various real-world scenarios, including emergencies, online meetings, and daily interactions. Mobile and Augmented Reality (AR) systems hold promises for offering low-cost solutions for accessible communication. This dissertation aims to bridge the gap between sign language and other oral language users by leveraging assistive Augmented Reality (AR) glasses for everyday wear. We seek to address the full spectrum issues of sign capture, recognition, and language translation on AR glasses and mobile devices.Our approach first prioritizes the most urgent setting, emergency communication, before extending to more general settings such as daily, online, and learning interactions. We employ domain-specific models derived from sign language with three main components: 1) Capturing sign gestures on a mobile-glass setup using sign parameters; 2) Recognizing signs with lightweight models based on sign parameter correlations and constraints; and 3) Providing general bidirectional ASL-English translation using ASL grammar and word order correlation.In collaboration with ASL users, our evaluation results demonstrate that, starting from emergency communication scenarios, our domain-oriented models substantially reduce latency by one to two orders of magnitude compared to previous solutions, while maintaining accurate translations. Furthermore, the developed mobile and AR platforms enable sign language interactions across various settings, such as daily in-person communication, virtual communication, and sign language learning, thereby extending the system's applicability. Our research offers an innovative approach to promote accessible communication, fostering social inclusion, and minimizing communication-related inequalities between deaf and hearing individuals.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2024
538 $a Mode of access: World Wide Web
650 4 $a Computer science. $3 573171
650 4 $a Audiology. $3 889171
650 4 $a Communication. $3 556422
653 $a Deaf study
653 $a Emergency call service
653 $a Mobile system
653 $a Sign language
655 7 $a Electronic books. $2 local $3 554714
690 $a 0984
690 $a 0300
690 $a 0459
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a University of California, Los Angeles. $b Computer Science 0201. $3 1182286
773 0 $t Dissertations Abstracts International $g 85-03A.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=30686835 $z click for full text (PQDT)