國立虎尾科技大學 |

Empirical Investigations and Dataset Collection for American Sign Language-Aware Personal Assistants.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	Empirical Investigations and Dataset Collection for American Sign Language-Aware Personal Assistants./
Author:	Glasser, Abraham Trout.
Description:	1 online resource (336 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 84-10, Section: B.
Contained By:	Dissertations Abstracts International84-10B.
Subject:	Information science. -
Online resource:	click for full text (PQDT)
ISBN:	9798377650614

Empirical Investigations and Dataset Collection for American Sign Language-Aware Personal Assistants.
Glasser, Abraham Trout.

Empirical Investigations and Dataset Collection for American Sign Language-Aware Personal Assistants. - 1 online resource (336 pages)

Source: Dissertations Abstracts International, Volume: 84-10, Section: B.

Thesis (Ph.D.)--Rochester Institute of Technology, 2023.

Includes bibliographical references

Proliferation of voice-controlled personal-assistant devices poses accessibility barriers for Deaf and Hard of Hearing (DHH) users. It is estimated that 128 million people use a voice assistant in the United States, and 4.2 billion digital voice assistants being used around the world, e.g. through over 60,000 different smart home devices that support Amazon's Alexa, which is one instance of virtual assistants [97,134]. The ongoing (at the time of this dissertation) coronavirus pandemic has accelerated the uptake of home-based, voice-controlled devices. As artificial intelligence researchers and developers are working on American Sign Language (ASL) recognition technologies, Human-Computer Interaction (HCI) research is needed to understand what Deaf and Hard of Hearing (DHH) users may want from this technology and how to best design the interaction.This dissertation's contributions are split into four parts:1. Part I: DHH InterestThis part addresses the gap in knowledge about DHH users' experience with personal assistant devices, shedding light on DHH users' prior experience with this technology and their interest in devices that could understand sign-language commands. This insight supports ongoing technological advancement in sign-language recognition technologies.2. Part II: Dataset CollectionWith the context that there is a ASL data bottleneck for these technologies, this part investigates remote ASL data collection at scale, creating an online sign language data collection platform and testing its viability. Extending upon this, a continuous signing data collection platform was made and is tested. This part also employs a remote data collection protocol using a Wizard-of-Oz prototype personal assistant device, to allow DHH users to spontaneously interact with such a device in sign language. The data collected from this is described, and an in-person Wizard-of-Oz experiment is conducted to investigate aspects that were not possible through the remote protocol.3. Part III: DHH BehaviorFrom the remote Wizard-of-Oz methodology in Part II, this part presents analysis of this data and addresses the gap of knowledge when it comes to ASL interaction with personal assistant devices. This part also describes analysis of the in-person Wizard-of-Oz experiment mentioned in Part II, showing what we have learned about the linguistic properties of in-person interaction.4. Part IV: Privacy ConcernsThis last part touches on a theme that occured during parts I-III; privacy concerns. This part utilizes state-of-the-art image processing technology and guides the development of ASL-optimized face technology to protect anonymity of DHH users' to their satisfaction. Lastly, a small interview study was appended to the in-person Wizard-of-Oz experiment to further confirm whether DHH users would be more comfortable in using a personal assistant device if face-disguise technology was embedded.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2024

Mode of access: World Wide Web

ISBN: 9798377650614Subjects--Topical Terms:

561178
Information science.
Subjects--Index Terms:

DHH usersIndex Terms--Genre/Form:

554714
Electronic books.

Empirical Investigations and Dataset Collection for American Sign Language-Aware Personal Assistants.
LDR:04474ntm a2200445K 4500 001 1141230
005 20240311061547.5
006 m o d
007 cr mn ---uuuuu
008 250605s2023 xx obm 000 0 eng d
020 $a 9798377650614
035 $a (MiAaPQ)AAI30312099
035 $a AAI30312099
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Glasser, Abraham Trout. $3 1464900
245 1 0 $a Empirical Investigations and Dataset Collection for American Sign Language-Aware Personal Assistants.
264 0 $c 2023
300 $a 1 online resource (336 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 84-10, Section: B.
500 $a Advisor: Huenerfauth, Matt.
502 $a Thesis (Ph.D.)--Rochester Institute of Technology, 2023.
504 $a Includes bibliographical references
520 $a Proliferation of voice-controlled personal-assistant devices poses accessibility barriers for Deaf and Hard of Hearing (DHH) users. It is estimated that 128 million people use a voice assistant in the United States, and 4.2 billion digital voice assistants being used around the world, e.g. through over 60,000 different smart home devices that support Amazon's Alexa, which is one instance of virtual assistants [97,134]. The ongoing (at the time of this dissertation) coronavirus pandemic has accelerated the uptake of home-based, voice-controlled devices. As artificial intelligence researchers and developers are working on American Sign Language (ASL) recognition technologies, Human-Computer Interaction (HCI) research is needed to understand what Deaf and Hard of Hearing (DHH) users may want from this technology and how to best design the interaction.This dissertation's contributions are split into four parts:1. Part I: DHH InterestThis part addresses the gap in knowledge about DHH users' experience with personal assistant devices, shedding light on DHH users' prior experience with this technology and their interest in devices that could understand sign-language commands. This insight supports ongoing technological advancement in sign-language recognition technologies.2. Part II: Dataset CollectionWith the context that there is a ASL data bottleneck for these technologies, this part investigates remote ASL data collection at scale, creating an online sign language data collection platform and testing its viability. Extending upon this, a continuous signing data collection platform was made and is tested. This part also employs a remote data collection protocol using a Wizard-of-Oz prototype personal assistant device, to allow DHH users to spontaneously interact with such a device in sign language. The data collected from this is described, and an in-person Wizard-of-Oz experiment is conducted to investigate aspects that were not possible through the remote protocol.3. Part III: DHH BehaviorFrom the remote Wizard-of-Oz methodology in Part II, this part presents analysis of this data and addresses the gap of knowledge when it comes to ASL interaction with personal assistant devices. This part also describes analysis of the in-person Wizard-of-Oz experiment mentioned in Part II, showing what we have learned about the linguistic properties of in-person interaction.4. Part IV: Privacy ConcernsThis last part touches on a theme that occured during parts I-III; privacy concerns. This part utilizes state-of-the-art image processing technology and guides the development of ASL-optimized face technology to protect anonymity of DHH users' to their satisfaction. Lastly, a small interview study was appended to the in-person Wizard-of-Oz experiment to further confirm whether DHH users would be more comfortable in using a personal assistant device if face-disguise technology was embedded.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2024
538 $a Mode of access: World Wide Web
650 4 $a Information science. $3 561178
650 4 $a Biomedical engineering. $3 588770
650 4 $a Communication. $3 556422
653 $a DHH users
653 $a Deaf
653 $a Personal assistants
653 $a American sign language
653 $a Voice-controlled devices
653 $a Sign-language commands
653 $a Wizard-of-oz experiment
653 $a Face-disguise technology
655 7 $a Electronic books. $2 local $3 554714
690 $a 0723
690 $a 0541
690 $a 0800
690 $a 0459
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a Rochester Institute of Technology. $b Computing and Information Sciences. $3 1188646
773 0 $t Dissertations Abstracts International $g 84-10B.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=30312099 $z click for full text (PQDT)