國立虎尾科技大學 |

Understanding and Facilitating Human-AI Teaming for Real-World Computer Vision Tasks /

Record Type:	Language materials, printed : Monograph/item
Title/Author:	Understanding and Facilitating Human-AI Teaming for Real-World Computer Vision Tasks // Chengyuan Xu.
Author:	Xu, Chengyuan,
Description:	1 electronic resource (186 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 86-03, Section: B.
Contained By:	Dissertations Abstracts International86-03B.
Subject:	Computer science. -
Online resource:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31331366
ISBN:	9798384033479

Understanding and Facilitating Human-AI Teaming for Real-World Computer Vision Tasks /
Xu, Chengyuan,

Understanding and Facilitating Human-AI Teaming for Real-World Computer Vision Tasks /Chengyuan Xu. - 1 electronic resource (186 pages)

Source: Dissertations Abstracts International, Volume: 86-03, Section: B.

Recent machine learning research has demonstrated that many task-specific AI models now reach or surpass human performance on static benchmarks. However, in real-world applications where human users collaborate with, or rely on AIs, key questions remain: Do these advancements in AI models inherently improve the user experience or augment users' capabilities? When and how should we partner users with AI to form effective human-AI teams? This dissertation explores new forms of human-AI collaboration in the context of real-world computer vision tasks. We demonstrate different user roles in diverse AI-assisted workflows -- from passive recipients of AI model outputs to active participants who steer the shaping of the model. 1) We developed intuitive user interfaces to make deep learning accessible to end users, in this case astrophysicists, without requiring knowledge in machine learning. The end-to-end model enhances the accuracy of automated processing of daily space observations from 20+ telescopes globally. The streamlined interface injects confidence into researchers' AI-supported analysis of scientific imagery. 2) We proposed the concept of "restrained and zealous AIs" to harness the complementary strength in human-AI teams. Insights from a month-long user study involving 78 professional data annotators suggest that recommendations from ill-suited AI counterparts may detrimentally affect users' skills. 3) Finally, we brought a novel concept of "in-situ learning" to augmented reality, where the user interacts with physical objects to train spatially-aware AI models that can remember the personalized environment and objects for various tasks. Each project brings the end user to a more active and engaged role in the inference, training, and evaluation processes of human-in-the-loop machine learning. In summary, this dissertation provides insights into good practices for teaming humans with AI for real-world collaboration, informing the design of future AI-assisted systems.

English

ISBN: 9798384033479Subjects--Topical Terms:

573171
Computer science.
Subjects--Index Terms:

User experience

Understanding and Facilitating Human-AI Teaming for Real-World Computer Vision Tasks /
LDR:03458nam a22004093i 4500 001 1157822
005 20250603111421.5
006 m o d
007 cr|nu||||||||
008 250804s2024 miu||||||m |||||||eng d
020 $a 9798384033479
035 $a (MiAaPQD)AAI31331366
035 $a AAI31331366
040 $a MiAaPQD $b eng $c MiAaPQD $e rda
100 1 $a Xu, Chengyuan, $e author. $3 1484098
245 1 0 $a Understanding and Facilitating Human-AI Teaming for Real-World Computer Vision Tasks / $c Chengyuan Xu.
264 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2024
300 $a 1 electronic resource (186 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 86-03, Section: B.
500 $a Advisors: Hollerer, Tobias Committee members: Jacobs, Jennifer; McCully, Curtis; Peljhan, Marko.
502 $b Ph.D. $c University of California, Santa Barbara $d 2024.
520 $a Recent machine learning research has demonstrated that many task-specific AI models now reach or surpass human performance on static benchmarks. However, in real-world applications where human users collaborate with, or rely on AIs, key questions remain: Do these advancements in AI models inherently improve the user experience or augment users' capabilities? When and how should we partner users with AI to form effective human-AI teams? This dissertation explores new forms of human-AI collaboration in the context of real-world computer vision tasks. We demonstrate different user roles in diverse AI-assisted workflows -- from passive recipients of AI model outputs to active participants who steer the shaping of the model. 1) We developed intuitive user interfaces to make deep learning accessible to end users, in this case astrophysicists, without requiring knowledge in machine learning. The end-to-end model enhances the accuracy of automated processing of daily space observations from 20+ telescopes globally. The streamlined interface injects confidence into researchers' AI-supported analysis of scientific imagery. 2) We proposed the concept of "restrained and zealous AIs" to harness the complementary strength in human-AI teams. Insights from a month-long user study involving 78 professional data annotators suggest that recommendations from ill-suited AI counterparts may detrimentally affect users' skills. 3) Finally, we brought a novel concept of "in-situ learning" to augmented reality, where the user interacts with physical objects to train spatially-aware AI models that can remember the personalized environment and objects for various tasks. Each project brings the end user to a more active and engaged role in the inference, training, and evaluation processes of human-in-the-loop machine learning. In summary, this dissertation provides insights into good practices for teaming humans with AI for real-world collaboration, informing the design of future AI-assisted systems.
546 $a English
590 $a School code: 0035
650 4 $a Computer science. $3 573171
653 $a User experience
653 $a End users
653 $a Real-world collaboration
653 $a Human performance
690 $a 0984
690 $a 0800
710 2 $a University of California, Santa Barbara. $b Media Arts and Technology. $3 1148602
720 1 $a Hollerer, Tobias $e degree supervisor.
773 0 $t Dissertations Abstracts International $g 86-03B.
790 $a 0035
791 $a Ph.D.
792 $a 2024
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31331366