國立虎尾科技大學 |

Augmenting Interactive Information Seeking With System-Level Assistance.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	Augmenting Interactive Information Seeking With System-Level Assistance./
Author:	Burton, Ryan E.
Description:	1 online resource (192 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 85-12, Section: B.
Contained By:	Dissertations Abstracts International85-12B.
Subject:	Computer science. -
Online resource:	click for full text (PQDT)
ISBN:	9798382739502

Augmenting Interactive Information Seeking With System-Level Assistance.
Burton, Ryan E.

Augmenting Interactive Information Seeking With System-Level Assistance. - 1 online resource (192 pages)

Source: Dissertations Abstracts International, Volume: 85-12, Section: B.

Thesis (Ph.D.)--University of Michigan, 2024.

Includes bibliographical references

Within the past two decades there has been an increased amount of interest in human-centered information retrieval research beyond the traditional system-focused view embodied by Cranfield- and TREC-style evaluation. From blending search and recommender systems to work on search as learning, the limits of conventional search engines' focus on query relevance to deliver ten blue links at millisecond speeds has become evident as use cases become more varied. My work focuses on the types of scenarios that typical systems neglect in searching and browsing, particularly tasks involving multi-attribute queries and information seeking as learning, and explores ways to guide users towards optimal behavior through system design. Enabling this across the three studies comprising this dissertation is a sidebar affordance, serving as a means for enabling complementary information seeking interactions. The contributions of this work will have implications on the effective design and implementation of new types of user-centered interactive IR systems.We begin with an investigation of time-quality tradeoffs with slow search. Taking inspiration from movements such as slow food, slow travel, and slow technology, slow search serves as an acknowledgement of the fact that there are tasks for which users have indicated a willingness to wait for the perfect set of results. By implementing a user study where searchers were exposed to a system that embodied characteristics of slow search, where speed could be traded for an better results, we analyzed user behavior as they performed tasks which typically required multiple queries with a baseline Web search engine and saw how their effectiveness in using the system improved as they used this novel interface.Next, we performed a simulation study to explore the implications of changing attributes of our slow search system on the behavioral outcomes of synthetic users modelled based on human interaction log data. By incorporating the users' cost model, we were able to identify fruitful directions for further interactive search experiments. In this way, we showed the potential for guiding low-performing users towards higher performance.We finally focus on search as learning, using a large language model (LLM) as an enabler of slow search. Here, our study tests a contextual chatbot assistant that aids in users' reading and searching in a specialized domain - data science. The chatbot can provide responses to questions about documents and domain-specific vocabulary. Using mixed methods, we identify patterns of use and investigate learning and interaction behaviors. Results show learning gains reveals that trust is a prominent factor in users' perceptions of usefulness. We furthermore propose an extension to develop a retrieval framework that can be used to directly optimize the set of interactions that a user may take in order to extract the maximum utility of a document. Using vocabulary learning and searching-to-learn as a foundation, we propose both an algorithm and user study to evaluate effectiveness in jointly considering relevance and familiarity with technical terms to learn to ensure users get the most out of the documents they search for.The theme linking these studies together is a focus on improving user behavior to reduce effort or time-on-task, and increase value over time during interactive search. This dissertation serves as a basis for future system design and experiments that preserve interactivity, encourage effective mental models, and reduce user effort while increasing the value users receive during the search process.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2024

Mode of access: World Wide Web

ISBN: 9798382739502Subjects--Topical Terms:

573171
Computer science.
Subjects--Index Terms:

Slow searchIndex Terms--Genre/Form:

554714
Electronic books.

Augmenting Interactive Information Seeking With System-Level Assistance.
LDR:05042ntm a22004097 4500 001 1151771
005 20241118085757.5
006 m o d
007 cr mn ---uuuuu
008 250605s2024 xx obm 000 0 eng d
020 $a 9798382739502
035 $a (MiAaPQ)AAI31349003
035 $a (MiAaPQ)umichrackham005508
035 $a AAI31349003
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Burton, Ryan E. $3 1478597
245 1 0 $a Augmenting Interactive Information Seeking With System-Level Assistance.
264 0 $c 2024
300 $a 1 online resource (192 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 85-12, Section: B.
500 $a Advisor: Collins-Thompson, Kevyn.
502 $a Thesis (Ph.D.)--University of Michigan, 2024.
504 $a Includes bibliographical references
520 $a Within the past two decades there has been an increased amount of interest in human-centered information retrieval research beyond the traditional system-focused view embodied by Cranfield- and TREC-style evaluation. From blending search and recommender systems to work on search as learning, the limits of conventional search engines' focus on query relevance to deliver ten blue links at millisecond speeds has become evident as use cases become more varied. My work focuses on the types of scenarios that typical systems neglect in searching and browsing, particularly tasks involving multi-attribute queries and information seeking as learning, and explores ways to guide users towards optimal behavior through system design. Enabling this across the three studies comprising this dissertation is a sidebar affordance, serving as a means for enabling complementary information seeking interactions. The contributions of this work will have implications on the effective design and implementation of new types of user-centered interactive IR systems.We begin with an investigation of time-quality tradeoffs with slow search. Taking inspiration from movements such as slow food, slow travel, and slow technology, slow search serves as an acknowledgement of the fact that there are tasks for which users have indicated a willingness to wait for the perfect set of results. By implementing a user study where searchers were exposed to a system that embodied characteristics of slow search, where speed could be traded for an better results, we analyzed user behavior as they performed tasks which typically required multiple queries with a baseline Web search engine and saw how their effectiveness in using the system improved as they used this novel interface.Next, we performed a simulation study to explore the implications of changing attributes of our slow search system on the behavioral outcomes of synthetic users modelled based on human interaction log data. By incorporating the users' cost model, we were able to identify fruitful directions for further interactive search experiments. In this way, we showed the potential for guiding low-performing users towards higher performance.We finally focus on search as learning, using a large language model (LLM) as an enabler of slow search. Here, our study tests a contextual chatbot assistant that aids in users' reading and searching in a specialized domain - data science. The chatbot can provide responses to questions about documents and domain-specific vocabulary. Using mixed methods, we identify patterns of use and investigate learning and interaction behaviors. Results show learning gains reveals that trust is a prominent factor in users' perceptions of usefulness. We furthermore propose an extension to develop a retrieval framework that can be used to directly optimize the set of interactions that a user may take in order to extract the maximum utility of a document. Using vocabulary learning and searching-to-learn as a foundation, we propose both an algorithm and user study to evaluate effectiveness in jointly considering relevance and familiarity with technical terms to learn to ensure users get the most out of the documents they search for.The theme linking these studies together is a focus on improving user behavior to reduce effort or time-on-task, and increase value over time during interactive search. This dissertation serves as a basis for future system design and experiments that preserve interactivity, encourage effective mental models, and reduce user effort while increasing the value users receive during the search process.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2024
538 $a Mode of access: World Wide Web
650 4 $a Computer science. $3 573171
650 4 $a Information science. $3 561178
653 $a Slow search
653 $a Chatbots
653 $a Conversational assistants
653 $a Simulation
653 $a Information retrieval
655 7 $a Electronic books. $2 local $3 554714
690 $a 0723
690 $a 0984
690 $a 0800
710 2 $a University of Michigan. $b Information. $3 1179585
710 2 $a ProQuest Information and Learning Co. $3 1178819
773 0 $t Dissertations Abstracts International $g 85-12B.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31349003 $z click for full text (PQDT)