國立虎尾科技大學 |

Content-Aware AI-Driven Design Assistance Frameworks for Graphic Design Layouts.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	Content-Aware AI-Driven Design Assistance Frameworks for Graphic Design Layouts./
Author:	Banian, Sara.
Description:	1 online resource (223 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 83-07, Section: B.
Contained By:	Dissertations Abstracts International83-07B.
Subject:	Computer engineering. -
Online resource:	click for full text (PQDT)
ISBN:	9798762103787

Content-Aware AI-Driven Design Assistance Frameworks for Graphic Design Layouts.
Banian, Sara.

Content-Aware AI-Driven Design Assistance Frameworks for Graphic Design Layouts. - 1 online resource (223 pages)

Source: Dissertations Abstracts International, Volume: 83-07, Section: B.

Thesis (Ph.D.)--Northeastern University, 2021.

Includes bibliographical references

Designing user interfaces (UIs) for mobile interaction is widespread but still challenging. It is important for the overall user satisfaction and application success. During the design process, designers express their requirements through images describing the UI's layout, structure, and content. Designers, however, encounter key challenges throughout the design process. For example, searching for inspiring design examples is challenging because current search systems rely on only text-based queries and do not consider the UI structure and content. Furthermore, these systems often focus on overall page-level layout over individual UI components. Also, creating wireframe templates is difficult for many designers as it necessitates an understanding of different design guidelines. Therefore, it is critical to support designers by developing effective design tools to help them be more productive and creative.In this dissertation, I aim to explore how to develop design assistance methodologies to augment the process of UI layout design, with a particular focus on visual search and layout generation. Specifically, for this exploration, I seek to investigate the use of advanced deep learning models in the context of mobile UI layout design. Processing layouts differs from processing pixel-level images in that it necessitates processing both the semantic (e.g., labels) and spatial (e.g., coordinates) content of the layout to model the data properly. To achieve this, I explore the design problems from both the data and the model side. First, I present a large-scale UI dataset that accurately specifies the interface's view hierarchy (i.e., UI components and their location). Second, I contribute the VINS framework, which is composed of three systems LayVis, CompVis, and TransVis that addresses layout-based visual search, component-based visual search, and layout generation, respectively.First, I introduce LayVis, an object-detection layout-based retrieval model. It takes as input a UI image and retrieves visually similar design examples. Next, I introduce CompVis, a component-based visual search system to easily retrieve individual UI components via convolutional neural networks (CNNs). Specifically, for a given query, the system allows to retrieve (1) text label synonyms, (2) similar UI components, and (3) design examples containing such components. Finally, I present TransVis, a transformer-based generative framework that investigate how to generate UI layouts according to user specifications and following design practices. It specifically models UI layouts as an ordered sequence of elements based on spatial and semantic relationships for (1) generating complete UI layouts, (2) auto-completing existing UI layouts seamlessly, and (3) supporting many design elements per layout.Overall, the work presented in this dissertation contributes to augmenting the UI layout design. Through quantitative and qualitative evaluation of VINS, we conclude the following: (1) Advanced deep learning models can aid in the development of design assistance methodologies for layout design; and (2) Designers perceive the use of VINS inspiring and useful. Such insights, combined with the open-sourced large-scale dataset, can help the research community develop more effective AI-based data-driven design tools. This work presents future opportunities to investigate different deep learning models within the context of layout design and how designers interact with these AI-based models.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2024

Mode of access: World Wide Web

ISBN: 9798762103787Subjects--Topical Terms:

569006
Computer engineering.
Subjects--Index Terms:

Data-driven designIndex Terms--Genre/Form:

554714
Electronic books.

Content-Aware AI-Driven Design Assistance Frameworks for Graphic Design Layouts.
LDR:04865ntm a22003737 4500 001 1147822
005 20240916075408.5
006 m o d
007 cr bn ---uuuuu
008 250605s2021 xx obm 000 0 eng d
020 $a 9798762103787
035 $a (MiAaPQ)AAI28869363
035 $a AAI28869363
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Banian, Sara. $3 1473639
245 1 0 $a Content-Aware AI-Driven Design Assistance Frameworks for Graphic Design Layouts.
264 0 $c 2021
300 $a 1 online resource (223 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 83-07, Section: B.
500 $a Advisor: Harteveld, Casper;Seif El-Nasr, Magy.
502 $a Thesis (Ph.D.)--Northeastern University, 2021.
504 $a Includes bibliographical references
520 $a Designing user interfaces (UIs) for mobile interaction is widespread but still challenging. It is important for the overall user satisfaction and application success. During the design process, designers express their requirements through images describing the UI's layout, structure, and content. Designers, however, encounter key challenges throughout the design process. For example, searching for inspiring design examples is challenging because current search systems rely on only text-based queries and do not consider the UI structure and content. Furthermore, these systems often focus on overall page-level layout over individual UI components. Also, creating wireframe templates is difficult for many designers as it necessitates an understanding of different design guidelines. Therefore, it is critical to support designers by developing effective design tools to help them be more productive and creative.In this dissertation, I aim to explore how to develop design assistance methodologies to augment the process of UI layout design, with a particular focus on visual search and layout generation. Specifically, for this exploration, I seek to investigate the use of advanced deep learning models in the context of mobile UI layout design. Processing layouts differs from processing pixel-level images in that it necessitates processing both the semantic (e.g., labels) and spatial (e.g., coordinates) content of the layout to model the data properly. To achieve this, I explore the design problems from both the data and the model side. First, I present a large-scale UI dataset that accurately specifies the interface's view hierarchy (i.e., UI components and their location). Second, I contribute the VINS framework, which is composed of three systems LayVis, CompVis, and TransVis that addresses layout-based visual search, component-based visual search, and layout generation, respectively.First, I introduce LayVis, an object-detection layout-based retrieval model. It takes as input a UI image and retrieves visually similar design examples. Next, I introduce CompVis, a component-based visual search system to easily retrieve individual UI components via convolutional neural networks (CNNs). Specifically, for a given query, the system allows to retrieve (1) text label synonyms, (2) similar UI components, and (3) design examples containing such components. Finally, I present TransVis, a transformer-based generative framework that investigate how to generate UI layouts according to user specifications and following design practices. It specifically models UI layouts as an ordered sequence of elements based on spatial and semantic relationships for (1) generating complete UI layouts, (2) auto-completing existing UI layouts seamlessly, and (3) supporting many design elements per layout.Overall, the work presented in this dissertation contributes to augmenting the UI layout design. Through quantitative and qualitative evaluation of VINS, we conclude the following: (1) Advanced deep learning models can aid in the development of design assistance methodologies for layout design; and (2) Designers perceive the use of VINS inspiring and useful. Such insights, combined with the open-sourced large-scale dataset, can help the research community develop more effective AI-based data-driven design tools. This work presents future opportunities to investigate different deep learning models within the context of layout design and how designers interact with these AI-based models.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2024
538 $a Mode of access: World Wide Web
650 4 $a Computer engineering. $3 569006
650 4 $a Artificial intelligence. $3 559380
653 $a Data-driven design
653 $a Deep learning
653 $a Human computer interaction
653 $a User interface
655 7 $a Electronic books. $2 local $3 554714
690 $a 0464
690 $a 0800
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a Northeastern University. $b Electrical and Computer Engineering. $3 1182193
773 0 $t Dissertations Abstracts International $g 83-07B.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=28869363 $z click for full text (PQDT)