國立虎尾科技大學 |

Cross-domain Image Analysis Approaches Towards Segmentation of Placenta Photos and Pictorial Realism Study of Paintings.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	Cross-domain Image Analysis Approaches Towards Segmentation of Placenta Photos and Pictorial Realism Study of Paintings./
Author:	Zhang, Zhuomin.
Description:	1 online resource (143 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 85-05, Section: A.
Contained By:	Dissertations Abstracts International85-05A.
Subject:	Artists. -
Online resource:	click for full text (PQDT)
ISBN:	9798380729819

Cross-domain Image Analysis Approaches Towards Segmentation of Placenta Photos and Pictorial Realism Study of Paintings.
Zhang, Zhuomin.

Cross-domain Image Analysis Approaches Towards Segmentation of Placenta Photos and Pictorial Realism Study of Paintings. - 1 online resource (143 pages)

Source: Dissertations Abstracts International, Volume: 85-05, Section: A.

Thesis (Ph.D.)--The Pennsylvania State University, 2023.

Includes bibliographical references

The rapid development of imaging technologies has revolutionized image acquisition and led to an unprecedented explosion in the volume of visual data, which has become an integral part of our daily lives. Furthermore, in most real-world scenarios, data is often collected from different sources, referred to as different "domains," each with its own characteristics and properties. Recently, the utilization of advanced machine learning (ML) algorithms to analyze cross-domain images has gained significant attention in various research fields. Cross-domain image analysis aims to: (1) identify and characterize similarities and discrepancies among images belonging to different domains; and (2) transfer knowledge learned from one domain to another domain for further image analysis tasks, which can help to resolve the issues of limited labeled data and domain-specific variations. Over the past decades, researchers have developed various techniques and methods to attain the objectives of cross-domain image analysis, which include domain adaptation, transfer learning, and deep-learning-based methods. Motivated by the superiority of these devised analysis approaches, this dissertation aims to advance the state-of-the-art in cross-domain image analysis, contributing to the development of more effective and robust machine learning models that can benefit a wide range of research fields.In this dissertation, we present two research problems and corresponding solutions from the biomedical and art historical perspectives to demonstrate the capability of advanced machine learning algorithms and underlying challenges when dealing with cross-domain images analysis. The first part discusses the utilization of the idea of image translation to achieve placenta segmentation from photos collected from different sources. For each photo, four regions need to be segmented, placenta disc, umbilical cord, ruler, and background. Specifically, we propose a multi-region saliency-aware learning (MSL) method for cross-domain placenta image segmentation by enforcing semantic consistency. Firstly, an attention module is added to the adversarial image translation process to get the most discriminative regions (ruler and background). Subsequently, a novel attention-consistent loss serves as an extra constraint to enforce the preservation of the attention-related information during the translation. Notably, we also propose a new saliency-consistent loss as another supervision to guarantee salient regions are consistent before and after translation. Then, we will use a well-trained convolutional neural network (CNN) model from the annotation-sufficient domain to achieve the segmentation task in another domain following image translation. The experimental results demonstrate the superiority of the proposed MSL model to solve the cross-domain segmentation problem for placenta photos. Furthermore, after the segmentation, an automatic pipeline is developed to extract specific visual characteristics from placenta photos for pathological diagnosis.Another topic is for studying the European art style known as realism. The specific case study we report here is the work of John Constable (1776-1837) who achieved a remarkable degree of naturalism in his sky painting. Specifically, we propose a new ML based paradigm for studying pictorial realism in a more objective way. Our framework assesses realism by measuring the similarity between two domains: clouds painted by artists known for their depictions of skies, like Constable, and photographs of clouds. The similarity is computed from two aspects, the accuracy of cloud classification and the discrepancy of painting styles. Our basic assumption is that if the paintings imitate observed reality well, painted clouds can be accurately classified by the classifier trained with cloud photos because they follow the similar feature representation documented in the photographs. The experimental results of cloud classification show that Constable more consistently approximates the formal features of actual clouds in his paintings than his contemporaries. We also put forward new evaluation metrics based on disentangled style features to carefully analyze the style discrepancy between paintings and photographs of clouds as well as between Constable and his contemporaries. We find that the painting style of Lionel Constable is most similar to the style of his father, John Constable, thereby verifying the opinions of art historians that he emulated his father's painting for practice. The study, as a novel interdisciplinary approach that combines machine learning, meteorology, and art history, is a springboard for broader and deeper analyses of pictorial realism.In addition, instead of only focusing on cross-domain artwork analysis, we discuss the potential biases that may appear in the general ML-based artwork analysis process as a supplement. Although recent research studies have substantially shown the effectiveness and applicability of machine learning for art understanding and creation, it has been argued that understanding or creating art is a human-defined procedure, which not only depends on stereotyped cognition or changeless laws, but also mixes with individual biases. Therefore, the procedure of analyzing artworks by virtue of intelligent machines can also be biased. Different kinds of biases such as labeling bias, design bias, and confounding bias can exist at any stage in the procedure of ML-based artwork analysis, unprofessional data curation, incomplete problem formulation, unreasonable algorithm design, subjective evaluation methods, etc. Since ignoring these biases could have negative impact on the precision and reliability of the experimental results, we are thus motivated to investigate these biases from both machine learning and art history perspectives and provide insights on how to systematically address them.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2024

Mode of access: World Wide Web

ISBN: 9798380729819Subjects--Topical Terms:

660603
Artists.
Subjects--Index Terms:

Visual dataIndex Terms--Genre/Form:

554714
Electronic books.

Cross-domain Image Analysis Approaches Towards Segmentation of Placenta Photos and Pictorial Realism Study of Paintings.
LDR:07441ntm a22004097 4500 001 1147003
005 20240819061927.5
006 m o d
007 cr bn ---uuuuu
008 250605s2023 xx obm 000 0 eng d
020 $a 9798380729819
035 $a (MiAaPQ)AAI30720669
035 $a (MiAaPQ)PennState_30373zxz78
035 $a AAI30720669
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Zhang, Zhuomin. $3 1472590
245 1 0 $a Cross-domain Image Analysis Approaches Towards Segmentation of Placenta Photos and Pictorial Realism Study of Paintings.
264 0 $c 2023
300 $a 1 online resource (143 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 85-05, Section: A.
500 $a Advisor: Wang, James Z.;Li, Jia.
502 $a Thesis (Ph.D.)--The Pennsylvania State University, 2023.
504 $a Includes bibliographical references
520 $a The rapid development of imaging technologies has revolutionized image acquisition and led to an unprecedented explosion in the volume of visual data, which has become an integral part of our daily lives. Furthermore, in most real-world scenarios, data is often collected from different sources, referred to as different "domains," each with its own characteristics and properties. Recently, the utilization of advanced machine learning (ML) algorithms to analyze cross-domain images has gained significant attention in various research fields. Cross-domain image analysis aims to: (1) identify and characterize similarities and discrepancies among images belonging to different domains; and (2) transfer knowledge learned from one domain to another domain for further image analysis tasks, which can help to resolve the issues of limited labeled data and domain-specific variations. Over the past decades, researchers have developed various techniques and methods to attain the objectives of cross-domain image analysis, which include domain adaptation, transfer learning, and deep-learning-based methods. Motivated by the superiority of these devised analysis approaches, this dissertation aims to advance the state-of-the-art in cross-domain image analysis, contributing to the development of more effective and robust machine learning models that can benefit a wide range of research fields.In this dissertation, we present two research problems and corresponding solutions from the biomedical and art historical perspectives to demonstrate the capability of advanced machine learning algorithms and underlying challenges when dealing with cross-domain images analysis. The first part discusses the utilization of the idea of image translation to achieve placenta segmentation from photos collected from different sources. For each photo, four regions need to be segmented, placenta disc, umbilical cord, ruler, and background. Specifically, we propose a multi-region saliency-aware learning (MSL) method for cross-domain placenta image segmentation by enforcing semantic consistency. Firstly, an attention module is added to the adversarial image translation process to get the most discriminative regions (ruler and background). Subsequently, a novel attention-consistent loss serves as an extra constraint to enforce the preservation of the attention-related information during the translation. Notably, we also propose a new saliency-consistent loss as another supervision to guarantee salient regions are consistent before and after translation. Then, we will use a well-trained convolutional neural network (CNN) model from the annotation-sufficient domain to achieve the segmentation task in another domain following image translation. The experimental results demonstrate the superiority of the proposed MSL model to solve the cross-domain segmentation problem for placenta photos. Furthermore, after the segmentation, an automatic pipeline is developed to extract specific visual characteristics from placenta photos for pathological diagnosis.Another topic is for studying the European art style known as realism. The specific case study we report here is the work of John Constable (1776-1837) who achieved a remarkable degree of naturalism in his sky painting. Specifically, we propose a new ML based paradigm for studying pictorial realism in a more objective way. Our framework assesses realism by measuring the similarity between two domains: clouds painted by artists known for their depictions of skies, like Constable, and photographs of clouds. The similarity is computed from two aspects, the accuracy of cloud classification and the discrepancy of painting styles. Our basic assumption is that if the paintings imitate observed reality well, painted clouds can be accurately classified by the classifier trained with cloud photos because they follow the similar feature representation documented in the photographs. The experimental results of cloud classification show that Constable more consistently approximates the formal features of actual clouds in his paintings than his contemporaries. We also put forward new evaluation metrics based on disentangled style features to carefully analyze the style discrepancy between paintings and photographs of clouds as well as between Constable and his contemporaries. We find that the painting style of Lionel Constable is most similar to the style of his father, John Constable, thereby verifying the opinions of art historians that he emulated his father's painting for practice. The study, as a novel interdisciplinary approach that combines machine learning, meteorology, and art history, is a springboard for broader and deeper analyses of pictorial realism.In addition, instead of only focusing on cross-domain artwork analysis, we discuss the potential biases that may appear in the general ML-based artwork analysis process as a supplement. Although recent research studies have substantially shown the effectiveness and applicability of machine learning for art understanding and creation, it has been argued that understanding or creating art is a human-defined procedure, which not only depends on stereotyped cognition or changeless laws, but also mixes with individual biases. Therefore, the procedure of analyzing artworks by virtue of intelligent machines can also be biased. Different kinds of biases such as labeling bias, design bias, and confounding bias can exist at any stage in the procedure of ML-based artwork analysis, unprofessional data curation, incomplete problem formulation, unreasonable algorithm design, subjective evaluation methods, etc. Since ignoring these biases could have negative impact on the precision and reliability of the experimental results, we are thus motivated to investigate these biases from both machine learning and art history perspectives and provide insights on how to systematically address them.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2024
538 $a Mode of access: World Wide Web
650 4 $a Artists. $3 660603
650 4 $a Photographs. $3 658117
650 4 $a Feces. $3 1465177
650 4 $a Maps. $3 889832
650 4 $a Painters. $3 1472591
650 4 $a Landscape art. $3 1472592
650 4 $a Realism. $3 567326
650 4 $a Painting. $3 1131865
650 4 $a Art history. $3 1180038
650 4 $a Art criticism. $3 576960
650 4 $a Fine arts. $3 1112523
653 $a Visual data
653 $a Cross-domain image analysis
653 $a Image acquisition
653 $a Multi-region saliency-aware learning
653 $a Placenta segmentation
655 7 $a Electronic books. $2 local $3 554714
690 $a 0357
690 $a 0365
690 $a 0377
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a The Pennsylvania State University. $3 845556
773 0 $t Dissertations Abstracts International $g 85-05A.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=30720669 $z click for full text (PQDT)