國立虎尾科技大學 |

Virtual Cleaning of Works of Art Using Deep Learning Based Approaches.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	Virtual Cleaning of Works of Art Using Deep Learning Based Approaches./
Author:	Maali Amiri, Morteza.
Description:	1 online resource (112 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 84-07, Section: A.
Contained By:	Dissertations Abstracts International84-07A.
Subject:	Physics. -
Online resource:	click for full text (PQDT)
ISBN:	9798363517198

Virtual Cleaning of Works of Art Using Deep Learning Based Approaches.
Maali Amiri, Morteza.

Virtual Cleaning of Works of Art Using Deep Learning Based Approaches. - 1 online resource (112 pages)

Source: Dissertations Abstracts International, Volume: 84-07, Section: A.

Thesis (Ph.D.)--Rochester Institute of Technology, 2022.

Includes bibliographical references

Virtual cleaning of art is a key process that conservators apply to see the likely appearance of the work of art they have aimed to clean, before the process of cleaning. There have been many different approaches to virtually clean artworks but having to physically clean the artwork at a few specific places of specific colors, the need to have pure black and white paint on the painting and their low accuracy are only a few of their shortcomings prompting us to propose deep learning based approaches in this research. First we report the work we have done in this field focusing on the color estimation of the artwork virtual cleaning and then we describe our methods for the spectral reflectance estimation of artwork in virtual cleaning. In the color estimation part, a deep convolutional neural network (CNN) and a deep generative network (DGN) are suggested, which estimate the RGB image of the cleaned artwork from an RGB image of the uncleaned artwork. Applying the networks to the images of the well-known artworks (such as the Mona Lisa and The Virgin and Child with Saint Anne) and Macbeth ColorChecker and comparing the results to the only physics-based model (which is the first model that has approached the issue of virtual cleaning from the physics-point of view, hence our reference to compare our models with) shows that our methods outperform that model and have great potentials of being applied to the real situations in which there might not be much information available on the painting, and all we have is an RGB image of the uncleaned artwork. Nonetheless, the methods proposed in the first part, cannot provide us with the spectral reflectance information of the artwork, therefore, the second part of the dissertation is proposed. This part focuses on the spectral estimation of the artwork virtual cleaning. Two deep learning-based approaches are also proposed here; the first one is deep generative network. This method receives a cube of the hyperspectral image of the uncleaned artwork and tries to output another cube which is the virtually cleaned hyperspectral image of the artwork. The second approach is 1D Convolutional Autoencoder (1DCA), which is based on 1D convolutional neural network and tries to find the spectra of the virtually cleaned artwork using the spectra of the physically cleaned artworks and their corresponding uncleaned spectra. The approaches are applied to hyperspectral images of Macbeth ColorChecker (simulated in the forms of cleaned and uncleaned hyperspectral images) and the 'Haymakers' (real hyperspectral images of both cleaned and uncleaned states). The results, in terms of Euclidean distance and spectral angle between the virtually cleaned artwork and the physically cleaned one, show that the proposed approaches have outperformed the physics-based model, with DGN outperforming the 1DCA. Methods proposed herein do not rely on finding a specific type of paint and color on the painting first and take advantage of the high accuracy offered by deep learning-based approaches and they are also applicable to other paintings.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2024

Mode of access: World Wide Web

ISBN: 9798363517198Subjects--Topical Terms:

564049
Physics.
Subjects--Index Terms:

1 dimensional convolutional autoencoderIndex Terms--Genre/Form:

554714
Electronic books.

Virtual Cleaning of Works of Art Using Deep Learning Based Approaches.
LDR:04522ntm a22003977 4500 001 1144136
005 20240603070937.5
006 m o d
007 cr mn ---uuuuu
008 250605s2022 xx obm 000 0 eng d
020 $a 9798363517198
035 $a (MiAaPQ)AAI30243478
035 $a AAI30243478
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Maali Amiri, Morteza. $3 1469065
245 1 0 $a Virtual Cleaning of Works of Art Using Deep Learning Based Approaches.
264 0 $c 2022
300 $a 1 online resource (112 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 84-07, Section: A.
500 $a Advisor: Messinger, David.
502 $a Thesis (Ph.D.)--Rochester Institute of Technology, 2022.
504 $a Includes bibliographical references
520 $a Virtual cleaning of art is a key process that conservators apply to see the likely appearance of the work of art they have aimed to clean, before the process of cleaning. There have been many different approaches to virtually clean artworks but having to physically clean the artwork at a few specific places of specific colors, the need to have pure black and white paint on the painting and their low accuracy are only a few of their shortcomings prompting us to propose deep learning based approaches in this research. First we report the work we have done in this field focusing on the color estimation of the artwork virtual cleaning and then we describe our methods for the spectral reflectance estimation of artwork in virtual cleaning. In the color estimation part, a deep convolutional neural network (CNN) and a deep generative network (DGN) are suggested, which estimate the RGB image of the cleaned artwork from an RGB image of the uncleaned artwork. Applying the networks to the images of the well-known artworks (such as the Mona Lisa and The Virgin and Child with Saint Anne) and Macbeth ColorChecker and comparing the results to the only physics-based model (which is the first model that has approached the issue of virtual cleaning from the physics-point of view, hence our reference to compare our models with) shows that our methods outperform that model and have great potentials of being applied to the real situations in which there might not be much information available on the painting, and all we have is an RGB image of the uncleaned artwork. Nonetheless, the methods proposed in the first part, cannot provide us with the spectral reflectance information of the artwork, therefore, the second part of the dissertation is proposed. This part focuses on the spectral estimation of the artwork virtual cleaning. Two deep learning-based approaches are also proposed here; the first one is deep generative network. This method receives a cube of the hyperspectral image of the uncleaned artwork and tries to output another cube which is the virtually cleaned hyperspectral image of the artwork. The second approach is 1D Convolutional Autoencoder (1DCA), which is based on 1D convolutional neural network and tries to find the spectra of the virtually cleaned artwork using the spectra of the physically cleaned artworks and their corresponding uncleaned spectra. The approaches are applied to hyperspectral images of Macbeth ColorChecker (simulated in the forms of cleaned and uncleaned hyperspectral images) and the 'Haymakers' (real hyperspectral images of both cleaned and uncleaned states). The results, in terms of Euclidean distance and spectral angle between the virtually cleaned artwork and the physically cleaned one, show that the proposed approaches have outperformed the physics-based model, with DGN outperforming the 1DCA. Methods proposed herein do not rely on finding a specific type of paint and color on the painting first and take advantage of the high accuracy offered by deep learning-based approaches and they are also applicable to other paintings.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2024
538 $a Mode of access: World Wide Web
650 4 $a Physics. $3 564049
650 4 $a Fine arts. $3 1112523
653 $a 1 dimensional convolutional autoencoder
653 $a Deep convolutional neural network
653 $a Deep generative network
653 $a Deep learning
653 $a Virtual cleaning
655 7 $a Electronic books. $2 local $3 554714
690 $a 0605
690 $a 0800
690 $a 0357
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a Rochester Institute of Technology. $b Imaging Science. $3 1187019
773 0 $t Dissertations Abstracts International $g 84-07A.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=30243478 $z click for full text (PQDT)