國立虎尾科技大學 |

Paying Attention to Music : = Applying Attention Mechanisms to Automatic Music Transcription.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	Paying Attention to Music :/
Reminder of title:	Applying Attention Mechanisms to Automatic Music Transcription.
Author:	Wise, Andrew J.
Description:	1 online resource (128 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 85-12, Section: B.
Contained By:	Dissertations Abstracts International85-12B.
Subject:	Computer science. -
Online resource:	click for full text (PQDT)
ISBN:	9798383179406

Paying Attention to Music : = Applying Attention Mechanisms to Automatic Music Transcription.
Wise, Andrew J.

Paying Attention to Music :Applying Attention Mechanisms to Automatic Music Transcription. - 1 online resource (128 pages)

Source: Dissertations Abstracts International, Volume: 85-12, Section: B.

Thesis (Ph.D.)--University of Louisiana at Lafayette, 2024.

Includes bibliographical references

The field of music information retrieval has seen a proliferation in the use of deep learning techniques, with an apparent consensus in the use of convolutional neural networks and spectrograms as input. This is surprising as the data contained in spectrograms breaks the underlying assumptions imposed by the convolution operation. Literature shows researchers have tried to get around this problem by changing the input data or applying recurrence, but have met limited success. Attention mechanisms have been shown to outperform recurrence when tracking long-range dependencies. Despite these occurring naturally in music, researchers have been slow to adopt attention for music tasks.The work focuses on the novel application of attention-augmented convolutional neural networks to musical instrument recognition tasks. A single-source, single-label setting is first investigated to evaluate the impact of the attention augmentation in a clean setting. The created network is tasked with identifying one of nineteen possible orchestral musical instruments from an audio file. The proposed architecture augments the final convolution modules from a baseline convolutional template with attention mechanisms. The introduction of attention enhances the network's ability to extract the model of sound generation from spectrograms. The ratio of convolution to attention is manipulated, and two different spectrogram types, CQT and STFT, are used to assess the efficacy of applying attention to this task. It was found that the networks containing a 25\\% attention augmentation outperformed their non-augmented and further augmented counterparts.Predominant musical instrument identification is investigated next, which involves identifying an arbitrary number of instruments deemed predominant in a multi-source, multi-label setting. The impact of the attention augmentation is assessed across various networks and input representations that build off the first phase to enhance representational power while reducing dimensionality. Specifically, networks are trained and tested across five different attention amounts with center loss, with and without two auxiliary classifications, and using four different input spectrogram representations. In total, 60 different networks are created, trained, and tested for comparison. Once again, networks augmented with 25\\% attention are demonstrated to outperform their convolutional-only and further augmented counterparts, achieving micro and macro F1 scores of 0.6743 and 0.5514 respectively.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2024

Mode of access: World Wide Web

ISBN: 9798383179406Subjects--Topical Terms:

573171
Computer science.
Subjects--Index Terms:

AttentionIndex Terms--Genre/Form:

554714
Electronic books.

Paying Attention to Music : = Applying Attention Mechanisms to Automatic Music Transcription.
LDR:04019ntm a22003977 4500 001 1149878
005 20241022110539.5
006 m o d
007 cr bn ---uuuuu
008 250605s2024 xx obm 000 0 eng d
020 $a 9798383179406
035 $a (MiAaPQ)AAI31293884
035 $a AAI31293884
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Wise, Andrew J. $3 1476249
245 1 0 $a Paying Attention to Music : $b Applying Attention Mechanisms to Automatic Music Transcription.
264 0 $c 2024
300 $a 1 online resource (128 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 85-12, Section: B.
500 $a Advisor: Kumar, Ashok;Maida, Anthony S.
502 $a Thesis (Ph.D.)--University of Louisiana at Lafayette, 2024.
504 $a Includes bibliographical references
520 $a The field of music information retrieval has seen a proliferation in the use of deep learning techniques, with an apparent consensus in the use of convolutional neural networks and spectrograms as input. This is surprising as the data contained in spectrograms breaks the underlying assumptions imposed by the convolution operation. Literature shows researchers have tried to get around this problem by changing the input data or applying recurrence, but have met limited success. Attention mechanisms have been shown to outperform recurrence when tracking long-range dependencies. Despite these occurring naturally in music, researchers have been slow to adopt attention for music tasks.The work focuses on the novel application of attention-augmented convolutional neural networks to musical instrument recognition tasks. A single-source, single-label setting is first investigated to evaluate the impact of the attention augmentation in a clean setting. The created network is tasked with identifying one of nineteen possible orchestral musical instruments from an audio file. The proposed architecture augments the final convolution modules from a baseline convolutional template with attention mechanisms. The introduction of attention enhances the network's ability to extract the model of sound generation from spectrograms. The ratio of convolution to attention is manipulated, and two different spectrogram types, CQT and STFT, are used to assess the efficacy of applying attention to this task. It was found that the networks containing a 25\\% attention augmentation outperformed their non-augmented and further augmented counterparts.Predominant musical instrument identification is investigated next, which involves identifying an arbitrary number of instruments deemed predominant in a multi-source, multi-label setting. The impact of the attention augmentation is assessed across various networks and input representations that build off the first phase to enhance representational power while reducing dimensionality. Specifically, networks are trained and tested across five different attention amounts with center loss, with and without two auxiliary classifications, and using four different input spectrogram representations. In total, 60 different networks are created, trained, and tested for comparison. Once again, networks augmented with 25\\% attention are demonstrated to outperform their convolutional-only and further augmented counterparts, achieving micro and macro F1 scores of 0.6743 and 0.5514 respectively.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2024
538 $a Mode of access: World Wide Web
650 4 $a Computer science. $3 573171
650 4 $a Music. $3 649088
653 $a Attention
653 $a Attention augmented
653 $a Automatic music transcription
653 $a Convolutional neural networks
653 $a Music information retrieval
653 $a Musical instrument recognition
655 7 $a Electronic books. $2 local $3 554714
690 $a 0984
690 $a 0413
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a University of Louisiana at Lafayette. $b Computer Science. $3 1195497
773 0 $t Dissertations Abstracts International $g 85-12B.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31293884 $z click for full text (PQDT)