Towards effective content-based music retrieval with multiple acoustic feature composition

• Main Authors: SHEN, Jialie, Shepherd, John, Ahh, Ngu
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2006
• Subjects: acoustic signal processing; audio databases; content-based retrieval; learning (artificial intelligence); multilayer perceptrons; multimedia databases; music; pattern classification; principal component analysis; PCA; audio alteration; content-based mus; Databases and Information Systems; Numerical Analysis and Scientific Computing
• Online Access: https://ink.library.smu.edu.sg/sis_research/128; https://ink.library.smu.edu.sg/context/sis_research/article/1127/viewcontent/Towards_Effective_Content_Based_Music_Retrieval_With_Multiple_Acoustic_Feature_Combination.pdf
• Institution: Singapore Management University

In this paper, we present a new approach to constructing music descriptors to support efficient content-based music retrieval and classification. The system applies multiple musical properties combined with a hybrid architecture based on principal component analysis (PCA) and a multilayer perceptron neural network. This architecture enables straightforward incorporation of multiple musical feature vectors, based on properties such as timbral texture, pitch, and rhythm structure, into a single low-dimensioned vector that is more effective for classification than the larger individual feature vectors. The use of supervised training enables incorporation of human musical perception that further enhances the classification process. We compare our approach with state of the art techniques and demonstrate its effectiveness on content-based music retrieval. In addition, extensive experimental study illustrates its effectiveness and robustness against various kinds of audio alteration