메뉴 건너뛰기
소속 기관 / 학교 인증
인증하면 논문, 학술자료 등을  무료로 열람할 수 있어요.
한국대학교, 누리자동차, 시립도서관 등 나의 기관을 확인해보세요
(국내 대학 90% 이상 구독 중)
고객센터 ENG
주제분류

논문 기본 정보

저자정보
(Zhengzhou Technology and Business University)
저널정보
Korean Institute of Information Scientists and Engineers Journal of Computing Science and Engineering Journal of Computing Science and Engineering Vol.20 No.3
오류 신고하기

피인용 1

검색

    초록·키워드

    To address the challenges of capturing long-term temporal dependencies, insufficient extraction of key emotional features, and the inherent limitations of single-modal information in music emotion recognition tasks, this study proposes a novel multi-modal framework. The core idea of the research is to break through the limitations of single mode in the expression of complex music emotions by separating and deeply mining the acoustic physical dynamics of audio and the music theory context of Musical Instrument Digital Interface (MIDI), and making adaptive fusion at the decision-making level. Specifically, the framework constructs a dual channel model based on long short-term memory (LSTM) networks and gated recurrent units (GRU). First, for symbolic music, a bidirectional LSTM with a self-attention mechanism is designed to capture music theory context and dynamically focus on crucial emotional phrases. Second, for audio music, a bidirectional GRU based on temporal pattern attention is constructed to perform deep temporal modeling of Mel spectrograms. Experimental results demonstrate that the symbolic model achieves an average accuracy of 88.68% on the MidiEmotion dataset, while the audio model attains 88.15% on the EMOPIA dataset. The multi-modal fusion model integrates the strengths of both, achieving a superior final accuracy of 91.55% and an F1-score of 91.04%. These findings prove that the proposed model effectively leverages the complementarity between symbolic semantics and acoustic features, substantially enhancing both the precision and robustness of emotion detection in music.

    최근 본 자료 전체보기