Articles

AI-based Visualization and Quantitative Analysis of Gayageum Sanjo Vibrato Using CREPE and FFT for Traditional Korean Music Education

AUTHOR :
Minji Kim, Honggu Yeo, Dasaem Jeong
INFORMATION:
page. 69~91 / 2025 Vol.54 No.4
e-ISSN 2713-3788
p-ISSN 1229-4179

ABSTRACT

This study aimed to establish reference criteria for learners and performers by defining nonghyun—a core expressive element in Korean traditional music—within rhythmic sobak units. Using deep learning-based analysis with pitch extraction (CREPE) and Fast Fourier Transform (FFT), gayageum sanjo performances were analyzed and visualized. Within clearly periodic rhythmic units, nonghyun segments were identified and measured in pitch, depth, speed, and frequency. The analysis showed that Jinyangjo exhibited about three nonghyun per beat and Jungmori about two, maintaining rhythmic periodicity despite tonal or phrasing variations. Future research should refine segmentation criteria and extend to diverse sanjo repertoires and performers.

Keyword :

REFERENCES


  1. Ahn, S. H. (2008). Characteristics in the ways of variation by each Yupa of Gayageum Sanjo. Doctoral dissertation, Hanyang University.
  2. Bang, H. S. (2023). A study on the characteristic analysis of Haegeum vibrato based on monotones. Journal of the National Center for Korean Traditional Performing Arts, 48, 37-52. https://doi.org/10.29028/JNGC.2023.48.037 [Crossref]
  3. Byeon, M. H. (2012). Dictionary of Korean music terms. Minsokwon.
  4. Cho, H. K. (2018). A study on the ways of making sample-based virtual instruments by analyzing pitch of Nonghyun of the Haegeum. Master's thesis, Sangmyung University.
  5. Cho, M. S. (2021). A comparative analysis on the notation method of Jungjungmori in Haegeum Sanjo of Seo Yongseok style: Based on the scores of Choi Taehyun and Kang Dukwon/Yang Kyungsook. Master's thesis, Dankook University.
  6. De Cheveigné, A., & Kawahara, H. (2002). YIN, a fundamental frequency estimator for speech and music. The Journal of the Acoustical Society of America, 111(4), 1917-1930. https://doi.org/10.1121/1.1458024 [Crossref]
  7. Goto, M., Hashiguchi, H., Nishimura, T., & Oka, R. (2002). RWC music database: Popular, classical and jazz music databases. In Proceedings of the 3rd International Conference on Music Information Retrieval (ISMIR 2002) (Vol. 2, pp. 287-288). ISMIR.
  8. Han, D., Caro Repetto, R., & Jeong, D. (2023). Finding Tori: Self-supervised learning for analyzing Korean folk song. In Proceedings of the 24th International Society for Music Information Retrieval Conference (ISMIR 2023) (pp. 440-447). ISMIR. https://doi.org/10.5281/zenodo.10265319 [Crossref]
  9. Huang, Y.-F., Liang, J.-I., Wei, I.-C., & Su, L. (2020). Joint analysis of mode and playing technique in Guqin performance with machine learning. In Proceedings of the 21st International Society for Music Information Retrieval Conference (ISMIR 2020) (pp. 85-92). ISMIR. https://doi.org/10.5281/zenodo.4245378 [Crossref]
  10. Kim, H. J. (2019). A study on improvement of Korean folk song (Yukjabaegi-tori) notation and contents in elementary music textbooks. Korean Journal of Research in Music Education, 48(4), 147-160. https://doi.org/10.30775/KMES.48.4.147 [Crossref]
  11. Kim, H. J. (2022). The current status of teaching Tori and Sigimsae in elementary music education and a reconsideration of Tori theory for local folk songs. Korean Musicology, 72, 63-86. https://doi.org/10.35983/sikm.2022.72.63 [Crossref]
  12. Kim, H. S., Baek, D. W., & Choi, T. H. (1995). Introduction to traditional Korean music. Minsokwon.
  13. Kim, I. R. (2022, April 20). Gayageum Sanjo, Shin Gwan-yong school - Hogoji-eum [Album]. Music & New.
  14. Kim, J. W., Salamon, J., Li, P., & Bello, J. P. (2018). CREPE: A convolutional representation for pitch estimation. In 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (pp. 161-165). IEEE. https://doi.org/10.1109/ICASSP.2018.8461329 [Crossref]
  15. Kim, M. H. (2007). La-mode and sol-mode Garakdory analyze and compare: Focused on Gwaebeop, Joobeop, Nonghyun and rhythm. Master's thesis, Pusan National University.
  16. Kim, M. J. (2021). A proposal of Gayageum performance method by Tori for teaching Korean folk song accompaniment. Culture and Convergence, 43(9), 583-606. https://doi.org/10.33645/cnc.2021.09.43.9.583 [Crossref]
  17. Kim, W. J. (2015). Research methodology in Korean music. Minsokwon.
  18. Kim, Y. J. (2021). A study on Gayakeum Nonghyun technique using Praat: Focusing on Pyeongjo and Gyeomyunjo of Namchang Gagok. Doctoral dissertation, Kyungpook National University.
  19. Kim, Y. J. (2023). A musical acoustics study for Gayageum Jeongak vibrato: With focus on music by Choi Choong-woong. Journal of Music Education Science, 54, 163-180. https://doi.org/10.30832/JMES.2023.54.163 [Crossref]
  20. Kim, Y. J. (2024). An acoustic analysis of Haegeum Nonghyun: Based on Jinyangjo. Master's thesis, Seoul National University.
  21. Kim, Y. S. (2007). An analysis and improvement plan of Korean vocal music. Master's thesis, Hanyang University.
  22. Kim, Y. U. (2015). Introduction to Korean traditional music. Eumak Segye.
  23. Kwon, S. Y. (2023). A study on Dwitpungryu of "Seong Geum-yeon-transmitted Julpungryu": Centered on the comparison with Gayageum melodies of National Gugak Center and Gurye Hyangje Julpungryu. Master's thesis, Korea National University of Arts.
  24. Lee, D. G. (2017). Comparative study on Geomungo Sigimsae of Isudaeyeop Yeochang Gagok: Focusing on melodies of Kim Seonhan and Lee O-gyu. Master's thesis, Ewha Womans University.
  25. Lee, Y. N. (2015). An acoustic study on tonal Sigimsae of 1930s Gayageum Sanjo: Based on Jinyangjo. Doctoral dissertation, Seoul National University.
  26. Lim, E. K. (2010). Study on Nonghyun frequency of Gayageum Sanjo. Master's thesis, Korea National University of Education.
  27. Marchini, M., Ramirez, R., Papiotis, P., & Maestre, E. (2014). The sense of ensemble: A machine learning approach to expressive performance modelling in string quartets. Journal of New Music Research, 43(3), 303-317. https://doi.org/10.1080/09298215.2014.922999 [Crossref]
  28. Mauch, M., & Dixon, S. (2014). pYIN: A fundamental frequency estimator using probabilistic threshold distributions. In 2014 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (pp. 659-663). IEEE. https://doi.org/10.1109/ICASSP.2014.6853678 [Crossref]
  29. Ministry of Education (2022). Music curriculum. No. 2022-33. [supplementary 12]. Ministry of Education.
  30. Moon, K. A. (2022). Gayageum sanjo, Kim Jukpa ryu [Digital album]. Mirrorball Music.
  31. National Gugak Center (2025). Nonghyun. In Gugak Dictionary. Retrieved August 1, 2025, from https://www.gugak.go.kr/ency/topic/view/2104
  32. Shikarpur, N., Dendukuri, K. M., Wu, Y., Caillon, A., & Huang, C. Z. A. (2024). Hierarchical generative modeling of melodic vocal contours in Hindustani classical music. In Proceedings of the 25th International Society for Music Information Retrieval Conference (ISMIR 2024) (pp. 1020-1028). ISMIR. https://doi.org/10.5281/zenodo.14877505 [Crossref]
  33. Shin, J. Y. (2025). A study on the Sigimsae instruction methods using Gayageum - Focused on Yukjabaegi. Master's thesis, Jeonju National University of Education.
  34. Shin, M. S. (2024). Gayageum Sanjo, Kim Yundeok ryu [Digital album]. Soundpress.
  35. Wu, Y., Manilow, E., Deng, Y., Swavely, R., Kastner, K., Cooijmans, T., Courville, A., Huang, C. A., & Engel, J. (2022). MIDI-DDSP: Detailed control of musical performance via hierarchical modeling. In International Conference on Learning Representations (ICLR 2022). ICLR.

Archives

(55 Volumes, 945 Articles)
view all volumes and issues