Abstract
In this paper we investigate the retrieval performance of monophonic and polyphonic queries made on a polyphonic music database. We extend the n-gram approach for full-music indexing of monophonic music data to polyphonic music using both rhythm and pitch information. We define an experimental framework for a comparative and fault-tolerance study of various n-gramming strategies and encoding levels. For monophonic queries, we focus in particular on query-by-humming systems, and for polyphonic queries on query-by-example. Error models addressed in several studies are surveyed for the fault-tolerance study. Our experiments show that different n-gramming strategies and encoding precision differ widely in their effectiveness. We present the results of our study on a collection of 6366 polyphonic MIDI-encoded music pieces.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Barlow, H. and Morgenstern, S. (1949). A Dictionary of Musical Themes. London: Ernest Benn.
Blackburn, S. and DeRoure, D. (1998). A Tool for Content-Based Navigation of Music. In ACM Multimedia' 98, pp. 361–368.
Chen, J.C.C. and Chen, A.L.P. (1998). Query by Rhythm: An Approach for Song Retrieval in Music Databases. In Proceedings of IEEE International Workshop on Research Issues in Data Engineering, pp. 139–146.
Clausen, M., Engelbrecht, R., Meyer, D., and Schmitz, J. (2000). PROMS: A Web-Based Tool for Searching Polyphonic Music. In 1st International Symposium on Music Information Retrieval, ISMIR 2000.
Crawford, T., Iliopoulus, C.S., and Raman, R. (1998). String-Matching Techniques for Musical Similarity and Melodic Recognition. Computing in Musicology, 11, 73–100.
Doraisamy, S. (1995). Locating Recurring Themes in Musical Sequences. Master's Thesis, University Malaysia Sarawak.
Dovey, M. (2001). A Technique for Regular Expression Style Searching in Polyphonic Music. In 2nd International Symposium on Music Information Retrieval, ISMIR 2001.
Downie, S. (1999). Evaluating a Simple Approach to Music Information Retrieval: Conceiving Melodic n-grams as Text. PhD Thesis, University of Western Ontario.
Downie, S. and Nelson, M. (2000). Evaluation of a Simple and Effective Music Information Retrieval Method. In SIGIR 2000, pp. 73–80.
Foote, J. (2000). ARTHUR: Retrieving Orchestral Music by Long-Term Structure. In 1st International Symposium on Music Information Retrieval, ISMIR 2000.
Ghias, A., Logan, J., Chamberlin, D., and Smith, B.C. (1995). Query by Humming–Musical Information Retrieval in an Audio Database. In ACM Multimedia' 95–Electronic Proceedings.
Harter, S.P. and Hert, C.A. (1997). Evaluation of Information Retrieval Systems: Approaches, Issues and Methods. Annual Review of Information Science and Technology, 32, 1–94.
Haus, G. and Pollastri, E. (2001). An Audio Front End for Query by Humming Systems. In 2nd International Symposium on Musical Information Retrieval, ISMIR 2001.
Heaps, H.S. (1978). Information Retrieval: Computational and Theoretical Aspects. Academic Press.
Huron, D. (1997). Humdrum and Kern: Selective Feature Encoding. In Eleanor Selfridge-Field (Ed.), Beyond MIDI: The Handbook of Musical Codes (pp. 375–401). MIT Press.
Huron, D. (2000). Perceptual and Cognitive Applications in Music Information Retrieval. In 1st International Symposium on Music Information Retrieval, ISMIR 2000.
Kornstadt, A. (1998). Themefinder: AWeb-Based Melodic Search Tool. Computing in Musicology, 11, 231–236.
Kosugi, N., Nishihara, Y., Sakata, T., Yamamuro, M., and Kushima, K. (2000). A Practical Query by Humming System for a Large Music Database. In ACM Multimedia 2000.
Lemström, K., Haapaniemi, A., and Ukkonen, E. (1998). Retrieving Music–to Index or not to Index. In ACM Multimedia' 98.
Lemur Toolkit. (2001). http://www-2.cs.cmu.edu/~lemur.
McNab, R., Smith, L.A., Bainbridge, D., and Witten, I.H. (1997, May). The New Zealand Digital Library MELody InDEX. D-Lib Magazine.
McNab, R.J., Smith, L.A., Witten, I.H., Henderson, C.L., and Cunningham, S.J. (1996). Towards the Digital Music Library: Tune Retrieval from Acoustic Input. In Digital Libraries.
Melucci, M. and Orio, N. (1999). Music Information Retrieval using Melodic Surface. In The Fourth ACM Conference on Digital Libraries' 99, pp. 152–160.
Pickens, J. (2001). Feature Selection for Polyphonic Music Retrieval. In SIGIR 2001.
Prechelt, L. and Typke, R. (2001). An Interface for Melody Input. ACM Transactions on Computer-Human Interaction, 8(2), 133–149.
Robertson, S.E., Walker, S., Jones, S., Hancock-Beaulieu, M.M., and Gatford, M. (1994). Okapi at TREC-3. In NIST Special Publication 500-225: Overview of the Third Text REtrieval Conference (TREC-3).
Rolland, P.-Y., Raskinis, G., and Ganascia, J.-G. (1999). Musical Content-Based Retrieval: An Overview of the Melodiscov Approach and System. In ACM Multimedia' 99.
Salton, G. (1989). Automatic Text Processing: The Transformation, Analysis and Retrieval of Information by Computer. Addison-Wesley.
Selfridge-Field, E. (1998). Conceptual and Representational Issues in Melodic Comparison. Computing in Musicology, 11, 1–64.
Shmulevich, I., Yli-Harja, O., Coyle, E., Povel, D.-J., and Lemström, K. (1999). Perceptual Issues in Music Pattern Recognition–Complexity of Rhythm and Key Finding. In Proceedings of the AISB' 99 Symposium on Musical Creativity, pp. 64–69.
Uitdenbogerd, A. and Zobel, J. (1999). Melodic MatchingTechniques for Large Databases. In ACM Multimedia' 99.
Walker, S., Robertson, S.E., Boughanem, M., Jones, G.J.F., and Spärck-Jones, K. (1997). Okapi at TREC-6: Automatic ad hoc, VLC, routing, filtering and QSDR. In NIST Special Publication 500-240, The Sixth Text Retrieval Conference (TREC-6).
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Doraisamy, S., Rüger, S. Robust Polyphonic Music Retrieval with N-grams. Journal of Intelligent Information Systems 21, 53–70 (2003). https://doi.org/10.1023/A:1023553801115
Issue Date:
DOI: https://doi.org/10.1023/A:1023553801115