Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

When music makes a scene

When music makes a scene Music frequently occurs as an important reinforcing and meaning-creating element in multimodal human experiences. This way, cross-modal connotative associations are established, which are actively exploited in professional multimedia productions. A lay user who wants to use music in a similar way may have a result in mind, but may lack the right musical vocabulary to express the corresponding information need. However, if the connotative associations between music and visual narrative are strong enough, characterizations of music in terms of a narrative multimedia context can be envisioned. In this article, we present the outcomes of a user study considering this problem. Through a survey for which respondents were recruited via crowdsourcing methods, we solicited descriptions of cinematic situations for which fragments of royalty-free production music would be suitable soundtracks. As we will show, these descriptions can reliably be recognized by other respondents as belonging to the music fragments that triggered them. We do not fix any description vocabulary beforehand, but rather give respondents a lot of freedom to express their associations. From these free descriptions, common narrative elements emerge that can be generalized in terms of event structure. The insights gained this way can be used to inform new conceptual foundations for supervised methods, and to provide new perspectives on meaningful and multimedia context-aware querying, retrieval and analysis. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png International Journal of Multimedia Information Retrieval Springer Journals

When music makes a scene

Download PDF
16 pages

Loading next page...
 
/lp/springer-journals/when-music-makes-a-scene-syreWG9uWx
Publisher
Springer Journals
Copyright
Copyright © 2013 by Springer-Verlag London
Subject
Computer Science; Multimedia Information Systems; Information Storage and Retrieval; Information Systems Applications (incl. Internet); Data Mining and Knowledge Discovery; Image Processing and Computer Vision; Computer Science, general
ISSN
2192-6611
eISSN
2192-662X
DOI
10.1007/s13735-012-0031-3
Publisher site
See Article on Publisher Site

Abstract

Music frequently occurs as an important reinforcing and meaning-creating element in multimodal human experiences. This way, cross-modal connotative associations are established, which are actively exploited in professional multimedia productions. A lay user who wants to use music in a similar way may have a result in mind, but may lack the right musical vocabulary to express the corresponding information need. However, if the connotative associations between music and visual narrative are strong enough, characterizations of music in terms of a narrative multimedia context can be envisioned. In this article, we present the outcomes of a user study considering this problem. Through a survey for which respondents were recruited via crowdsourcing methods, we solicited descriptions of cinematic situations for which fragments of royalty-free production music would be suitable soundtracks. As we will show, these descriptions can reliably be recognized by other respondents as belonging to the music fragments that triggered them. We do not fix any description vocabulary beforehand, but rather give respondents a lot of freedom to express their associations. From these free descriptions, common narrative elements emerge that can be generalized in terms of event structure. The insights gained this way can be used to inform new conceptual foundations for supervised methods, and to provide new perspectives on meaningful and multimedia context-aware querying, retrieval and analysis.

Journal

International Journal of Multimedia Information Retrieval – Springer Journals

Published: Jan 24, 2013

References

  • A connotative space for supporting movie affective recommendation
    Benini, S; Canini, L; Leonardi, R
  • Retrieval of commercials by semantic content: the semiotic perspective
    Colombo, C; Bimbo, A; Pala, P
  • Music—a very short introduction
    Cook, N
  • Measuring nominal scale agreement among many raters
    Fleiss, JL
  • Contextual music information retrieval and recommendation: state of the art and challenges
    Kaminskas, M; Ricci, F
  • Analysis of user needs and information features in natural language queries seeking user information
    Lee, JH
  • Ästhetik der Filmmusik
    Lissa, Z
  • Conducting behavioral research on Amazon’s Mechanical Turk
    Mason, W; Suri, S
  • Denotative and connotative semantics in hypermedia: proposal for a semiotic-aware architecture
    Nack, F; Hardman, L
  • Running experiments on Amazon Mechanical Turk
    Paolacci, G; Chandler, J; Ipeirotis, PG
  • Ten little title tunes—towards a musicology of the mass media
    Tagg, P; Clarida, B
  • Semantic annotation and retrieval of music and sound effects
    Turnbull, D; Barrington, L; Torres, D; Lanckriet, G