A prototype system for rule-based expressive modifications of audio recordings
2007 (English)In: Proc. of the Int. Symp. on Performance Science 2007, Porto, Portugal: AEC (European Conservatories Association) , 2007, 355-360 p.Conference paper (Refereed)
A prototype system is described that aims to modify a musical recording in an expressive way using a set of performance rules controlling tempo, sound level and articulation. The audio signal is aligned with an enhanced score file containing performance rules information. A time-frequency transformation is applied, and the peaks in the spectrogram, representing the harmonics of each tone, are tracked and associated with the corresponding note in the score. New values for tempo, note lengths and sound levels are computed based on rules and user decisions. The spectrogram is modified by adding, subtracting and scaling spectral peaks to change the original tone’s length and sound level. For tempo variations, a time scale modification algorithm is integrated in the time domain re-synthesis process. The prototype is developed in Matlab. An intuitive GUI is provided that allows the user to choose parameters, listen and visualize the audio signals involved and perform the modifications. Experiments have been performed on monophonic and simple polyphonic recordings of classical music for piano and guitar.
Place, publisher, year, edition, pages
Porto, Portugal: AEC (European Conservatories Association) , 2007. 355-360 p.
automatic music performance, performance rules, musical expression, emotions, audio signal processing
Computer Science Language Technology (Computational Linguistics)
IdentifiersURN: urn:nbn:se:kth:diva-51976OAI: oai:DiVA.org:kth-51976DiVA: diva2:465266
ISPS 2007, the Int. Symp. on Performance Science 2007, 22-23 November 2007, Porto, Portugal
tmh_import_11_12_14. QC 201112222011-12-142011-12-142011-12-22Bibliographically approved