Introduction to Music Synchronization for RWC Music Database (Classical Music, RWC-MDB-C-2001)

On this web page, we supply MIDI-audio synchronization results obtained from the synchronization procedure described in [2]. Providing these results, our goal is to establish a platform for comparing and discussing various synchronization and alignment procedures. In general terms, music synchronization denotes a procedure which, for a given position in one representation of a piece of music, determines the corresponding position within another representation. Depending upon the respective data formats, one distinguishes between various synchronization tasks. For example, audio-audio synchronization refers to the task of time aligning two different audio recordings of a piece of music. These alignments can be used to jump freely between different interpretations, thus affording efficient and convenient audio browsing. The goal of MIDI-audio synchronization is to coordinate MIDI note events with audio data. The result can be regarded as an automated annotation of the audio recording with available MIDI data. For references, we refer to [1] [2] [3] [4].

To ensure the availability of necessary audio and MIDI data, we revert to the RWC (Real World Computing) Music Database (RWC-MDB). This database, which can be acquired by researchers at the RWC website, is a copyright-cleared music database, see also [5]. The classical part of the RWC database contains an audio recording as well as a corresponding MIDI file for 61 pieces. Using the synchronization results based on [2], we modified each MIDI file to run synchronously to the corresponding audio recording. These modified MIDI files, which can be regarded as an annotation of the audio recordings by the MIDI note parameters, can now be obtained from this page.

The Synchronization Results include the following data for each of the given 61 MIDI/audio pairs.

• Synchronized MIDI files (Warped MIDI [mid])
• MIDI annotations in form of synchronized MIDI event list (Annotation [csv])
• Audio-MIDI warping path (WP [txt])
• Sonification of first 60 seconds using a sinusoidal synthesis for the synchronized MIDI events (Sonification (sinusoidal) [mp3])
• Sonification of first 60 seconds using a wavetable synthesis for the synchronized MIDI events (Sonification (wavetable) [mp3])

Disclaimer: The MP3 files and standard MIDI files (SMFs) supplied on this page are provided just for the users who have already obtained the RWC Music Database (Classical Music, RWC-MDB-C-2001) because these files generated from the original SMFs of the RWC Music Database are also considered to be a part of the RWC Music Database. Their conditions of use are the same as those for the original SMFs. Only users who have submitted a signed Pledge and have received distribution media of the RWC Music Database may download files from this page. The "User ID" and "Password" needed for downloading these files are same with those for downloading the original SMFs. Unauthorized reuse, reproduction, and redistribution are prohibited.

If you have not obtained the RWC Music Database yet, you can visit http://www.mpi-inf.mpg.de/~mmueller/SyncRWC60/ to check the synchronization results and sonifications only for the first 60 seconds of each recording. But you cannot use those results for your research without obtaining the RWC Music Database.

For comments and feedback, please contact Meinard Müller (meinard (at) mpi-inf.mpg.de) and Sebastian Ewert (ewerts (at) cs.uni-bonn.de).

Synchronization Results

The table contains the following data.

• ID: Identifier for the piece similar to the RWC Piece No.
• Composer: Name of composer.
• Piece: Name and work number (opus etc.) of piece.
• Duration (Audio): Duration of audio recording in seconds.
• Duration (MIDI): Duration of MIDI version in seconds.
• Pitch Diff: Estimated difference between the audio and the MIDI given in semitones. In our synchronization approach, we account for possible tuning difference between the audio and the reference MIDI file by considering various pitch filter bank implementations. For example, the number 0.25 indicates that the audio tends to be 0.25 semitones above the reference tuning given by the MIDI file.
• MIDI Shift: Semitone shift applied to the MIDI file in the sonification to better match the audio. The MIDI shift number is the Pitch Diff number rounded to the next integer value.
• WP:Warping path resulting from the MIDI-audio synchronization procedure. The warping path is given as list of pairs, where each pair consists of a an audio time position and a MIDI time position both given in seconds. The resolution is 20 milliseconds using a feature rate of 50 Hz and classical DTW with the standard step size conditions.
• Annotation: Text file containing a comma separated valued list of MIDI events along with corresponding time positions in the audio version. Each row contains the MIDI time position in seconds, the MIDI time position in musical beats, the MIDI note number, the MIDI note duration in seconds, the MIDI velocity, the MIDI channel, as well as the corresponding time position (computed by the synchronization procedure) in the audio recording.
• Warped MIDI: Temporally warped (and possibly pitch-corrected by MIDI Shift) MIDI running synchronously to the audio recording.
Technically, we used tempo events in a first step to warp the MIDI on a beat level, and then, in a second step, minimally adjusted the tick times of the notes to allow for intra-beat micro corrections.
• Sonification (sinusoidal): MP3 file of sonification of the first 60 seconds of the audio using a sinusoidal synthesis for the synchronized MIDI events.
• Sonification (wavetable): MP3 file of sonification of the first 60 seconds of the audio using a wavetable synthesis for the synchronized MIDI events.

Note: The MIDI-audio alignment results were obtained using the state-of-the-art synchronization procedure described in [2]. No parameter tuning or manual postprocessing were applied to improve the final result. The results are not meant to be ground truth annotations and may contain synchronization errors and inaccuracies. In particular, boundary problems have not been dealt with in the current version so that synchronization inaccuracies may typically appear at the beginning and the end of the files.

Note: The "User ID" and "Password" needed for downloading the linked files are same with those for downloading the original standard MIDI files from the RWC Music Database website. Unauthorized reuse, reproduction, and redistribution are prohibited.

ID	Composer	Piece	Duration (Audio)	Duration (MIDI)	Pitch Diff	MIDI Shift	WP	Annotation	Warped MIDI	Sonification (sinusoidal)	Sonification (wavetable)
1	Haydn, Franz Joseph	Symphony no.94 in G major, Hob.I-94 `The Surprise'. 1st mvmt.	504	503	0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
2	Mozart, Wolfgang Amadeus	Symphony no.40 in G minor, K.550. 1st mvmt.	460	464	0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
3	Beethoven, Ludwig van	Symphony no.5 in C minor, op.67. 1st mvmt.	436	465	0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
4	Tchaikovsky, Pyotr Ilich	Symphony no.6 in B minor, op.74 `Pathétique'. 4th mvmt.	593	578	0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
5	Mozart, Wolfgang Amadeus	Violin Concerto no.5 in A major, K.219. 1st mvmt.	606	606	0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
6	Chopin, Frédéric François	Piano Concerto no.1 in E minor, op.11. 2nd mvmt.	600	517	0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
7	Bach, Johann Sebastian	Brandenburg Concerto no.5 in D major, BWV.1050. 1st mvmt.	602	615	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
8	Mozart, Wolfgang Amadeus	<Le Nozze di Figaro> (The Marriage of Figaro), K.492: Overture	255	248	0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
9	Wagner, Richard	<Tristan und Isolde>: Prelude and `Liebestod'	1082	1080	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
10	Strauss II, Johann	`An der Schönen Blauen Donau' (Blue Danube Waltz), op.314	462	464	0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
11	Bach, Johann Sebastian	Passacaglia and Fugue in C minor, BWV.582	757	755	0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
12	Bach, Johann Sebastian	<The Musical Offering>, BWV.1079. `Ricercare à 6'	387	385	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
13	Mozart, Wolfgang Amadeus	String Quartet no.19 in C major, K.465. 1st mvmt.	510	498	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
14	Beethoven, Ludwig van	String Quartet no.14 in C# minor, op.131. 5th mvmt.	398	399	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
15	Borodin, Alexander	String Quartet no.2 in D major. 3rd mvmt.	464	457	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
16	Mozart, Wolfgang Amadeus	Clarinet Quintet in A major, K.581. 1st mvmt.	546	557	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
17	Brahms, Johannes	Clarinet Quintet in B minor, op.115. 3rd mvmt.	297	293	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
18	Brahms, Johannes	Horn Trio in Eb major, op.40. 2nd mvmt.	462	467	0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
19	Beethoven, Ludwig van	Piano Trio no.7 in Bb major, op.97 `Archduke'. 1st mvmt.	574	569	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
20	Brahms, Johannes	Piano Trio no.1 in B major, op.8. 1st mvmt.	632	619	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
21	Schubert, Franz Peter	Piano Quintet in A major, op.32/D.667 `Trout'. 4th mvmt.	491	468	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
22	Brahms, Johannes	Hungarian Dance no.5 in F# minor	145	142	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
23a	Ravel, Maurice	Suite <Ma Mère l'Oye> (Mother Goose), 1. Pavane de la Belle au Bois Dormant	80	83	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
23b	Ravel, Maurice	Suite <Ma Mère l'Oye> (Mother Goose), 2. Petit Poucet	165	166	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
23c	Ravel, Maurice	Suite <Ma Mère l'Oye> (Mother Goose), 3. Laideronnette, Impératrice des Pagodes	205	200	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
23d	Ravel, Maurice	Suite <Ma Mère l'Oye> (Mother Goose), 4. Les Entretiens de la Belle et de la Bête	249	254	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
23e	Ravel, Maurice	Suite <Ma Mère l'Oye> (Mother Goose), 5. Le Jardin Féerique	170	174	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
24a	Bach, Johann Sebastian	<The Anna Magdalena Bach Notebooks>, 1. Menuet in G major	86	82	-1.00	-1	[txt]	[csv]	[mid]	[mp3]	[mp3]
24b	Bach, Johann Sebastian	<The Anna Magdalena Bach Notebooks>, 2. Menuet in G minor	89	83	-0.75	-1	[txt]	[csv]	[mid]	[mp3]	[mp3]
24c	Bach, Johann Sebastian	<The Anna Magdalena Bach Notebooks>, 8. Musette in D major	52	46	-0.75	-1	[txt]	[csv]	[mid]	[mp3]	[mp3]
25a	Bach, Johann Sebastian	The Well-Tempered Clavier, Book 1, no.1 in C major BWV.846. Prelude	124	121	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
25b	Bach, Johann Sebastian	The Well-Tempered Clavier, Book 1, no.1 in C major BWV.846. Fugue	132	133	0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
25c	Bach, Johann Sebastian	The Well-Tempered Clavier, Book 1, no.2 in C minor BWV.847. Prelude	92	95	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
25d	Bach, Johann Sebastian	The Well-Tempered Clavier, Book 1, no.2 in C minor BWV.847. Fugue	115	119	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
26	Mozart, Wolfgang Amadeus	Piano Sonata in A major, K.331/300i. 1st mvmt.	600	599	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
27	Mozart, Wolfgang Amadeus	Variations on `Ah Vous Dirai-je Maman', K.265/300e	448	446	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
28	Beethoven, Ludwig van	Piano Sonata no.23 in F minor, op.57 `Appasionata'. 1st mvmt.	590	583	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
29	Schumann, Roberto Alexander	`Träumerei' from Suite <Kinderszenen>, op.15	145	149	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
30	Chopin, Frédéric François	Nocturne no.2 in Eb major, op.9-2	243	242	0.33	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
31	Chopin, Frédéric François	Etude in E major, op.10-3	256	262	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
32	Chopin, Frédéric François	Etude in F minor, op.25-2	110	106	-0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
33	Chopin, Frédéric François	Polonaise no.6 in Ab major "Héroïque" op.53	405	403	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
34	Liszt, Franz	`La Campanella' from <Grandes Études de Paganini>	309	311	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
35a	Satie, Erik	Three Gymnopédies no.1	229	198	0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
35b	Satie, Erik	Three Gymnopédies no.2	181	181	0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
35c	Satie, Erik	Three Gymnopédies no.3	166	164	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
36	Bach, Johann Sebastian	6 Sonatas and Partitas for Unaccompanied Violin no.6 (Partita no.3) in E major, BWV.1006. 3. Gavotte en Rondeau	212	174	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
37	Beethoven, Ludwig van	Violin Sonata no.5 in F major, op.24 `Spring'. 3rd mvmt.	78	72	0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
38	Paganini, Niccolò	24 Caprices, op.1 no.24 in A minor	321	307	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
39	Franck, César	Violin Sonata in A major. 4th mvmt.	404	399	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
40	Massenet, Jules	Meditation from <Thaïs>	306	297	0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
41	Bach, Johann Sebastian	Suite for Unaccompanied Cello no.1 in G major, BWV 1007. 1. Prelude	159	143	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
42	Saint-Saëns, Camille	`Le Cygne' from Suite <Le Carnaval des Animaux>	152	166	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
43	Fauré, Gabriel	Sicilienne op.78	250	241	0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
44	Rimski-Korsakov, Nikolay	`The Flight of the Bumble Bee'	64	61	0.33	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
45	Handel, George Frideric	Air `Ombra mai fu' (Largo) from <Serse> (Xerxes)	170	168	0.25	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
46	Mozart, Wolfgang Amadeus	Air 14 (Queen of the Night's Air) `Der Hölle Rache kocht in meinem Herzen' from <Die Zauberflöte> (The Magic Flute), K.620	189	184	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
47	Schubert, Franz Peter	`Ständchen' (Serenade) from <Schwanengesang>, D.957	226	225	-0.33	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
48	Schubert, Franz Peter	`Der Lindenbaum' from <Winterreise>, op.89/D.911	266	255	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
49	Verdi, Giuseppe	Air `La donna è mobile qual piuma al vento' from <Rigoletto>	132	133	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]
50	Bizet, Georges	Micaela's Air `Je dis que rien ne m'épouvante' from <Carmen>	306	307	0.00	0	[txt]	[csv]	[mid]	[mp3]	[mp3]

References

[1]

Meinard Müller
Information Retrieval for Music and Motion
Monograph, Springer, 2007.
ISBN: 978-3-540-74047-6
[bib] [link]

[2]

Sebastian Ewert, Meinard Müller, and Peter Grosche
High resolution audio synchronization using chroma onset features.
Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Taipei, Taiwan, pp. 1869-1872, 2009.
[bib] [pdf]

[3]

Meinard Müller, Henning Mattes, and Frank Kurth
An efficient multiscale approach to audio synchronization.
Proceedings of the 7th International Conference on Music Information Retrieval (ISMIR), Victoria, Canada, pp. 192-197, 2006.
[bib] [pdf]

[4]

Meinard Müller, Frank Kurth, and Tido Röder
Towards an efficient algorithm for automatic score-to-audio synchronization.
Proceedings of the 5th International Conference on Music Information Retrieval (ISMIR), Barcelona, Spain, pp. 365-372, 2004.
[bib] [pdf]

[5]

Masataka Goto, Hiroki Hashiguchi, Takuichi Nishimura, and Ryuichi Oka
RWC Music Database: Popular, classical and jazz music databases.
Proceedings of the 3rd International Conference on Music Information Retrieval (ISMIR), Paris, France, pp. 287-288, 2002.
[bib] [pdf]

Links

• PD Dr. Meinard Müller, Multimedia Information Retrieval Group, Max-Planck Institut für Informatik
  
• Prof. Dr. Michael Clausen, Multimedia Signal Processing Group, Bonn University
• Dipl.-Inform. Sebastian Ewert, Multimedia Signal Processing Group, Bonn University
• Prof. Dr. Masataka Goto, Media Interaction Group, National Institute of Advanced Industrial Science and Technology (AIST)
• RWC Music Database Home Page

• Homepage
• Introduction
• Synchronization Results
• References
• Links
• Project Partners
• MPI Informatik
• Bonn University
• AIST
• RWC-MDB