Hn-sinc-NSF music¶
Messages¶
Paper:
Zhao, Y., Wang, X., Juvela, L. & Yamagishi, J. Transferring neural speech waveform synthesizers to musical instrument sounds generation. in Proc. ICASSP 6269–6273 (IEEE, 2020). doi:10.1109/ICASSP40776.2020.9053047
BibTex:
@inproceedings{Zhao2020, author = {Zhao, Yi and Wang, Xin and Juvela, Lauri and Yamagishi, Junichi}, booktitle = {Proc. ICASSP}, doi = {10.1109/ICASSP40776.2020.9053047}, pages = {6269--6273}, title = {{Transferring neural speech waveform synthesizers to musical instrument sounds generation}}, url = {https://ieeexplore.ieee.org/document/9053047/}, year = {2020} }This page lists copy-synthesis waveform samples, i.e., waveforms generated given natural acoustic features. They were evaluated in the listening test
Experiments were based on URMP database
Code for Hn-sinc-NSF is available. You need both the CURRENNT toolkit and scripts
New implementaion based on Pytorch is also available
Audio samples (ensemble)¶
In the experiment, we evaluated each music track separately. However, we can also mix the tracks and create a virtual orchestra. Here are the audios.
If it is slow to load the samples, you can download them here
| 43_Chorale_mixed: trumpet, horn, trombone, and tuba | |
|---|---|
| 14_Waltz_mixed: flute, clarinet | |
| 13_Hark.wav: violin, viola | |
| 11_Maria_mixed: oboe, cello (quality not good) | |
| 10_March_mixed: trumpet, saxphone | |
| 08_Spring_mixed: flute, volin |
Audio samples (single track)¶
Audios in orange color have relatively large noises. It is better not to play the audios
It may take some time to load all the audios. Please wait for a few minutes, or change the web browser. If your browswer cannot load the audio samples, please download samples here
| WaveNet | WaveGlow | NSF | Natural | |||||||
|---|---|---|---|---|---|---|---|---|---|---|
| training-scratch | zeroshot | adaption | zeroshot | adaption | scratch | zeroshot | adaption | |||
| WN-FS | WN-ZS | WN-FT | WG-ZS | WG-FT | NSF-FS | NSF-ZS | NSF-FT | NAT | ||
| Violin 1 | Violin 1 | |||||||||
| Violin 2 | Violin 2 | |||||||||
| Cello 1 | Cello 1 | |||||||||
| Cello 2 | Cello 2 | |||||||||
| Viola 1 | Viola 1 | |||||||||
| Viola 2 | Viola 2 | |||||||||
| Flute 1 | Flute 1 | |||||||||
| Flute 2 | Flute 2 | |||||||||
| WaveNet | WaveGlow | NSF | Natural | |||||||
| training-scratch | zeroshot | adaption | zeroshot | adaption | scratch | zeroshot | adaption | |||
| WN-FS | WN-ZS | WN-FT | WG-ZS | WG-FT | NSF-FS | NSF-ZS | NSF-FT | NAT | ||
| Oboe 1 | Oboe 1 | |||||||||
| Oboe 2 | Oboe 2 | |||||||||
| Clarinet 1 | Clarinet 1 | |||||||||
| Clarinet 2 | Clarinet 2 | |||||||||
| Saxphone 1 | Saxphone 1 | |||||||||
| Saxphone 2 | Saxphone 2 | |||||||||
| Trumpet 1 | Trumpet 1 | |||||||||
| Trumpet 2 | Trumpet 2 | |||||||||
| WaveNet | WaveGlow | NSF | Natural | |||||||
| training-scratch | zeroshot | adaption | zeroshot | adaption | scratch | zeroshot | adaption | |||
| WN-FS | WN-ZS | WN-FT | WG-ZS | WG-FT | NSF-FS | NSF-ZS | NSF-FT | NAT | ||
| Horn 1 | Horn 1 | |||||||||
| Horn 2 | Horn 2 | |||||||||
| Trombone 1 | Trombone 1 | |||||||||
| Trombone 2 | Trombone 2 | |||||||||
| Tuba 1 | Tuba 1 | |||||||||
| Tuba 2 | Tuba 2 | |||||||||