The following are excerpts of MIDI clips of Chinese pop songs, either in their original state or generated by a machine learning model. Each clip is between 12 and 20 seconds in length, randomly extracted from a longer musical piece. The total time to complete these listening tasks is less than 10 minutes.
Please record your answers via the online answer form -- NOW DISABLED.
Note: If you are browsing this page using an iPhone, please remember to turn the silent mode off through the switch on the side of your iPhone.
Optional: Click here if you want info on the research project
Title: "Pictures of MIDI: Controlled Music Generation via Graphical Prompts for Image-Based Diffusion Inpainting"Abstract:
Recent years have witnessed significant progress in generative models for music, featuring diverse architectures that balance output quality, diversity, speed, and user control. This study explores a user-friendly graphical interface enabling the drawing of masked regions for inpainting by an Hourglass Diffusion Transformer (HDiT) model trained on MIDI piano roll images. To enhance note generation in specified areas, masked regions are ``seeded'' with extra noise. The non-latent HDiT’s linear scaling with pixel count allows efficient generation in pixel space, providing intuitive and interpretable controls such as masking throughout the network and removing the need to operate in compressed latent spaces such as those provided by pretrained autoencoders. We demonstrate that, in addition to inpainting of melodies, accompaniment, and continuations, the use of seeding can produce musical structures closely matching user specifications such as rising, falling, or diverging melody and/or accompaniment, even when these lie outside the typical training data distribution.
Your Seed Value
Please supply the following number when filling out the top of the form. This will help keep track of the options (since they're dynamically randomized).Your seed is: 0
One other note: Please disregard note 'velocity' / playing style.
For these examples, we're interested in the composition, not the performance.Question 1 - Creativity
For this question please listen to the clips provided, and then in the answer form, rate them according to your preference as per the criterion "CREATIVITY: How creative the music is." (That's all the definition you get. Just go with it!)
NOTE: IF YOU'RE ON A PHONE, PLEASE SCROLL TO THE RIGHT SO YOU SEE ALL THE CLIPS!
Question 2 - Naturalness
For this question please listen to the clips provided, and then in the answer form, rate them according to your preference as per the criterion "NATURALNESS: How likely a human musician composed the music
Question 3 - Musicality
For this question please listen to the clips provided (click on the tab to change clips), and then in the online answer form, rate them according to your preference as per the criterion "MUSICALITY: The overall music quality.
Question 4 - Fitness: Melody (given accompaniment)
This one has extra clips! For this question please listen to the clips provided, and then in the answer form, rate them according to your preference as per the criterion "FITNESS: How well the melody fits the accompaniment."
NOTE: IF YOU'RE ON A PHONE, PLEASE SCROLL TO THE RIGHT SO YOU SEE ALL THE CLIPS!