Exploring AI-based Sound Spaces for Environmental Audio
Task List and Introduction
Note:
Please use a laptop or desktop computer with a Firefox or Chrome browser to complete the tasks.
While you are listening to the sounds, please adjust the volume of your headphones
to be sufficiently loud but comfortable. Once it is set, do not change the volume for the entire task.
Please ensure you are sitting in a quiet environment while performing the tasks.
Task
Our Estimate for Time
Details
Consent Details
5 mins
Please read the details related to your consent to participate in this study.
'Select Model' as 'Hits & Scratches' and 'Select Example' as 'Hit - Wood-Dirt'. This sound is created by a drum stick hitting a wooden tree trunk.
Change the controls provided on the left panel to update the 'Synthetic Sound'. We use this Synthetic Sound to query the AI Sound Space. Observe how changing
the left panel controls changes both the 'Synthetic Sound' as well as the matching 'AI-generated Sound'.
Observe what each control does to the sounds.
For this task, using the controls provided on the left panel, change this example of 'Hit - Wood-Dirt' into a
sound
made by a drum stick scratching a soft surface (such as a carpet or sofa). See the example 'Scratch - Carpet' or 'Hit - Sofa' for an idea on how to change the controls.
Please feel free to explore this interface using other examples/models.
10 mins Main Task
Using the same interface above -
Create a sound of your choice. A sound that you might use in your practice or performance.
Play around with the controls and record a screencast of the activity when you are ready. We will use this video to initiate a discussion during the interview.
Please email me the video in advance of the interview.
(Please feel free to use your usual tools for recording your activity. Kindly ensure that you record audio as well when recording your screen activity. See here for some ways to record your screen.)
'Select Model' as 'Hits & Scratches' and 'Select Example' as 'Scratch - Carpet'. This sound is created by a drum stick scratching a carpeted floor.
Change the controls provided on the left panel to update the generated sound and
observe what each control does to the sound.
For this task, using the controls provided on the left panel, increase the number of impact sounds in
the sample (i.e., increase the number of times the stick scratches the carpeted
surface).
Please feel free to explore this interface using other examples/models.
10 mins Main Task
Using the same interface above -
Create a sound of your choice. A sound that you might use in your practice or performance.
Play around with the controls and record a screencast of the activity when you are ready. We will use this video to initiate a discussion during the interview.
Please email me the video in advance of the interview.
(Please feel free to use your usual tools for recording your activity. Kindly ensure that you record audio as well when recording your screen activity. See here for some ways to record your screen.)
30 mins
Thank you for completing all tasks!
We would now like to invite you to a short interview to understand your experience with the interfaces and models.
Please email purnima.kamath@u.nus.edu with your availability for the interview.