“Sonic Locomotion”, Wwise-based installation prototype
Behind The Scene
Step mats
Arduino IDE
Max/MSP
Wwise
Max is seen as a MIDI controller here, and the objects controlled include:
Playing of the event “Footsteps_Player”
RTCP/Switch of what environment
Volume fader for Fade in/out
I also explored Wwise’s feature to randomize repeating sound files to avoid aural exhaustion.
Programs: Arduino, Max/MSP, Wwise
Prompt: I was intrigued to see if I can utilize Wwise, a game audio program, as an interactive playback device and create immersive, dynamic soundscapes.
Utilizing Arduino, Max/MSP and Wwise, I wanted to build an experience where the change of environments are defined by the continuously changing soundscapes. I especially wanted to take advantage of Wwise’s features such as randomization and switch.
Theme: There is something calming about walking in the nature by oneself, in the dark, surround by nature sounds.
Wwise
Arduino
Connected to the step mats that function as on/off switches, the arduino is programmed to print “on” when the mat is being stepped on hence completing the circuit. I am treating both maps as identical input since the audio randomnization will be achieved in Wwise.
Max/MSP
Max does two things here.
Receiving “on/off” messages from Arduino via serial port, which are then programmed to trigger the '“Footsteps_Player” event in Wwise via MIDI.
Allows participants to select which environment they want to experience, which then send out MIDI values that changes RTCP value, which then triggers switches in Wwise.
