Personal Project
Whale Simulator is a VR project featuring sound interaction, created in Unity3d with Wwise and Max/MSP.
The environmental sound design is accomplished in Wwise. Each of the whales has a sound event based on the pool of “whale sound” clips triggered in random rate, frequency and also different volume, reverb according to the position of the player.
The patch I made in M4L to help accelerate making a bunch of different whale sounds:
The key concept is to enable movement by human voice, which is implemented in Max/MSP. When the player looks in a specific direction and gives sound, the input signal will be captured by Max/MSP. If the volume of the signal exceeds a certain threshold, it will trigger movement towards where the player gazes so that players could wander around the virtual world, having a fantastic ambisonic experience.