Input from the computer’s audio system is routed through the UDP object in Max/MSP through a Java gateway on to a Flash file:

 

Same as above, but with live camera tracking added from built-in webcam routed through Jitter:

 

The modification was based on the original idea below, which uses a stereo signal and pitch tracking:

Thanks to Base42.nl

Here’s everything you should need to get it running on your OSX system:

Flash files and tutorial
Max/MSP
Jitter
Flash Open Sound Control (Flosc)
My Pong Patches used for the above examples

More info in the comments


Sponsors