Music Monday 16/09: Robotic Mario / Zelda Melody

Here is a clip of NES games, fed through robotically controlled musical instruments, which play the onscreen gameplay live (including background music and sound effects).

Technical details:

“Both the piano and the percussion use solenoids to drive their player mechanisms. The piano uses Yamaha’s Disklavier system to strike keys, and the percussion uses a custom solution to strike the drum sticks. Both the piano and percussion are each controlled by Raspberry Pis which have custom software to control each instrument. The software is responsible for translating the gameplay audio to instructions which ultimately define which solenoid should be actuated. In full disclosure, there is normally a half-second audio delay that was removed in editing, but it’s still very playable live. The piano is controlled through the Disklavier’s MIDI interface, while the percussion’s solenoids are directly controlled through the Pi’s GPIO interface.”

Source: Roboband

David Lee
David is the founder of Heart Gaming. Regular writer, reviewer and editor. Has a strong passion for gaming; particularly the Legend of Zelda series.