Why
“Play The City” was an experience designed to celebrate The GRAMMYs return to New York. An Uber was specially outfitted with computer vision software played the city like a musical instrument. Sounds & animations were triggered by people and objects outside, allowing unique songs to be created in real-time.
How
An Uber car was outfitted with hidden cameras and innovative augmented reality, allowing the crew to capture passengers’ reactions to what they found upon looking out the car window. Musical notes were AR-superimposed onto each pedestrian, dog, etc., along with corresponding, original music orchestrated purely by the ‘rhythm of NYC life.’ The effect was the result of a combination of an AR camera rigged to the car, along with computers that worked together to synchronize the sound with the live visuals.