Interactive Annual 20:
The Mobile Orchestra
Beautifully simple and fun social idea.
A clever way to take advantage of multiple devices, and it actually worked great!
In this innovative app-based holiday card, AKQA sent a clear message to friends, family, clients and beyond: the holidays are best spent with others. Teaming up with the Pacific Chamber Symphony, the agency created an interactive orchestra that joins up to twelve phones and tablets to perform a single song, Carol of the Bells, a sort of digital carol to bring people together. Groups of friends can sync their mobile devices and each person is assigned one of twelve musical rolesmaybe conductor or cellist. As the carol begins, they play together in harmony. Executive creative director Stephen Clements described the in-house project as a great process of invention and problem solving. When you have very limited time and resources you make quick decisions and dont overthink things. Its more fun that way.
- • AKQAs creative technology team was working from a previous prototype built for a similar experience. It took about four weeks to rework both concept and code for the holiday card.
- • Along with the music, the app plays unique videos for each of the musicians playing an instrument as well as the conductor using his baton.
Comments by Stephen Clements:
We wanted as many people as possible to experience The Mobile Orchestra, so the product had to work across iOS, Android and Windows devices, which added complexity to the development process. The heart of the functionality lies in how each devices latency is determined. When the start command is issued, each musicians device is told to start playback from a specific point in the video plus the determined latency. This allows accuracy of the sync to be within 200 milliseconds in most cases.
The original vision, which was to detect a group session via GPS proximity, was abandoned early on in the development. Its a shame because it would have made the experience much simpler. However, it is still quite magical.
We think there are other applications for this simultaneous, multi-screen technology and we are planning to patent and license it to other clients. You can easily imagine famous movie scenes playing out on different devices simultaneously from different perspectives. Or a TV commercial that allows you to see different angles in different devices, for example, a view in a rear-view mirror. Once you can sync the experience, it opens a whole world of creative potential.
James De Jesus, user experience director
John Ta, designer
Osamu Akatsu, senior designer
Stephen Clements, executive creative director
Simon Jefferson, principal
Chris Miller, software engineer
Ray Patterson/Richard Tirta Widjaja/Mayo Tobita, developers
Eric Clifford, technical lead
Adam Creeger, mobile technology director
Mike Murray, editor
Steven Gallardo, project manager
Stuart Lewan/Gearoid OFlynn, quality assurance
AKQA (San Francisco, CA), project design and development