RPO partners with Snapchat for augmented reality project

Florence Lockheart
Wednesday, January 22, 2025

The Royal Philharmonic Orchestra has helped develop a lens that ‘translates’ music into colours and shapes, allowing participants to ‘see’ music

(Image courtesy of the RPO)
(Image courtesy of the RPO)

The Royal Philharmonic Orchestra (RPO) has launched a new partnership with social media platform Snapchat. Colours of Music is a collaborative augmented reality (AR) lens which ‘translates’ music into colours and shapes, allowing Snapchat users to ‘see’ music.

The Colours of Music AR lens allows users to ‘scan’ and instrument being played live to see a 3D AR representation of the notes, pace and dynamics. Snapchat and the Royal Philharmonic Orchestra will launch the new software on Sunday (26 January, 11am - 3pm) with a free performance at the Southbank Centre’s Western Roof Pavilion. Three RPO cellists will perform behind transparent ‘AR mirrors’ to demonstrates how the lens works.

RPO deputy managing director Huw Davies said: ’We are delighted to partner with Snap Inc for this exciting new project. At a time when many orchestral music enthusiasts supplement the concert experience by furthering their music discovery online, this pioneering new experience from Snap Inc will do much to inspire journeys of music discovery for people at home, at college or during a music lesson. Our annual audience research last year revealed more than a third of adults (34 per cent) viewed social media platforms as playing a key role to help them discover new music, and interest is growing in augmented reality (AR) or virtual reality (VR) music experiences. With this in mind, our Colours of Music collaboration with Snapchat will allow people to experience the wonder of sound in a whole new way.’

Developed by Snapchat in Paris, the Colours of Music AR lens is inspired by chromesthesia, a type of sound-to-colour synaesthesia. The experience draws on the expertise of RPO musicians as well as on academic and scientific research with the aim of making ‘live orchestral music accessible to as inclusive and diverse an audience as possible’, particularly for those who might be hard of hearing.