Your browser is out-of-date!

Update your browser to view this website correctly. Update my browser now

×

Taking live interactive VR performances to a new level

This was the reaction of four-time BRIT Award nominees Years & Years to a groundbreaking gig they performed recently at the Hospital Club in London. Technology giant Samsung

“We are buzzing – the show was like nothing we’ve done before.”

This was the reaction of four-time BRIT Award nominees Years & Years to a gig they performed recently at the Hospital Club in London. Technology giant Samsung was looking for a way to launch its Galaxy S7 flagship series martphones and showcase its Gear VR headsets. Working with experiential marketing agency Iris Worldwide, Samsung organised a ‘private performance’ to showcase how virtual reality (VR) can transform a live music experience.

“We teamed up with Years & Years, who share our passion, for innovation to take their live performance experience to a whole new level,” says David Lowes, chief marketing officer at Samsung Electronics Europe.

Private performance
The private performance was attended by 200 fans, and was also streamed live in interactive VR, making it a first for the music industry together with Samsung. An audience of UK and European media representatives were able to fully immerse themselves in the experience through Samsung Gear VR headsets powered by the brand new Galaxy S7 and S7 Edge Smartphone’s in a separate area of the club. The live stream was also available to existing Gear VR customers across Europe via a bespoke app. The show acted as a preview to the band’s upcoming world tour and saw them perform six tracks from their platinum selling album, Communion.

The event threw up a unique set of challenges. “This type of live-stream VR broadcast, is made possible by our proprietary end-to-end VR live streaming workflow,” explains Anthony Kaydis, founder and CEO of Shoreditch-based VR specialist Mativision, which powered the live streaming of the event and also developed the bespoke VR app for Samsung’s mobile devices. “One of the biggest challenges in a live immersive VR broadcast is that the multiple individual video images which produce the 360-degree spherical image that we then broadcast to the viewers’ headsets, must be stitched perfectly in real time, with no visual artefacts. As we use more than one 360-camera simultaneously in our live VR broadcasts, this becomes even more critical.”

A first for live VR
Leveraging Mativision’s VR Player technology, this was the first time that viewers of a live streamed VR experience delivered to Gear VR headsets, had the ability to select different camera positions, in real time, while the show was being broadcast. Furthermore, thanks to the creative input of director Sam Wrench, who has previously worked with acts including Mary J Blige, George Michael and Blur, a moving 360-video camera was deployed above the band.

“While we have a very mature technology offering and use special 360-cameras that are robust and small enough to be unobtrusive, it is creatives like Sam who are really help to drive the VR experience forward, using tricks and techniques from other traditional filming approaches,” says Karydis. “Having a moving camera on a rail above the band is a case in point, and it gave an amazingly impressive bird’s-eye view of the whole experience.”

However, it was not as easy as it sounds to execute. “Unlike in conventional filming, when you’re working in 360 you have to be very careful with movement, and we worked closely with both Sam and the operator of the rails moving platform to achieve a speed that didn’t feel unnatural or disorientating to the viewer,” Karydis adds.

A truly immersive experience
For Samsung, the event proved a success. By watching the performance live through the Samsung Gear VR headsets provided the remote audience was given a truly immersive experience and was able to ‘visit’ places not possible in a live performance, proving the effectiveness of the technology.

“Delivering a live VR project with this level of complexity demands a huge amount of experience and ability,” says Karydis. “It really constituted two separate simultaneous VR broadcasts and we had to ensure that they were delivered impeccably, both for the on-site as well as the Europe-wide VR-audiences at the same time.”

The event generated positive press coverage and the band themselves were really impressed with the technology.

“The VR element adds a totally new dimension for us as performers and for those watching,” Years & Years told reporters on the night. “We’re proud to be the first artists to offer such a unique and special, immersive experience to our fans. We can’t wait to see the performance ourselves in 360 video.”

George Kapellos, head of partnerships, Mativision