The Spatial-AV project, which studies immersive audiovisual media, has announced its latest camera technology and production tools, including light-field and multi-camera processing. In addition, the Alliance is showcasing new technologies from the project including object-oriented audio coding and live control of spatial audio data objects.
Under the project, started at IBC2012, Fraunhofer experts have developed and introduced new technologies to enhance the workflow for intelligent, modular, multi-sensory 3D recording and production systems.
The Fraunhofer Digital Cinema Alliance consists of Fraunhofer IIS, Fraunhofer Heinrich Hertz Institute HHI, Fraunhofer IDMT and Fraunhofer FOKUS.
The Alliance said that working with multi-camera or light-field data delivers a great deal of creative potential for further processing, changes or additional effects. This includes re-focusing, changing perspective and viewing angle that can be realised in post production without additional shootings or retakes.
The Fraunhofer IIS institute, which is coordinating the Alliance, is using IBC to present the first plug-ins to enable and test smart processing of this data in a professional post production tool.
The most recent additions to Spatial-AV include an automated stereoscopy system and a mobile 360-degree panoramic camera system, the OmniCam.
Recently used for a special recording during the FIFA World Cup in Brazil, OmniCam has also been used to allow concerts and operas to be experienced in panorama up to 360 degrees in UHD. Films from the OmniCam-360 will soon be available via an app that is being introduced at IBC.
Navigation within the panorama is made possible by the app running on second device, such as tablets, smartphones and laptops. The spectator is able to navigate at will in the videos of concerts or sporting events and can then individually zoom in on a section in the panorama.
