
MPEG finalizes specs for VR streaming standard
Virtual worlds are very much in vogue, whether in computer games or in industrial planning processes. The OMAF transmission and storage standard will ensure that all VR devices speak the same language and are compatible with each other. With the HEVC Tile Based Streaming technology from Fraunhofer HHI, the resolution of 360-degree videos can be significantly increased with OMAF. Thus, high-resolution video material enters virtual reality.
In the standardization committee MPEG, all industrial sectors that have something to do with virtual realities participated. Researchers from the Fraunhofer Heinrich Hertz Institute HHI in Berlin have also brought their expertise to the table: they have introduced technologies into the standard with which today’s and future devices can be efficiently supplied with high-resolution data. The clou: Smartphones can display VR content with a significantly higher quality if the user’s viewing direction is taken into account during streaming. The OMAF standard was technically finalised at the last MPEG meeting in October and is due to be published at the beginning of 2018.
The new standard is intended to make life easier for consumers – at least in terms of virtual reality. The OMAF standard promotes offers in the OMAF language. As a result, more services related to VR are likely to be created. Consumers can use them immediately because they speak a single language. In addition, they will probably have to pay less for this in the long run.
The VR industry also benefits from the new standard, as it makes the various devices compatible with each other. This not only simplifies the interaction but also the design of the individual devices and solutions, which in turn reduces costs.
OMAF determines how the media data must be prepared and how applications must be designed. However, it is not particularly catchy – it naturally does not answer concrete questions, such as about possible uses and benefits of the standard. The Virtual Reality Industry Forum VRIF takes over as a founding member of the Virtual Reality Industry Forum VRIF, which includes Intel, Qualcomm, Ericsson, Nokia, Dolby, Harmonic, Akamai, Sony, Huwaei, Technicolor and others. The Industry Forum develops guidelines for the OMAF standard, as well as best practice examples for industrial companies. The guidelines, in which the Fraunhofer HHI researchers have also played a major role and which are to be continuously developed further, cover both the production of VR content, its distribution and its use.
A key aspect of the OMAF standard is that the resolution of 360-degree videos, such as those viewed with VR glasses, should increase. So far, this is rather meagre. The HEVC Tile Based Streaming technology from the Fraunhofer HHI allows a big leap forward. The clou: The entire 360-degree video is divided into tiles of the HEVC video standard, which are encoded independently of each other. The end device, i. e. the VR glasses, uses these tiles to construct the required image in optimum resolution. The image is therefore high-resolution in the user’s direction of view, with a low resolution behind it. Up to now, it was necessary to have a separate video on the server for every angle – a costly affair. The HEVC Tile Based approach offers numerous advantages: the resolution can be greatly improved, significantly less video data has to be stored on the servers, and operating costs are reduced. HEVC Tiles allow ultra-high resolution content to be optimally transferred to mobile devices, even with limited bandwidth.
