bogJS – A JavaScript framework for object-based rendering in browsers
With the introduction of HTML5 and the Web Audio API, an important prerequisite was made for native rendering of object-based audio in modern browsers. Object-based audio is a revolutionary approach for creating and deploying interactive, personalized, scalable and immersive content, by representing it as a set of individual assets together with metadata describing their relationships and associations. This allows media objects to be assembled in ground-breaking ways to create new user experiences. This talk will introduce the open-source framework bogJS, developed by IRT (Institut für Rundfunktechnik) within the scope of the EU funded project ORPHEUS, which utilizes native nodes of the Web Audio API to realize such experiences. One aim of the development was to provide a flexible API that can be easily extended with different types of user interfaces and various representations of object metadata. Another key aim of the framework is to offer different possibilities to access audio signals for the rendering by taking into account current drawbacks and limitations of browser such as the supported number of tracks in a media element, the ordering of decoded multi-channel tracks or synchronized playback issues. Interoperability and implementation of current and upcoming standards, such as the ITU-R BS.2076 recommendation for a metadata definition model, will be taken into account and are currently under development. Furthermore, first projects and demonstrations using the framework will be presented.
@inproceedings{2016_EA_26,
abstract = {With the introduction of HTML5 and the Web Audio API, an important prerequisite was made for native rendering of object-based audio in modern browsers. Object-based audio is a revolutionary approach for creating and deploying interactive, personalized, scalable and immersive content, by representing it as a set of individual assets together with metadata describing their relationships and associations. This allows media objects to be assembled in ground-breaking ways to create new user experiences. This talk will introduce the open-source framework bogJS, developed by IRT (Institut für Rundfunktechnik) within the scope of the EU funded project ORPHEUS, which utilizes native nodes of the Web Audio API to realize such experiences. One aim of the development was to provide a flexible API that can be easily extended with different types of user interfaces and various representations of object metadata. Another key aim of the framework is to offer different possibilities to access audio signals for the rendering by taking into account current drawbacks and limitations of browser such as the supported number of tracks in a media element, the ordering of decoded multi-channel tracks or synchronized playback issues. Interoperability and implementation of current and upcoming standards, such as the ITU-R BS.2076 recommendation for a metadata definition model, will be taken into account and are currently under development. Furthermore, first projects and demonstrations using the framework will be presented.},
address = {Atlanta, GA, USA},
author = {Weitnauer, Michael and Meier, Michael},
booktitle = {Proceedings of the International Web Audio Conference},
editor = {Freeman, Jason and Lerch, Alexander and Paradis, Matthew},
month = {April},
pages = {},
publisher = {Georgia Tech},
series = {WAC '16},
title = {bogJS – A JavaScript framework for object-based rendering in browsers},
year = {2016},
ISSN = {2663-5844}
}