Towards an ecosystem for semantics

Scherp, Ansgar and Jain, Ramesh
MS 07: Workshop on multimedia information retrieval on The many faces of multimedia semantics
Multimedia does not exhibit a unique semantics but multiple semantics that are influenced by many factors. Current approaches and systems lack from considering this problem in its entirety. What is needed is a holistic approach that describes and embraces the complex and challenging problem of multimedia semantics. Consequently, we are developing with the Semantics Ecosystem (SES) an approach that aims at providing a framework for solving this problem. The SES defines five types of semantics and their relationships to each other and to the real world. In the paper, we present the SES and show its application to the domain of authoring multimedia albums. We show the benefits of having such a theoretical framework to handle the semantics of multimedia albums. The SES allows us to better understand, describe, and communicate the many different factors that are influencing multimedia semantics.
09 / 2007