The Experts below are selected from a list of 64638 Experts worldwide ranked by ideXlab platform
Susanne Boll - One of the best experts on this subject based on the ideXlab platform.
-
mm4u a framework for creating personalized Multimedia Content
2005Co-Authors: Ansgar Scherp, Susanne BollAbstract:Multimedia Content today can be considered as the composition of media elements into an interactive Multimedia presentation. Personalization of such Multimedia Content means that the Content reflects the users’s context, their specific background and interest as well as the heterogeneous infrastructure to which the Content is delivered and in which it is presented. To achieve personalized Multimedia Content a manual creation of many different documents for all the different user contexts, however, is not feasible let alone economical. Rather a dynamic process of selecting and assembling personalized Multimedia Content depending on the user context seems reasonable. Support for such a dynamic creation of personalized Multimedia presentations, however, is lacking today. Existing Multimedia authoring tools do not support dynamic Content creation. Systems that already dynamically assemble personalized Content, typically found in the Web, remain text-focused. First research approaches in the field of dynamic generation of personalized Multimedia Content are limited with regard to their expressiveness of the personalization task and the user features they can personalize to. Whenever the Content personalization task is more complex, these systems need to employ additional programming. Consequently, with MM4U (short for ”Multimedia for you”), we propose a generic and modular framework to support Multimedia Content personalization applications in this Multimedia software development process. The framework’s components provide generic components for typical tasks of the Multimedia Content personalization. In turn the development of Multimedia applications becomes easier and much more efficient for different users with their different contexts. First sample applications we develop on the basis of our framework are a personalized Multimedia picture gallery and a personalized sightseeing tour.
-
Z/sub Y/X-a Multimedia document model for reuse and adaptation of Multimedia Content
IEEE Transactions on Knowledge and Data Engineering, 2001Co-Authors: Susanne Boll, Wolfgang KlasAbstract:Advanced Multimedia applications require adequate support for the modeling of Multimedia Content by Multimedia document models. More and more this support calls for not only the adequate modeling of the temporal and spatial course of a Multimedia presentation and its interactions, but also for the partial reuse of Multimedia documents and adaptation to a given user context. However, our thorough investigation of existing standards for Multimedia document models such as HTML, MHEG, SMIL, and HyTime leads to us the conclusion that these standard models do not provide sufficient modeling support for reuse and adaptation. Therefore, we propose a new approach for the modeling of adaptable and reusable Multimedia Content, the Z/sub Y/X model. The model offers primitives that provide-beyond the more or less common primitives for temporal, spatial, and interaction modeling-a variform support for reuse of structure and layout of document fragments and for the adaptation of the Content and its presentation to the user context. We present the model in detail and illustrate the application and effectiveness of these concepts by samples taken from our Cardio-OP application in the domain of cardiac surgery. With the Z/sub Y/X model, we developed a comprehensive means for advanced Multimedia Content creation: support for template-driven authoring of Multimedia Content and support for flexible, dynamic composition of Multimedia documents customized to the user's local context and needs. The approach significantly impacts and supports the authoring process in terms of methodology and economic aspects.
-
Multimedia Document Models: Sealed Fate or Setting Out for New Shores?
Multimedia Tools and Applications, 2000Co-Authors: Susanne Boll, Wolfgang Klas, Utz WestermannAbstract:Existing Multimedia document models like HTML, MHEG, SMIL, and HyTime lack appropriate modeling primitives to fit the needs of next generation Multimedia applications which bring up requirements like reusability of Multimedia Content in different presentations and contexts, and adaptation to user preferences. In this paper, we motivate and present new requirements stemming from advanced Multimedia applications and the resulting consequences for Multimedia document models. Along these requirements, we discuss the document model standards HTML, HyTime, MHEG, SMIL, and Z_YX, a new model that has been developed with special focus on reusability and adaptation. The analysis and comparison of the models show the limitations of existing models, point the way to the need for new flexible Multimedia document models, and throw light on the many implications on authoring systems, Multimedia Content management, and presentation.
-
Multimedia document models sealed fate or setting out for new shores
International Conference on Multimedia Computing and Systems, 1999Co-Authors: Susanne Boll, Wolfgang Klas, Utz WestermannAbstract:Existing Multimedia document models like HTML, MHEG, SMIL and HyTime lack appropriate modeling primitives to fit the needs of next generation Multimedia applications which bring up requirements like reusability of Multimedia Content in different presentations and contexts, and adaptation to user preferences. We motivate and present new requirements stemming from advanced Multimedia applications and the resulting consequences for Multimedia document models. Along these requirements, we discuss HTML, HyTime, MHEG, SMIL, and ZyX, a new model that has been developed with special focus on reusability and adaptation. The analysis and comparison of the models show the limitations of existing models, point the way to the need for new flexible Multimedia document models, and throw light on the many implications on authoring systems, Multimedia Content management and presentation.
Jane Hunter - One of the best experts on this subject based on the ideXlab platform.
-
adding Multimedia to the semantic web building an mpeg 7 ontology
International Semantic Web Conference, 2001Co-Authors: Jane HunterAbstract:For the past two years the Moving Pictures Expert Group (MPEG), a working group of ISO/IEC, have been developing MPEG-7 [1], the "Multimedia Content Description Interface", a standard for describing Multimedia Content. The goal of this standard is to develop a rich set of standardized tools to enable both humans and machines to generate and understand audiovisual descriptions which can be used to enable fast efficient retrieval from digital archives (pull applications) as well as filtering of streamed audiovisual broadcasts on the Internet (push applications). MPEG-7 is intended to describe audiovisual information regardless of storage, coding, display, transmission, medium, or technology. It will address a wide variety of media types including: still pictures, graphics, 3D models, audio, speech, video, and combinations of these (e.g., Multimedia presentations). MPEG-7 is due for completion in October 2001. At this stage MPEG-7 definitions (description schemes and descriptors) are expressed solely in XML Schema [2-4]. XML Schema has been ideal for expressing the syntax, structural, cardinality and datatyping constraints required by MPEG-7. However it has become increasingly clear that in order to make MPEG-7 accessible, re-usable and interoperable with other domains then the semantics of the MPEG-7 metadata terms also need to be expressed in an ontology using a machine-understandable language. This paper describes the trials and tribulations of building such an ontology represented in RDF Schema [5] and demonstrates how this ontology can be exploited and reused by other communities on the semantic web (such as TV-Anytime [6], MPEG-21 [7], NewsML [8], museum, educational and geospatial domains) to enable the inclusion and exchange of Multimedia Content through a common understanding of the associated MPEG-7 Multimedia Content descriptions.
-
adding Multimedia to the semantic web building an mpeg 7 ontology
International Semantic Web Conference, 2001Co-Authors: Jane HunterAbstract:For the past two years the Moving Pictures Expert Group (MPEG), a working group of ISO/IEC, have been developing MPEG-7 [1], the "Multimedia Content Description Interface", a standard for describing Multimedia Content. The goal of this standard is to develop a rich set of standardized tools to enable both humans and machines to generate and understand audiovisual descriptions which can be used to enable fast efficient retrieval from digital archives (pull applications) as well as filtering of streamed audiovisual broadcasts on the Internet (push applications). MPEG-7 is intended to describe audiovisual information regardless of storage, coding, display, transmission, medium, or technology. It will address a wide variety of media types including: still pictures, graphics, 3D models, audio, speech, video, and combinations of these (e.g., Multimedia presentations). MPEG-7 is due for completion in October 2001. At this stage MPEG-7 definitions (description schemes and descriptors) are expressed solely in XML Schema [2-4]. XML Schema has been ideal for expressing the syntax, structural, cardinality and datatyping constraints required by MPEG-7. However it has become increasingly clear that in order to make MPEG-7 accessible, re-usable and interoperable with other domains then the semantics of the MPEG-7 metadata terms also need to be expressed in an ontology using a machine-understandable language. This paper describes the trials and tribulations of building such an ontology represented in RDF Schema [5] and demonstrates how this ontology can be exploited and reused by other communities on the semantic web (such as TV-Anytime [6], MPEG-21 [7], NewsML [8], museum, educational and geospatial domains) to enable the inclusion and exchange of Multimedia Content through a common understanding of the associated MPEG-7 Multimedia Content descriptions.
Wolfgang Klas - One of the best experts on this subject based on the ideXlab platform.
-
Z/sub Y/X-a Multimedia document model for reuse and adaptation of Multimedia Content
IEEE Transactions on Knowledge and Data Engineering, 2001Co-Authors: Susanne Boll, Wolfgang KlasAbstract:Advanced Multimedia applications require adequate support for the modeling of Multimedia Content by Multimedia document models. More and more this support calls for not only the adequate modeling of the temporal and spatial course of a Multimedia presentation and its interactions, but also for the partial reuse of Multimedia documents and adaptation to a given user context. However, our thorough investigation of existing standards for Multimedia document models such as HTML, MHEG, SMIL, and HyTime leads to us the conclusion that these standard models do not provide sufficient modeling support for reuse and adaptation. Therefore, we propose a new approach for the modeling of adaptable and reusable Multimedia Content, the Z/sub Y/X model. The model offers primitives that provide-beyond the more or less common primitives for temporal, spatial, and interaction modeling-a variform support for reuse of structure and layout of document fragments and for the adaptation of the Content and its presentation to the user context. We present the model in detail and illustrate the application and effectiveness of these concepts by samples taken from our Cardio-OP application in the domain of cardiac surgery. With the Z/sub Y/X model, we developed a comprehensive means for advanced Multimedia Content creation: support for template-driven authoring of Multimedia Content and support for flexible, dynamic composition of Multimedia documents customized to the user's local context and needs. The approach significantly impacts and supports the authoring process in terms of methodology and economic aspects.
-
Multimedia Document Models: Sealed Fate or Setting Out for New Shores?
Multimedia Tools and Applications, 2000Co-Authors: Susanne Boll, Wolfgang Klas, Utz WestermannAbstract:Existing Multimedia document models like HTML, MHEG, SMIL, and HyTime lack appropriate modeling primitives to fit the needs of next generation Multimedia applications which bring up requirements like reusability of Multimedia Content in different presentations and contexts, and adaptation to user preferences. In this paper, we motivate and present new requirements stemming from advanced Multimedia applications and the resulting consequences for Multimedia document models. Along these requirements, we discuss the document model standards HTML, HyTime, MHEG, SMIL, and Z_YX, a new model that has been developed with special focus on reusability and adaptation. The analysis and comparison of the models show the limitations of existing models, point the way to the need for new flexible Multimedia document models, and throw light on the many implications on authoring systems, Multimedia Content management, and presentation.
-
Multimedia document models sealed fate or setting out for new shores
International Conference on Multimedia Computing and Systems, 1999Co-Authors: Susanne Boll, Wolfgang Klas, Utz WestermannAbstract:Existing Multimedia document models like HTML, MHEG, SMIL and HyTime lack appropriate modeling primitives to fit the needs of next generation Multimedia applications which bring up requirements like reusability of Multimedia Content in different presentations and contexts, and adaptation to user preferences. We motivate and present new requirements stemming from advanced Multimedia applications and the resulting consequences for Multimedia document models. Along these requirements, we discuss HTML, HyTime, MHEG, SMIL, and ZyX, a new model that has been developed with special focus on reusability and adaptation. The analysis and comparison of the models show the limitations of existing models, point the way to the need for new flexible Multimedia document models, and throw light on the many implications on authoring systems, Multimedia Content management and presentation.
John R. Smith - One of the best experts on this subject based on the ideXlab platform.
-
Object-Based Multimedia Content Description Schemes and Applications for MPEG-7
2013Co-Authors: Ana B. Benitez, John R. Smith, Shihfu Chang, Seungyup Paek, Atul Puri, Qian Huang, Lawrence D. Bergman, Charles N. JudiceAbstract:In this paper, we describe description schemes (DSs) for image, video, Multimedia, home media, and archive Content proposed to the MPEG-7 standard. MPEG-7 aims to create a Multimedia Content description standard in order to facilitate various Multimedia searching and filtering applications. During the design process, special care was taken to provide simple but powerful structures that represent generic Multimedia data. We use the eXtensible Markup Language (XML) to illustrate and exemplify the proposed DSs because of its interoperability and flexibility advantages. The main components of the image, video, and Multimedia description schemes are object, feature classification, object hierarchy, entity-relation graph, code downloading, multi-abstraction levels, and modality transcoding. The home media description instantiates the former DSs proposing the 6-W semantic features for objects, and 1-P physical and 6-W semantic object hierarchies. The archive description scheme aims to describe collections of Multimedia documents, whereas the former DSs only aim at individual Multimedia documents. In the archive description scheme, the Content of an archive is represented using multiple hierarchies of clusters, which may be related by entity-relation graphs. The hierarchy is a specific case of entity-relation graph using a containment relation. We explicitly include the hierarchy structure in our DSs because it is a 1 natural way of defining composite objects, a more efficient structure for retrieval, and the representatio
-
ibm Multimedia search and retrieval system
Conference on Image and Video Retrieval, 2007Co-Authors: Apostol Natsev, Jelena Tesic, John R. SmithAbstract:IBM Multimedia Search and Retrieval System is a Webbased technology that makes digital photos and video searchable through automated classification and indexing [3]. IBM system is unique in that it learns as it goes, helping users search immense Multimedia Content repositories faster and more effectively than ever before. Marvel uses multi-modal machine learning techniques for bridging the semantic gap for Multimedia Content analysis and retrieval. It automatically annotates images and videos by recognizing the semantic entities-such as scenes, objects, events, and people-that are depicted in the Content.
-
semantic representation search and mining of Multimedia Content
Knowledge Discovery and Data Mining, 2004Co-Authors: Apostol Natsev, Milind R Naphade, John R. SmithAbstract:Semantic understanding of Multimedia Content is critical in enabling effective access to all forms of digital media data. By making large media repositories searchable, semantic Content descriptions greatly enhance the value of such data. Automatic semantic understanding is a very challenging problem and most media databases resort to describing Content in terms of low-level features or using manually ascribed annotations. Recent techniques focus on detecting semantic concepts in video, such as indoor, outdoor, face, people, nature, etc. This approach works for a fixed lexicon for which annotated training examples exist. In this paper we consider the problem of using such semantic concept detection to map the video clips into semantic spaces. This is done by constructing a model vector that acts as a compact semantic representation of the underlying Content. We then present experiments in the semantic spaces leveraging such information for enhanced semantic retrieval, classification, visualization, and data mining purposes. We evaluate these ideas using a large video corpus and demonstrate significant performance gains in retrieval effectiveness.
-
standard for Multimedia databases
International Conference on Management of Data, 2001Co-Authors: John R. SmithAbstract:The Moving Picture Experts Group (MPEG) is developing a new standard called the “Multimedia Content Description Interface,” also known as MPEG-7. The goal of MPEG-7 is to enable fast and effective searching and filtering of Multimedia Content. The effort is being driven by requirements taken from a large number of applications related to Multimedia databases, interactive media services (music, TV programs), video libraries, and so forth. MPEG-7 is achieving this goal by developing an XML-Schema based standard for describing features of Multimedia Content. In this tutorial, we study the emerging MPEG-7 standard and describe the new challenges for MPEG-7 Multimedia databases.
-
scalable Multimedia delivery for pervasive computing
ACM Multimedia, 1999Co-Authors: John R. Smith, Rakesh MohanAbstract:Growing numbers of pervasive devices are gaining access to the Internet and other information sources. However, much of the rich Multimedia Content cannot be easily handled by the client devices with limited communication, processing, storage and display capabilities. In order to improve access, we are developing a system for scalable delivery of Multimedia. The system uses an InfoPyramid for managing and manipulating Multimedia Content composed of video, images, audio and text. The InfoPyramid manages the different variations of media objects with different fidelities and modalities and generates and selects among the alternatives in order to adapt the delivery to different client devices. We describe a system for scalable Multimedia delivery for a variety of client devices, including PDAs, HHCs, smart phones, TV browsers and color PCs.
Jincheng Huang - One of the best experts on this subject based on the ideXlab platform.
-
Multimedia Content analysis using both audio and visual clues
IEEE Signal Processing Magazine, 2000Co-Authors: Yao Wang, Jincheng HuangAbstract:Multimedia Content analysis refers to the computerized understanding of the semantic meanings of a Multimedia document, such as a video sequence with an accompanying audio track. With a Multimedia document, its semantics are embedded in multiple forms that are usually complimentary of each other, Therefore, it is necessary to analyze all types of data: image frames, sound tracks, texts that can be extracted from image frames, and spoken words that can be deciphered from the audio track. This usually involves segmenting the document into semantically meaningful units, classifying each unit into a predefined scene type, and indexing and summarizing the document for efficient retrieval and browsing. We review advances in using audio and visual information jointly for accomplishing the above tasks. We describe audio and visual features that can effectively characterize scene Content, present selected algorithms for segmentation and classification, and review some testbed systems for video archiving and retrieval. We also describe audio and visual descriptors and description schemes that are being considered by the MPEG-7 standard for Multimedia Content description.
-
Multimedia Content analysis using both audio and visual clues
IEEE Signal Processing Magazine, 2000Co-Authors: Yao Wang, Zhu Liu, Jincheng HuangAbstract:Multimedia Content analysis refers to the computerized understanding of the semantic meanings of a Multimedia document, such as a video sequence with an accompanying audio track. With a Multimedia document, its semantics are embedded in multiple forms that are usually complimentary of each other, Therefore, it is necessary to analyze all types of data: image frames, sound tracks, texts that can be extracted from image frames, and spoken words that can be deciphered from the audio track. This usually involves segmenting the document into semantically meaningful units, classifying each unit into a predefined scene type, and indexing and summarizing the document for efficient retrieval and browsing. We review advances in using audio and visual information jointly for accomplishing the above tasks. We describe audio and visual features that can effectively characterize scene Content, present selected algorithms for segmentation and classification, and review some testbed systems for video archiving and retrieval. We also describe audio and visual descriptors and description schemes that are being considered by the MPEG-7 standard for Multimedia Content description.