The Experts below are selected from a list of 1158 Experts worldwide ranked by ideXlab platform

Joemon M. Jose - One of the best experts on this subject based on the ideXlab platform.

  • ACM Multimedia - Collaborative awareness in Multimedia Search
    Proceeding of the 16th ACM international conference on Multimedia - MM '08, 2008
    Co-Authors: Robert Villa, Nicholas Gildea, Joemon M. Jose
    Abstract:

    Awareness of another's activity is an important aspect of facilitating collaboration between users, enabling an "understanding of the activities of others" [1]. Many environments where Multimedia Search is required are collaborative in nature, such as when a group of artists and animators are engaged in the production of a Multimedia product. In this paper we introduce a study which used a novel evaluation methodology, where pairs of users competed to find the most relevant shots for a topic, with the aim of evaluating the role of awareness within an environment conductive to its use. Results based on event log and questionnaire data are reported, and conclusions presented illustrating some of the issues and pitfalls of using awareness in a video Search system.

  • a faceted interface for Multimedia Search
    International ACM SIGIR Conference on Research and Development in Information Retrieval, 2008
    Co-Authors: Robert Villa, Nicholas Gildea, Joemon M. Jose
    Abstract:

    With the rapid increase in online video services, video retrieval systems are becoming increasingly important Search tools to many users in many different fields. In this poster we present a novel video retrieval interface, which supports the creation of multiple Search "facets", to aid users carrying out complex, multi-faceted Search tasks. The interface allows multiple Searches to be executed and viewed simultaneously, and allows material to be reorganized between the facets. An experiment is presented which compares the faceted interface to a tabbed interface similar to that on modern web browsers, and some preliminary results are given.

  • SIGIR - A faceted interface for Multimedia Search
    Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '08, 2008
    Co-Authors: Robert Villa, Nicholas Gildea, Joemon M. Jose
    Abstract:

    With the rapid increase in online video services, video retrieval systems are becoming increasingly important Search tools to many users in many different fields. In this poster we present a novel video retrieval interface, which supports the creation of multiple Search "facets", to aid users carrying out complex, multi-faceted Search tasks. The interface allows multiple Searches to be executed and viewed simultaneously, and allows material to be reorganized between the facets. An experiment is presented which compares the faceted interface to a tabbed interface similar to that on modern web browsers, and some preliminary results are given.

  • a study of awareness in Multimedia Search
    ACM IEEE Joint Conference on Digital Libraries, 2008
    Co-Authors: Robert Villa, Nicholas Gildea, Joemon M. Jose
    Abstract:

    Awareness of another's activity is an important aspect of facilitating collaboration between users, enabling an "understanding of the activities of others"[1]. Techniques such as collaborative filtering enable a form of asynchronous awareness, providing recommendations generated from the past activity of a community of users. In this paper we investigate the role of awareness and its effect on Search behavior in collaborative Multimedia retrieval. We focus on the scenario where two users are Searching at the same time on the same task, and via the interface, can see the activity of the other user. The main reSearch question asks: does awareness of another Searcher aid a user when carrying out a Multimedia Search session? To encourage awareness, an experimental study was designed where two users were asked to find as many relevant video shots as possible under different awareness conditions. These were individual Search (no awareness of each other), mutual awareness (where both user's could see each other's Search screen), and unbalanced awareness (where one user is able to see the other's screen, but not vice-versa). Twelve pairs of users were recruited, and the four worst performing TRECVID 2006 Search topics were used as Search tasks, under four different awareness conditions. We present the results of this study, followed by a discussion of the implications for Multimedia digital library systems.

  • JCDL - A study of awareness in Multimedia Search
    Proceedings of the 8th ACM IEEE-CS joint conference on Digital libraries - JCDL '08, 2008
    Co-Authors: Robert Villa, Nicholas Gildea, Joemon M. Jose
    Abstract:

    Awareness of another's activity is an important aspect of facilitating collaboration between users, enabling an "understanding of the activities of others"[1]. Techniques such as collaborative filtering enable a form of asynchronous awareness, providing recommendations generated from the past activity of a community of users. In this paper we investigate the role of awareness and its effect on Search behavior in collaborative Multimedia retrieval. We focus on the scenario where two users are Searching at the same time on the same task, and via the interface, can see the activity of the other user. The main reSearch question asks: does awareness of another Searcher aid a user when carrying out a Multimedia Search session? To encourage awareness, an experimental study was designed where two users were asked to find as many relevant video shots as possible under different awareness conditions. These were individual Search (no awareness of each other), mutual awareness (where both user's could see each other's Search screen), and unbalanced awareness (where one user is able to see the other's screen, but not vice-versa). Twelve pairs of users were recruited, and the four worst performing TRECVID 2006 Search topics were used as Search tasks, under four different awareness conditions. We present the results of this study, followed by a discussion of the implications for Multimedia digital library systems.

Hongjiang Zhang - One of the best experts on this subject based on the ideXlab platform.

  • Multimedia content analysis and Search new perspectives and approaches
    ACM Multimedia, 2009
    Co-Authors: Hongjiang Zhang
    Abstract:

    After 15 years of extensive reSearch, Multimedia retrieval has finally come to its prime time when everything becomes accessible on the web. However, web Search provides both a new paradigm and poses a new challenge to the Multimedia retrieval reSearch community. It calls for a rethinking of the traditional content-based approaches, especially in how to make use of the massive yet noisy meta data associated with the web pages and links. In this talk, we will first review some familiar approaches in content-based Multimedia retrieval. Then, we will present a set of efforts in web Multimedia Search to illustrate interesting new thoughts that potentially will lead to new breakthroughs in Multimedia Search and stimulate new reSearch ideas.

  • ACM Multimedia - Multimedia content analysis and Search: new perspectives and approaches
    Proceedings of the seventeen ACM international conference on Multimedia - MM '09, 2009
    Co-Authors: Hongjiang Zhang
    Abstract:

    After 15 years of extensive reSearch, Multimedia retrieval has finally come to its prime time when everything becomes accessible on the web. However, web Search provides both a new paradigm and poses a new challenge to the Multimedia retrieval reSearch community. It calls for a rethinking of the traditional content-based approaches, especially in how to make use of the massive yet noisy meta data associated with the web pages and links. In this talk, we will first review some familiar approaches in content-based Multimedia retrieval. Then, we will present a set of efforts in web Multimedia Search to illustrate interesting new thoughts that potentially will lead to new breakthroughs in Multimedia Search and stimulate new reSearch ideas.

  • MMSP - Multimedia Search: Past and current approaches
    2008 IEEE 10th Workshop on Multimedia Signal Processing, 2008
    Co-Authors: Hongjiang Zhang
    Abstract:

    Summary form only given. After 15 years of extensive reSearch efforts, Multimedia retrieval has final come to its prime time when everything becomes accessible on the Web. However, Web Search both provides a new paradigm and poses challenge to Multimedia retrieval reSearch. It calls for a rethinking of the traditional content-based approaches, especially in how to make use the massive but noisy meta-data associated with Web pages and links. In this talk, we will first review some familiar approaches in content-based Multimedia retrieval and examine their limits. We will then present a few new efforts in web Multimedia Search to illustrate some new thoughts in this space.

  • Multimedia Search: Past and current approaches
    2008 IEEE 10th Workshop on Multimedia Signal Processing, 2008
    Co-Authors: Hongjiang Zhang
    Abstract:

    Summary form only given. After 15 years of extensive reSearch efforts, Multimedia retrieval has final come to its prime time when everything becomes accessible on the Web. However, Web Search both provides a new paradigm and poses challenge to Multimedia retrieval reSearch. It calls for a rethinking of the traditional content-based approaches, especially in how to make use the massive but noisy meta-data associated with Web pages and links. In this talk, we will first review some familiar approaches in content-based Multimedia retrieval and examine their limits. We will then present a few new efforts in web Multimedia Search to illustrate some new thoughts in this space.

Robert Villa - One of the best experts on this subject based on the ideXlab platform.

  • ACM Multimedia - Collaborative awareness in Multimedia Search
    Proceeding of the 16th ACM international conference on Multimedia - MM '08, 2008
    Co-Authors: Robert Villa, Nicholas Gildea, Joemon M. Jose
    Abstract:

    Awareness of another's activity is an important aspect of facilitating collaboration between users, enabling an "understanding of the activities of others" [1]. Many environments where Multimedia Search is required are collaborative in nature, such as when a group of artists and animators are engaged in the production of a Multimedia product. In this paper we introduce a study which used a novel evaluation methodology, where pairs of users competed to find the most relevant shots for a topic, with the aim of evaluating the role of awareness within an environment conductive to its use. Results based on event log and questionnaire data are reported, and conclusions presented illustrating some of the issues and pitfalls of using awareness in a video Search system.

  • a faceted interface for Multimedia Search
    International ACM SIGIR Conference on Research and Development in Information Retrieval, 2008
    Co-Authors: Robert Villa, Nicholas Gildea, Joemon M. Jose
    Abstract:

    With the rapid increase in online video services, video retrieval systems are becoming increasingly important Search tools to many users in many different fields. In this poster we present a novel video retrieval interface, which supports the creation of multiple Search "facets", to aid users carrying out complex, multi-faceted Search tasks. The interface allows multiple Searches to be executed and viewed simultaneously, and allows material to be reorganized between the facets. An experiment is presented which compares the faceted interface to a tabbed interface similar to that on modern web browsers, and some preliminary results are given.

  • SIGIR - A faceted interface for Multimedia Search
    Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '08, 2008
    Co-Authors: Robert Villa, Nicholas Gildea, Joemon M. Jose
    Abstract:

    With the rapid increase in online video services, video retrieval systems are becoming increasingly important Search tools to many users in many different fields. In this poster we present a novel video retrieval interface, which supports the creation of multiple Search "facets", to aid users carrying out complex, multi-faceted Search tasks. The interface allows multiple Searches to be executed and viewed simultaneously, and allows material to be reorganized between the facets. An experiment is presented which compares the faceted interface to a tabbed interface similar to that on modern web browsers, and some preliminary results are given.

  • a study of awareness in Multimedia Search
    ACM IEEE Joint Conference on Digital Libraries, 2008
    Co-Authors: Robert Villa, Nicholas Gildea, Joemon M. Jose
    Abstract:

    Awareness of another's activity is an important aspect of facilitating collaboration between users, enabling an "understanding of the activities of others"[1]. Techniques such as collaborative filtering enable a form of asynchronous awareness, providing recommendations generated from the past activity of a community of users. In this paper we investigate the role of awareness and its effect on Search behavior in collaborative Multimedia retrieval. We focus on the scenario where two users are Searching at the same time on the same task, and via the interface, can see the activity of the other user. The main reSearch question asks: does awareness of another Searcher aid a user when carrying out a Multimedia Search session? To encourage awareness, an experimental study was designed where two users were asked to find as many relevant video shots as possible under different awareness conditions. These were individual Search (no awareness of each other), mutual awareness (where both user's could see each other's Search screen), and unbalanced awareness (where one user is able to see the other's screen, but not vice-versa). Twelve pairs of users were recruited, and the four worst performing TRECVID 2006 Search topics were used as Search tasks, under four different awareness conditions. We present the results of this study, followed by a discussion of the implications for Multimedia digital library systems.

  • JCDL - A study of awareness in Multimedia Search
    Proceedings of the 8th ACM IEEE-CS joint conference on Digital libraries - JCDL '08, 2008
    Co-Authors: Robert Villa, Nicholas Gildea, Joemon M. Jose
    Abstract:

    Awareness of another's activity is an important aspect of facilitating collaboration between users, enabling an "understanding of the activities of others"[1]. Techniques such as collaborative filtering enable a form of asynchronous awareness, providing recommendations generated from the past activity of a community of users. In this paper we investigate the role of awareness and its effect on Search behavior in collaborative Multimedia retrieval. We focus on the scenario where two users are Searching at the same time on the same task, and via the interface, can see the activity of the other user. The main reSearch question asks: does awareness of another Searcher aid a user when carrying out a Multimedia Search session? To encourage awareness, an experimental study was designed where two users were asked to find as many relevant video shots as possible under different awareness conditions. These were individual Search (no awareness of each other), mutual awareness (where both user's could see each other's Search screen), and unbalanced awareness (where one user is able to see the other's screen, but not vice-versa). Twelve pairs of users were recruited, and the four worst performing TRECVID 2006 Search topics were used as Search tasks, under four different awareness conditions. We present the results of this study, followed by a discussion of the implications for Multimedia digital library systems.

Heng Tao Shen - One of the best experts on this subject based on the ideXlab platform.

  • Efficient Supervised Discrete Multi-View Hashing for Large-Scale Multimedia Search
    IEEE Transactions on Multimedia, 2020
    Co-Authors: Xu Lu, Jingjing Li, Huaxiang Zhang, Heng Tao Shen
    Abstract:

    Hashing has recently received substantial attention in large-scale Multimedia Search for its extremely low-cost storage cost and high retrieval efficiency. However, most existing hashing techniques focus on learning hash codes for single-view or cross-view retrieval. It is still an unsolved problem that how to efficiently learn discriminative binary codes for multi-view data that is common in real world Multimedia Search. In this paper, we propose an efficient Supervised Discrete Multi-view Hashing (SDMH) to solve the problem. SDMH first properly detects the shared binary hash codes, with an integrated multi-view feature mapping and latent hash coding, by exploiting the complementarity of different view-specific features and removing the involved inter-view redundancy. To further enhance the discriminative capability of hash codes, SDMH directly represses the explicit semantic labels of data samples with their corresponding binary codes. Different from most existing multi-view hashing methods that adopt “relaxing+rounding” hash optimization strategy or the discrete optimization method based on discrete cyclic coordinate descent, an efficient augmented Lagrangian multiplier (ALM) based discrete hash optimization method is developed in this paper to optimize the hash codes within a single step. Experimental results on four benchmark datasets demonstrate the superior performance of the proposed approach over state-of-the-art hashing techniques, in terms of both learning efficiency and retrieval accuracy.

  • ACM Multimedia - Linear cross-modal hashing for efficient Multimedia Search
    Proceedings of the 21st ACM international conference on Multimedia - MM '13, 2013
    Co-Authors: Zi Huang, Heng Tao Shen, Xin Zhao
    Abstract:

    Most existing cross-modal hashing methods suffer from the scalability issue in the training phase. In this paper, we propose a novel cross-modal hashing approach with a linear time complexity to the training data size, to enable scalable indexing for Multimedia Search across multiple modals. Taking both the intra-similarity in each modal and the inter-similarity across different modals into consideration, the proposed approach aims at effectively learning hash functions from large-scale training datasets. More specifically, for each modal, we first partition the training data into $k$ clusters and then represent each training data point with its distances to $k$ centroids of the clusters. Interestingly, such a k-dimensional data representation can reduce the time complexity of the training phase from traditional O(n2) or higher to O(n), where $n$ is the training data size, leading to practical learning on large-scale datasets. We further prove that this new representation preserves the intra-similarity in each modal. To preserve the inter-similarity among data points across different modals, we transform the derived data representations into a common binary subspace in which binary codes from all the modals are "consistent" and comparable. nThe transformation simultaneously outputs the hash functions for all modals, which are used to convert unseen data into binary codes. Given a query of one modal, it is first mapped into the binary codes using the modal's hash functions, followed by matching the database binary codes of any other modals. Experimental results on two benchmark datasets confirm the scalability and the effectiveness of the proposed approach in comparison with the state of the art.

  • linear cross modal hashing for efficient Multimedia Search
    ACM Multimedia, 2013
    Co-Authors: Zi Huang, Heng Tao Shen, Xin Zhao
    Abstract:

    Most existing cross-modal hashing methods suffer from the scalability issue in the training phase. In this paper, we propose a novel cross-modal hashing approach with a linear time complexity to the training data size, to enable scalable indexing for Multimedia Search across multiple modals. Taking both the intra-similarity in each modal and the inter-similarity across different modals into consideration, the proposed approach aims at effectively learning hash functions from large-scale training datasets. More specifically, for each modal, we first partition the training data into $k$ clusters and then represent each training data point with its distances to $k$ centroids of the clusters. Interestingly, such a k-dimensional data representation can reduce the time complexity of the training phase from traditional O(n2) or higher to O(n), where $n$ is the training data size, leading to practical learning on large-scale datasets. We further prove that this new representation preserves the intra-similarity in each modal. To preserve the inter-similarity among data points across different modals, we transform the derived data representations into a common binary subspace in which binary codes from all the modals are "consistent" and comparable. nThe transformation simultaneously outputs the hash functions for all modals, which are used to convert unseen data into binary codes. Given a query of one modal, it is first mapped into the binary codes using the modal's hash functions, followed by matching the database binary codes of any other modals. Experimental results on two benchmark datasets confirm the scalability and the effectiveness of the proposed approach in comparison with the state of the art.

  • sparse hashing for fast Multimedia Search
    ACM Transactions on Information Systems, 2013
    Co-Authors: Zi Huang, Hong Cheng, Heng Tao Shen
    Abstract:

    Hash-based methods achieve fast similarity Search by representing high-dimensional data with compact binary codes. However, both generating binary codes and encoding unseen data effectively and efficiently remain very challenging tasks. In this article, we focus on these tasks to implement approximate similarity Search by proposing a novel hash based method named sparse hashing (SH for short). To generate interpretable (or semantically meaningful) binary codes, the proposed SH first converts original data into low-dimensional data through a novel nonnegative sparse coding method. SH then converts the low-dimensional data into Hamming space (i.e., binary encoding low-dimensional data) by a new binarization rule. After this, training data are represented by generated binary codes. To efficiently and effectively encode unseen data, SH learns hash functions by taking a-priori knowledge into account, such as implicit group effect of the features in training data, and the correlations between original space and the learned Hamming space. SH is able to perform fast approximate similarity Search by efficient bit XOR operations in the memory of a modern PC with short binary code representations. Experimental results show that the proposed SH significantly outperforms state-of-the-art techniques.

Amanda Spink - One of the best experts on this subject based on the ideXlab platform.

  • Multimedia Search capabilities of Chinese language Search engines
    2020
    Co-Authors: Yun-ke Chang, Miguel A. Morales-arroyo, Amanda Spink
    Abstract:

    This paper reports results from a study exploring the Multimedia Search functionality of Chinese language Search engines. Web Searching in Chinese (Mandarin) is a growing reSearch area and a technical challenge for popular commercial Web Search engines. Few studies have been conducted on Chinese language Search engines. We investigate two reSearch questions: which Chinese language Search engines provide Multimedia Searching, and what Multimedia Search functionalities are available in Chinese language Web Search engines. Specifically, we examine each Web Search engine's (1) features permitting Chinese language Multimedia Searches, (2) extent of Search personalization and user control of Multimedia Search variables, and (3) the relationships between Web Search engines and their features in the Chinese context. Key findings show that Chinese language Web Search engines offer limited Multimedia Search functionality, and general Search engines provide a wider range of features than specialized Multimedia Search engines. Study results have implications for Chinese Web users, Website designers and Web Search engine developers. © 2009 Elsevier Ltd. All rights reserved.

  • Multimedia Search capabilities of Chinese language Search engines
    Information Processing and Management, 2010
    Co-Authors: Yun-ke Chang, Miguel A. Morales-arroyo, Amanda Spink
    Abstract:

    This paper reports results from a study exploring the Multimedia Search functionality of Chinese language Search engines. Web Searching in Chinese (Mandarin) is a growing reSearch area and a technical challenge for popular commercial Web Search engines. Few studies have been conducted on Chinese language Search engines. We investigate two reSearch questions: which Chinese language Search engines provide Multimedia Searching, and what Multimedia Search functionalities are available in Chinese language Web Search engines. Specifically, we examine each Web Search engine's (1) features permitting Chinese language Multimedia Searches, (2) extent of Search personalization and user control of Multimedia Search variables, and (3) the relationships between Web Search engines and their features in the Chinese context. Key findings show that Chinese language Web Search engines offer limited Multimedia Search functionality, and general Search engines provide a wider range of features than specialized Multimedia Search engines. Study results have implications for Chinese Web users, Website designers and Web Search engine developers.

  • web Search engine Multimedia functionality
    Faculty of Science and Technology; Institute for Creative Industries and Innovation, 2008
    Co-Authors: Dian Tjondronegoro, Amanda Spink
    Abstract:

    Web Search engines are beginning to offer access to Multimedia Searching, including audio, video and image Searching. In this paper we report findings from a study examining the state of Multimedia Search functionality on major general and specialized Web Search engines. We investigated 102 Web Search engines to examine: (1) how many Web Search engines offer Multimedia Searching, (2) the type of Multimedia Search functionality and methods offered, such as "query by example", and (3) the supports for personalization or customization which are accessible as advanced Search. Findings include: (1) few major Web Search engines offer Multimedia Searching and (2) Multimedia Web Search functionality is generally limited. Our findings show that despite the increasing level of interest in Multimedia Web Search, those few Web Search engines offering Multimedia Web Search, provide limited Multimedia Search functionality. Keywords are still the only means of Multimedia retrieval, while other methods such as "query by example" are offered by less than 1% of Web Search engines examined.

  • Multimedia Chinese Web Search Engines: A Survey
    Fourth International Conference on Information Technology (ITNG'07), 2007
    Co-Authors: Yun-ke Chang, Amanda Spink
    Abstract:

    The objective of this paper is to explore the state of Multimedia Search functionality on major general and dedicated Web Search engines in Chinese language. The authors studied: a) how many Chinese Web Search engines presently make use of Multimedia Searching, and b) the type of Multimedia Search functionality available. Specifically, the following were examined: a) Multimedia features - features allowing Multimedia Search; and b) extent of personalization - the extent to which a Search engine Web site allows users to control Multimedia Search. Overall, Chinese Web Search engines offer limited Multimedia Searching functionality. The significance of the study is based on two factors: a) little reSearch has been conducted on Chinese Web Search engines, and b) the instrument used in the study and the results obtained by this reSearch could help users, Web designers, and Web Search engine developers. By large, general Web Search engines support more Multimedia features than specialized ones

  • ITNG - Multimedia Chinese Web Search Engines: A Survey
    Fourth International Conference on Information Technology (ITNG'07), 2007
    Co-Authors: Yun-ke Chang, M.a.m. Arroyo, Amanda Spink
    Abstract:

    The objective of this paper is to explore the state of Multimedia Search functionality on major general and dedicated Web Search engines in Chinese language. The authors studied: a) how many Chinese Web Search engines presently make use of Multimedia Searching, and b) the type of Multimedia Search functionality available. Specifically, the following were examined: a) Multimedia features - features allowing Multimedia Search; and b) extent of personalization - the extent to which a Search engine Web site allows users to control Multimedia Search. Overall, Chinese Web Search engines offer limited Multimedia Searching functionality. The significance of the study is based on two factors: a) little reSearch has been conducted on Chinese Web Search engines, and b) the instrument used in the study and the results obtained by this reSearch could help users, Web designers, and Web Search engine developers. By large, general Web Search engines support more Multimedia features than specialized ones