Subjective Test

14,000,000 Leading Edge Experts on the ideXlab platform

Scan Science and Technology

Contact Leading Edge Experts & Companies

Scan Science and Technology

Contact Leading Edge Experts & Companies

The Experts below are selected from a list of 87489 Experts worldwide ranked by ideXlab platform

Honggoo Kang - One of the best experts on this subject based on the ideXlab platform.

  • improved time frequency trajectory excitation modeling for a statistical parametric speech synthesis system
    International Conference on Acoustics Speech and Signal Processing, 2015
    Co-Authors: Eunwoo Song, Honggoo Kang
    Abstract:

    This paper proposes an improved time-frequency trajectory excitation (TFTE) modeling method for a statistical parametric speech synthesis system. The proposed approach overcomes the dimensional variation problem of the training process caused by the inherent nature of the pitch-dependent analysis paradigm. By reducing the redundancies of the parameters using predicted average block coefficients (PABC), the proposed algorithm efficiently models excitation, even if its dimension is varied. Objective and Subjective Test results verify that the proposed algorithm provides not only robustness to the training process but also naturalness to the synthesized speech.

  • ICASSP - Improved time-frequency trajectory excitation modeling for a statistical parametric speech synthesis system
    2015 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP), 2015
    Co-Authors: Eunwoo Song, Honggoo Kang
    Abstract:

    This paper proposes an improved time-frequency trajectory excitation (TFTE) modeling method for a statistical parametric speech synthesis system. The proposed approach overcomes the dimensional variation problem of the training process caused by the inherent nature of the pitch-dependent analysis paradigm. By reducing the redundancies of the parameters using predicted average block coefficients (PABC), the proposed algorithm efficiently models excitation, even if its dimension is varied. Objective and Subjective Test results verify that the proposed algorithm provides not only robustness to the training process but also naturalness to the synthesized speech.

Eunwoo Song - One of the best experts on this subject based on the ideXlab platform.

  • improved time frequency trajectory excitation modeling for a statistical parametric speech synthesis system
    International Conference on Acoustics Speech and Signal Processing, 2015
    Co-Authors: Eunwoo Song, Honggoo Kang
    Abstract:

    This paper proposes an improved time-frequency trajectory excitation (TFTE) modeling method for a statistical parametric speech synthesis system. The proposed approach overcomes the dimensional variation problem of the training process caused by the inherent nature of the pitch-dependent analysis paradigm. By reducing the redundancies of the parameters using predicted average block coefficients (PABC), the proposed algorithm efficiently models excitation, even if its dimension is varied. Objective and Subjective Test results verify that the proposed algorithm provides not only robustness to the training process but also naturalness to the synthesized speech.

  • ICASSP - Improved time-frequency trajectory excitation modeling for a statistical parametric speech synthesis system
    2015 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP), 2015
    Co-Authors: Eunwoo Song, Honggoo Kang
    Abstract:

    This paper proposes an improved time-frequency trajectory excitation (TFTE) modeling method for a statistical parametric speech synthesis system. The proposed approach overcomes the dimensional variation problem of the training process caused by the inherent nature of the pitch-dependent analysis paradigm. By reducing the redundancies of the parameters using predicted average block coefficients (PABC), the proposed algorithm efficiently models excitation, even if its dimension is varied. Objective and Subjective Test results verify that the proposed algorithm provides not only robustness to the training process but also naturalness to the synthesized speech.

Margaret Helen Pinson - One of the best experts on this subject based on the ideXlab platform.

  • Evaluating experiment design with unrepeated scenes for video quality Subjective assessment
    Quality and User Experience, 2019
    Co-Authors: Lucjan Janowski, Ludovic Malfait, Margaret Helen Pinson
    Abstract:

    The conventional video Subjective Test design, in which subjects view and rate multiple versions of each source video sequence, was used for decades. New technology, like adaptive streaming, makes it almost impossible to use this design since much longer sequences are needed. In this paper we examine three experiment designs: the conventional design and two alternatives that use each source sequence only once. Based on data collected by three laboratories, we compare the accuracy and scoring behavior of these three designs. We check whether there is a significant difference in scoring behavior between the experiment designs. One of the proposed experiment designs is proposed for immediate use.

  • video quality assessment Subjective Testing of entertainment scenes
    IEEE Signal Processing Magazine, 2015
    Co-Authors: Margaret Helen Pinson, Lucjan Janowski, Zdzislaw Papir
    Abstract:

    This article describes how to perform a video quality Subjective Test. For companies, these Tests can greatly facilitate video product development; for universities, removing perceived barriers to conducting such Tests allows expanded research opportunities. This tutorial assumes no prior knowledge and focuses on proven techniques.

  • a new method for immersive audiovisual Subjective Testing
    2014
    Co-Authors: Margaret Helen Pinson
    Abstract:

    An immersive Subjective Test method is proposed in which subjects view each source stimulus only once. In order to encourage a subject’s engagement with Test content, longer stimuli are used. Distractor questions are used in addition to the traditional MOS scale in order to focus the subject on the intended application. A speech quality experiment is conducted with this method, and the results compared to those obtained with traditional methods. The consistent rank ordering among datasets demonstrates the validity of the immersive method.

  • the influence of subjects and environment on audiovisual Subjective Tests an international study
    IEEE Journal of Selected Topics in Signal Processing, 2012
    Co-Authors: Margaret Helen Pinson, Romuald Pepion, Quan Huynhthu, C Schmidmer, Audrey C Younkin, Le P Callet, Lucjan Janowski, Philip J Corriveau, Marcus Barkowsky, William Ingram
    Abstract:

    Traditionally, audio quality and video quality are evaluated separately in Subjective Tests. Best practices within the quality assessment community were developed before many modern mobile audiovisual devices and services came into use, such as internet video, smart phones, tablets and connected televisions. These devices and services raise unique questions that require jointly evaluating both the audio and the video within a Subjective Test. However, audiovisual Subjective Testing is a relatively under-explored field. In this paper, we address the question of determining the most suitable way to conduct audiovisual Subjective Testing on a wide range of audiovisual quality. Six laboratories from four countries conducted a systematic study of audiovisual Subjective Testing. The stimuli and scale were held constant across experiments and labs; only the environment of the Subjective Test was varied. Some Subjective Tests were conducted in controlled environments and some in public environments (a cafeteria, patio or hallway). The audiovisual stimuli spanned a wide range of quality. Results show that these audiovisual Subjective Tests were highly repeatable from one laboratory and environment to the next. The number of subjects was the most important factor. Based on this experiment, 24 or more subjects are recommended for Absolute Category Rating (ACR) Tests. In public environments, 35 subjects were required to obtain the same Student's t-Test sensitivity. The second most important variable was individual differences between subjects. Other environmental factors had minimal impact, such as language, country, lighting, background noise, wall color, and monitor calibration. Analyses indicate that Mean Opinion Scores (MOS) are relative rather than absolute. Our analyses show that the results of experiments done in pristine, laboratory environments are highly representative of those devices in actual use, in a typical user environment.

Lucjan Janowski - One of the best experts on this subject based on the ideXlab platform.

  • Evaluating experiment design with unrepeated scenes for video quality Subjective assessment
    Quality and User Experience, 2019
    Co-Authors: Lucjan Janowski, Ludovic Malfait, Margaret Helen Pinson
    Abstract:

    The conventional video Subjective Test design, in which subjects view and rate multiple versions of each source video sequence, was used for decades. New technology, like adaptive streaming, makes it almost impossible to use this design since much longer sequences are needed. In this paper we examine three experiment designs: the conventional design and two alternatives that use each source sequence only once. Based on data collected by three laboratories, we compare the accuracy and scoring behavior of these three designs. We check whether there is a significant difference in scoring behavior between the experiment designs. One of the proposed experiment designs is proposed for immediate use.

  • video quality assessment Subjective Testing of entertainment scenes
    IEEE Signal Processing Magazine, 2015
    Co-Authors: Margaret Helen Pinson, Lucjan Janowski, Zdzislaw Papir
    Abstract:

    This article describes how to perform a video quality Subjective Test. For companies, these Tests can greatly facilitate video product development; for universities, removing perceived barriers to conducting such Tests allows expanded research opportunities. This tutorial assumes no prior knowledge and focuses on proven techniques.

  • Subjective and objective evaluation of an audiovisual Subjective dataset for research and development
    2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX), 2013
    Co-Authors: Margaret H. Pinson, Romuald Pepion, C Schmidmer, Audrey C Younkin, Patrick Le Callet, Lucjan Janowski, Philip J Corriveau, Marcus Barkowsky, Quan Huynh-thu, William Ingram
    Abstract:

    In 2011, the Video Quality Experts Group (VQEG) ran subjects through the same audiovisual Subjective Test at six different international laboratories. That small dataset is now publically available for research and development purposes.

  • the influence of subjects and environment on audiovisual Subjective Tests an international study
    IEEE Journal of Selected Topics in Signal Processing, 2012
    Co-Authors: Margaret Helen Pinson, Romuald Pepion, Quan Huynhthu, C Schmidmer, Audrey C Younkin, Le P Callet, Lucjan Janowski, Philip J Corriveau, Marcus Barkowsky, William Ingram
    Abstract:

    Traditionally, audio quality and video quality are evaluated separately in Subjective Tests. Best practices within the quality assessment community were developed before many modern mobile audiovisual devices and services came into use, such as internet video, smart phones, tablets and connected televisions. These devices and services raise unique questions that require jointly evaluating both the audio and the video within a Subjective Test. However, audiovisual Subjective Testing is a relatively under-explored field. In this paper, we address the question of determining the most suitable way to conduct audiovisual Subjective Testing on a wide range of audiovisual quality. Six laboratories from four countries conducted a systematic study of audiovisual Subjective Testing. The stimuli and scale were held constant across experiments and labs; only the environment of the Subjective Test was varied. Some Subjective Tests were conducted in controlled environments and some in public environments (a cafeteria, patio or hallway). The audiovisual stimuli spanned a wide range of quality. Results show that these audiovisual Subjective Tests were highly repeatable from one laboratory and environment to the next. The number of subjects was the most important factor. Based on this experiment, 24 or more subjects are recommended for Absolute Category Rating (ACR) Tests. In public environments, 35 subjects were required to obtain the same Student's t-Test sensitivity. The second most important variable was individual differences between subjects. Other environmental factors had minimal impact, such as language, country, lighting, background noise, wall color, and monitor calibration. Analyses indicate that Mean Opinion Scores (MOS) are relative rather than absolute. Our analyses show that the results of experiments done in pristine, laboratory environments are highly representative of those devices in actual use, in a typical user environment.

Zdzislaw Papir - One of the best experts on this subject based on the ideXlab platform.