Evaluation Methodology

14,000,000 Leading Edge Experts on the ideXlab platform

Scan Science and Technology

Contact Leading Edge Experts & Companies

Scan Science and Technology

Contact Leading Edge Experts & Companies

The Experts below are selected from a list of 356712 Experts worldwide ranked by ideXlab platform

Ioannis Pratikakis - One of the best experts on this subject based on the ideXlab platform.

  • performance Evaluation Methodology for historical document image binarization
    IEEE Transactions on Image Processing, 2013
    Co-Authors: Konstantinos Ntirogiannis, Basilis Gatos, Ioannis Pratikakis
    Abstract:

    Document image binarization is of great importance in the document image analysis and recognition pipeline since it affects further stages of the recognition process. The Evaluation of a binarization method aids in studying its algorithmic behavior, as well as verifying its effectiveness, by providing qualitative and quantitative indication of its performance. This paper addresses a pixel-based binarization Evaluation Methodology for historical handwritten/machine-printed document images. In the proposed Evaluation scheme, the recall and precision Evaluation measures are properly modified using a weighting scheme that diminishes any potential Evaluation bias. Additional performance metrics of the proposed Evaluation scheme consist of the percentage rates of broken and missed text, false alarms, background noise, character enlargement, and merging. Several experiments conducted in comparison with other pixel-based Evaluation measures demonstrate the validity of the proposed Evaluation scheme.

  • Performance Evaluation Methodology for document image dewarping techniques
    IET Image Processing, 2012
    Co-Authors: Nikolaos Stamatopoulos, Basilis Gatos, Ioannis Pratikakis
    Abstract:

    The performance Evaluation of dewarping techniques is currently addressed by concentrating in visual pleasing impressions or by using optical character recognition (OCR) as a means for indirect Evaluation. In this study, the authors present a performance Evaluation Methodology that calculates a comprehensive Evaluation measure which reflects the entire performance of a dewarping technique in a concise quantitative manner. The proposed Evaluation measure takes into account the deviation of the dewarped text lines from a horizontal straight reference which is considered to be the optimal result. This measure is expressed by the integral over the dewarped text line curves. To reduce the manual effort for identifying the text lines in the dewarped image, the authors propose a point-to-point matching procedure that finds the correspondence between the manually marked warped document image and the dewarping counterpart. This enables an Evaluation for unlimited number of methodologies addressing a marking procedure which is applied only once. The validity of the proposed performance Evaluation Methodology is demonstrated by a concise experimental work that comprises four state-of-the-art dewarping techniques as well as the involvement of different users in the interactive part of the procedure.

  • An Objective Evaluation Methodology for Document Image Binarization Techniques
    2008 The Eighth IAPR International Workshop on Document Analysis Systems, 2008
    Co-Authors: Konstantinos Ntirogiannis, Basilis Gatos, Ioannis Pratikakis
    Abstract:

    Evaluation of document image binarization techniques is a tedious task that is mainly performedby a human expert or by involving an OCR engine. This paper presents an objective Evaluation Methodology for document image binarization techniques that aims to reduce the human involvement in the ground truth construction and consecutive testing. A skeletonized ground truth image is produced by the user following a semi-automatic procedure. The estimated ground truth image can aid in evaluating the binarization result in terms of recall and precision as well as to further analyze the result by calculating broken and missing text, deformations and false alarms. A detailed description of the Methodology along with a benchmarking of the six (6) most promising state-of-the-art binarization algorithms based on the proposed Methodology is presented.

Basilis Gatos - One of the best experts on this subject based on the ideXlab platform.

  • ICDAR - Goal-Oriented Performance Evaluation Methodology for Page Segmentation Techniques
    2015 13th International Conference on Document Analysis and Recognition (ICDAR), 2015
    Co-Authors: Nikolaos Stamatopoulos, Georgios Louloudis, Basilis Gatos
    Abstract:

    Document image segmentation is a fundamental step in the document image analysis pipeline as it affects the accuracy of subsequent processing steps. An objective and realistic Evaluation of page segmentation techniques is crucial for a quantitative comparison among them. In this paper, a goal-oriented performance Evaluation Methodology that calculates a comprehensive Evaluation measure SR (Success Rate) is presented. SR measure reflects the entire performance of a page segmentation technique in a concise quantitative manner. It is a pixel-based approach which avoids the dependence on a strictly defined ground-truth. The proposed Evaluation measure SR deals only with text regions and is correlated with the percentage of the text information in which the subsequent processing (e.g. text line segmentation and recognition) can be applied successfully.

  • performance Evaluation Methodology for historical document image binarization
    IEEE Transactions on Image Processing, 2013
    Co-Authors: Konstantinos Ntirogiannis, Basilis Gatos, Ioannis Pratikakis
    Abstract:

    Document image binarization is of great importance in the document image analysis and recognition pipeline since it affects further stages of the recognition process. The Evaluation of a binarization method aids in studying its algorithmic behavior, as well as verifying its effectiveness, by providing qualitative and quantitative indication of its performance. This paper addresses a pixel-based binarization Evaluation Methodology for historical handwritten/machine-printed document images. In the proposed Evaluation scheme, the recall and precision Evaluation measures are properly modified using a weighting scheme that diminishes any potential Evaluation bias. Additional performance metrics of the proposed Evaluation scheme consist of the percentage rates of broken and missed text, false alarms, background noise, character enlargement, and merging. Several experiments conducted in comparison with other pixel-based Evaluation measures demonstrate the validity of the proposed Evaluation scheme.

  • Performance Evaluation Methodology for document image dewarping techniques
    IET Image Processing, 2012
    Co-Authors: Nikolaos Stamatopoulos, Basilis Gatos, Ioannis Pratikakis
    Abstract:

    The performance Evaluation of dewarping techniques is currently addressed by concentrating in visual pleasing impressions or by using optical character recognition (OCR) as a means for indirect Evaluation. In this study, the authors present a performance Evaluation Methodology that calculates a comprehensive Evaluation measure which reflects the entire performance of a dewarping technique in a concise quantitative manner. The proposed Evaluation measure takes into account the deviation of the dewarped text lines from a horizontal straight reference which is considered to be the optimal result. This measure is expressed by the integral over the dewarped text line curves. To reduce the manual effort for identifying the text lines in the dewarped image, the authors propose a point-to-point matching procedure that finds the correspondence between the manually marked warped document image and the dewarping counterpart. This enables an Evaluation for unlimited number of methodologies addressing a marking procedure which is applied only once. The validity of the proposed performance Evaluation Methodology is demonstrated by a concise experimental work that comprises four state-of-the-art dewarping techniques as well as the involvement of different users in the interactive part of the procedure.

  • An Objective Evaluation Methodology for Document Image Binarization Techniques
    2008 The Eighth IAPR International Workshop on Document Analysis Systems, 2008
    Co-Authors: Konstantinos Ntirogiannis, Basilis Gatos, Ioannis Pratikakis
    Abstract:

    Evaluation of document image binarization techniques is a tedious task that is mainly performedby a human expert or by involving an OCR engine. This paper presents an objective Evaluation Methodology for document image binarization techniques that aims to reduce the human involvement in the ground truth construction and consecutive testing. A skeletonized ground truth image is produced by the user following a semi-automatic procedure. The estimated ground truth image can aid in evaluating the binarization result in terms of recall and precision as well as to further analyze the result by calculating broken and missing text, deformations and false alarms. A detailed description of the Methodology along with a benchmarking of the six (6) most promising state-of-the-art binarization algorithms based on the proposed Methodology is presented.

P. Peterson - One of the best experts on this subject based on the ideXlab platform.

  • Proliferation Resistance and Physical Protection Evaluation Methodology Development and Applications
    2009
    Co-Authors: R. Bari, P. Peterson, I. Therios, J. Whitlock
    Abstract:

    An overview of the technical progress and accomplishments on the Evaluation Methodology for proliferation resistance and physical protection of Generation IV nuclear energy Systems.

  • Evaluation Methodology for proliferation resistance and physical protection of generation iv nuclear energy systems an overview
    International Conferene on Probabilistic Safety Assessment and Management New Orleans LA 05 14 2006 05 19 2006, 2006
    Co-Authors: T Bjornard, P. Peterson, Robert A Bari, R Nishimura, J Roglans, D Bley, J Cazalet, Giacomo G M Cojazzi, P Delaune, M Golay
    Abstract:

    This paper provides an overview of the Methodology approach developed by the Generation IV International Forum Expert Group on Proliferation Resistance & Physical Protection for Evaluation of Proliferation Resistance and Physical Protection robustness of Generation IV nuclear energy systems options. The Methodology considers a set of alternative systems and evaluates their resistance or robustness to a collection of potential threats. For the challenges considered, the response of the system to these challenges is assessed and expressed in terms of outcomes. The challenges to the system are given by the threats posed by potential proliferant States and sub-national adversaries on the nuclear systems. The characteristics of the Generation IV systems, both technical and institutional, are used to evaluate their response to the threats and determine their resistance against the proliferation threats and robustness against sabotage and theft threats. System response encompasses three main elements: (1) System Element Identification. The nuclear energy system is decomposed into smaller elements (subsystems) at a level amenable to further analysis. (2) Target Identification and Categorization. A systematic process is used to identify and select representative targets for different categories of pathways, within each system element, that actors (proliferant States or adversaries) might choose to use ormore » attack. (3) Pathway Identification and Refinement. Pathways are defined as potential sequences of events and actions followed by the proliferant State or adversary to achieve its objectives (proliferation, theft or sabotage). For each target, individual pathway segments are developed through a systematic process, analyzed at a high level, and screened where possible. Segments are connected into full pathways and analyzed in detail. The outcomes of the system response are expressed in terms of PR&PP measures. Measures are high-level characteristics of a pathway that include information important to the Evaluation Methodology users and to the decisions of a proliferant State or adversary. They are first evaluated for segments and then aggregated for complete pathways. Results are aggregated as appropriate to permit pathway comparisons and system assessment. The paper highlights the current achievements in the development of the Proliferation Resistance and Physical Protection Evaluation Methodology. The way forward is also briefly presented together with some conclusions.« less

Lei Jiang - One of the best experts on this subject based on the ideXlab platform.

  • Availability-Based Engineering Resilience Metric and Its Corresponding Evaluation Methodology
    Bayesian Networks for Reliability Engineering, 2020
    Co-Authors: Baoping Cai, Yuanjiang Chang, Zengkai Liu, Yonghong Liu, Lei Jiang
    Abstract:

    Several resilience metrics have been proposed for engineering systems (e.g., mechanical engineering, civil engineering, critical infrastructure, etc.); however, they are different from one another. Their difference is determined by the performances of the objects of Evaluation. This study proposes a new availability-based engineering resilience metric from the perspective of reliability engineering. Resilience is considered an intrinsic ability and an inherent attribute of an engineering system. Engineering system structure and maintenance resources are principal factors that affect resilience, which are integrated into the engineering resilience metric. A corresponding dynamic-Bayesian-network-based Evaluation Methodology is developed on the basis of the proposed resilience metric. The resilience value of an engineering system can be predicted using the proposed Methodology, which provides implementation guidance for engineering planning, design, operation, construction, and management. Some examples for common systems (i.e., series, parallel, and voting systems) and an actual application example (i.e., a nine-bus power grid system) are used to demonstrate the application of the proposed resilience metric and its corresponding Evaluation Methodology.

  • Reliability Evaluation Methodology of Complex Systems Based on Dynamic Object-Oriented Bayesian Networks
    Bayesian Networks for Reliability Engineering, 2020
    Co-Authors: Baoping Cai, Yuanjiang Chang, Zengkai Liu, Yonghong Liu, Lei Jiang
    Abstract:

    A novel reliability Evaluation Methodology of complex systems is proposed using dynamic object-oriented Bayesian networks (DOOBNs). This modeling Methodology consists of two main phases, namely construction phases for object-oriented Bayesian networks (OOBNs) and for DOOBNs. In the first phase, the network fragments with similar structures and parameters are divided into classes; these classes are then encapsulated. The construction of OOBNs is completed according to the relationship among the encapsulated classes. In the second phase, every fragment of the dynamic Bayesian networks (DBNs) that was constructed by the first phase is encapsulated as a class called DOOBN. The construction of DOOBNs is completed according to the relationship among the time fragments. The accuracy of this Methodology is validated using the all-series, all-voting, voting-after-series, series-after-voting, parallel-after-series, and series-after-parallel systems. This Methodology is further illustrated and verified by using deepwater blowout preventer system and can model the system from global to local levels, thereby effectively reducing modeling difficulty and adopting efficient arithmetic reasoning algorithms.

M Golay - One of the best experts on this subject based on the ideXlab platform.

  • Evaluation Methodology for proliferation resistance and physical protection of generation iv nuclear energy systems an overview
    International Conferene on Probabilistic Safety Assessment and Management New Orleans LA 05 14 2006 05 19 2006, 2006
    Co-Authors: T Bjornard, P. Peterson, Robert A Bari, R Nishimura, J Roglans, D Bley, J Cazalet, Giacomo G M Cojazzi, P Delaune, M Golay
    Abstract:

    This paper provides an overview of the Methodology approach developed by the Generation IV International Forum Expert Group on Proliferation Resistance & Physical Protection for Evaluation of Proliferation Resistance and Physical Protection robustness of Generation IV nuclear energy systems options. The Methodology considers a set of alternative systems and evaluates their resistance or robustness to a collection of potential threats. For the challenges considered, the response of the system to these challenges is assessed and expressed in terms of outcomes. The challenges to the system are given by the threats posed by potential proliferant States and sub-national adversaries on the nuclear systems. The characteristics of the Generation IV systems, both technical and institutional, are used to evaluate their response to the threats and determine their resistance against the proliferation threats and robustness against sabotage and theft threats. System response encompasses three main elements: (1) System Element Identification. The nuclear energy system is decomposed into smaller elements (subsystems) at a level amenable to further analysis. (2) Target Identification and Categorization. A systematic process is used to identify and select representative targets for different categories of pathways, within each system element, that actors (proliferant States or adversaries) might choose to use ormore » attack. (3) Pathway Identification and Refinement. Pathways are defined as potential sequences of events and actions followed by the proliferant State or adversary to achieve its objectives (proliferation, theft or sabotage). For each target, individual pathway segments are developed through a systematic process, analyzed at a high level, and screened where possible. Segments are connected into full pathways and analyzed in detail. The outcomes of the system response are expressed in terms of PR&PP measures. Measures are high-level characteristics of a pathway that include information important to the Evaluation Methodology users and to the decisions of a proliferant State or adversary. They are first evaluated for segments and then aggregated for complete pathways. Results are aggregated as appropriate to permit pathway comparisons and system assessment. The paper highlights the current achievements in the development of the Proliferation Resistance and Physical Protection Evaluation Methodology. The way forward is also briefly presented together with some conclusions.« less