Interrater Reliability

14,000,000 Leading Edge Experts on the ideXlab platform

Scan Science and Technology

Contact Leading Edge Experts & Companies

Scan Science and Technology

Contact Leading Edge Experts & Companies

The Experts below are selected from a list of 327 Experts worldwide ranked by ideXlab platform

Nayak L Polissar - One of the best experts on this subject based on the ideXlab platform.

  • Interrater Reliability of posture observations
    Human Factors, 2009
    Co-Authors: Ninica Howard, Peregrin Spielholz, Barbara Silverstein, Nayak L Polissar
    Abstract:

    Objective: The aims of this research were (a) to study the Interrater Reliability of a posture observation method, (b) to test the impact of different posture categorization systems on Interrater Reliability, and (c) to provide guidelines for improving Interrater Reliability. Background: Estimation of posture through observation is challenging. Previous studies have shown varying degrees of validity and Reliability, providing little information about conditions necessary to achieve acceptable Reliability. Method: Seven raters estimated posture angles from video recordings. Different measures of Interrater Reliability, including percentage agreement, precision, expression as Interrater standard deviation, and intraclass correlation coefficients (ICC), were computed. Results: Some posture parameters, such as the upper arm flexion and extension, had ICCs ≥ 0.50. Most posture parameters had a precision around the 10° range. The predefined categorization and 30° posture categorization strategies showed substan...

Ninica Howard - One of the best experts on this subject based on the ideXlab platform.

  • Interrater Reliability of posture observations
    Human Factors, 2009
    Co-Authors: Ninica Howard, Peregrin Spielholz, Barbara Silverstein, Nayak L Polissar
    Abstract:

    Objective: The aims of this research were (a) to study the Interrater Reliability of a posture observation method, (b) to test the impact of different posture categorization systems on Interrater Reliability, and (c) to provide guidelines for improving Interrater Reliability. Background: Estimation of posture through observation is challenging. Previous studies have shown varying degrees of validity and Reliability, providing little information about conditions necessary to achieve acceptable Reliability. Method: Seven raters estimated posture angles from video recordings. Different measures of Interrater Reliability, including percentage agreement, precision, expression as Interrater standard deviation, and intraclass correlation coefficients (ICC), were computed. Results: Some posture parameters, such as the upper arm flexion and extension, had ICCs ≥ 0.50. Most posture parameters had a precision around the 10° range. The predefined categorization and 30° posture categorization strategies showed substan...

Theo Dassen - One of the best experts on this subject based on the ideXlab platform.

  • a systematic review of Interrater Reliability of pressure ulcer classification systems
    Journal of Clinical Nursing, 2009
    Co-Authors: Jan Kottner, Ruud J G Halfens, Kathrin Raeder, Theo Dassen
    Abstract:

    Aims.  To review systematically the Interrater Reliability of pressure ulcer classification systems to find out which classification should be used in daily practice. Background.  Pressure ulcer classification systems are important tools in research and practice. They aim at providing accurate and precise communication, documentation and treatment decisions. Pressure ulcer classifications are criticised for their low degree of Interrater Reliability. Design.  Systematic review. Methods.  The data bases MEDLINE, EMBASE, CINAHL and the World Wide Web were searched. Original research studies estimating Interrater Reliability of pressure ulcer classification systems were included. Study selection, data extraction and quality assessment was conducted independently by two reviewers. Results.  Twenty-four out of 339 potentially relevant studies were included in the final data synthesis. Due to the heterogeneity of the studies a meaningful comparison was impossible. Conclusions.  There is at present not enough evidence to recommend a specific pressure ulcer classification system for use in daily practice. Interrater Reliability studies are required, in which comparable raters apply different pressure ulcer classification systems to comparable samples. Relevance to clinical practice.  It is necessary to determine the Interrater Reliability of pressure ulcer classifications among all users in clinical practice. If Interrater Reliability is low the use of those systems is questionable. On the basis of this review there are no recommendations as to which system is to be given preference.

  • an Interrater Reliability study of the braden scale in two nursing homes
    International Journal of Nursing Studies, 2008
    Co-Authors: Jan Kottner, Theo Dassen
    Abstract:

    Abstract Background Adequate risk assessment is essential in pressure ulcer prevention. Assessment scales were designed to support practitioners in identifying persons at pressure ulcer risk. The Braden scale is one of the most extensively studied risk assessment instruments, although the majority of studies focused on validity rather than Reliability. Objectives The first aim was to measure the Interrater Reliability of the Braden scale and its individual items. The second aim was to study different statistical approaches regarding Interrater Reliability estimation. Design and methods An Interrater Reliability study was conducted in two German nursing homes. Residents ( n =152) from 8 units were assessed twice. The raters were trained nurses with a work experience ranging from 0.5 to 30 years. Data were analysed using an overall percentage of agreement, weighted and unweighted kappa and the intraclass correlation coefficient. Results Differences between nurses rating the overall Braden score ranged from 0 up to 9 points. Interrater Reliability expressed by the intraclass correlation coefficient ranged from 0.73 (95% CI 0.26–0.91) to 0.95 (95% CI 0.87–0.98). Calculated intraclass correlation coefficients for individual items ranged from 0.06 (95% CI −0.31 to 0.48) to 0.97 (95% CI 0.93–0.99) with the lowest values being measured for the items "sensory perception" and "nutrition". There was no association between work experience and the level of Interrater Reliability. With two exceptions, simple kappa-values were always lower than weighted kappa-values and intraclass correlation coefficients. Conclusions Although the calculated Interrater Reliability coefficients for the total Braden score were high in some cases, several clinically relevant differences occurred between the nurses. Due to Interrater Reliability being very low for the items "sensory perception" and "nutrition", it is doubtful if their assessment contributes to any valid results. The calculation of weighted kappa or intraclass correlation coefficients is the most appropriate Interrater Reliability estimates.

  • Interpreting Interrater Reliability coefficients of the Braden scale: a discussion paper.
    International Journal of Nursing Studies, 2007
    Co-Authors: Jan Kottner, Theo Dassen
    Abstract:

    There are many studies investigating psychometric properties of the Braden scale, a scale that predicts the risk for pressure ulcers. The main focus of these studies is validity as opposed to Reliability. In order to estimate the degree of Interrater Reliability a literature review revealed that numerous statistical approaches and coefficients were used (Pearson's product-moment correlation, Cohen's kappa, overall percentage of agreement, intraclass correlation). These coefficients were calculated for the individual items and the overall Braden score and were used inconsistently. The advantages and limitations of every coefficient are discussed and it is concluded that most of them are inappropriate measures. Therefore, estimating the degree of the Braden scale Interrater Reliability is limited to a certain extent. It is shown that the intraclass correlation coefficient is an appropriate statistical approach for calculating the Interrater Reliability of the Braden scale. It is recommended to present intraclass correlation coefficients in combination with the overall percentage of agreement.

Peregrin Spielholz - One of the best experts on this subject based on the ideXlab platform.

  • Interrater Reliability of posture observations
    Human Factors, 2009
    Co-Authors: Ninica Howard, Peregrin Spielholz, Barbara Silverstein, Nayak L Polissar
    Abstract:

    Objective: The aims of this research were (a) to study the Interrater Reliability of a posture observation method, (b) to test the impact of different posture categorization systems on Interrater Reliability, and (c) to provide guidelines for improving Interrater Reliability. Background: Estimation of posture through observation is challenging. Previous studies have shown varying degrees of validity and Reliability, providing little information about conditions necessary to achieve acceptable Reliability. Method: Seven raters estimated posture angles from video recordings. Different measures of Interrater Reliability, including percentage agreement, precision, expression as Interrater standard deviation, and intraclass correlation coefficients (ICC), were computed. Results: Some posture parameters, such as the upper arm flexion and extension, had ICCs ≥ 0.50. Most posture parameters had a precision around the 10° range. The predefined categorization and 30° posture categorization strategies showed substan...

Barbara Silverstein - One of the best experts on this subject based on the ideXlab platform.

  • Interrater Reliability of posture observations
    Human Factors, 2009
    Co-Authors: Ninica Howard, Peregrin Spielholz, Barbara Silverstein, Nayak L Polissar
    Abstract:

    Objective: The aims of this research were (a) to study the Interrater Reliability of a posture observation method, (b) to test the impact of different posture categorization systems on Interrater Reliability, and (c) to provide guidelines for improving Interrater Reliability. Background: Estimation of posture through observation is challenging. Previous studies have shown varying degrees of validity and Reliability, providing little information about conditions necessary to achieve acceptable Reliability. Method: Seven raters estimated posture angles from video recordings. Different measures of Interrater Reliability, including percentage agreement, precision, expression as Interrater standard deviation, and intraclass correlation coefficients (ICC), were computed. Results: Some posture parameters, such as the upper arm flexion and extension, had ICCs ≥ 0.50. Most posture parameters had a precision around the 10° range. The predefined categorization and 30° posture categorization strategies showed substan...