Sonja Mensch

28 Chapter 2 Table 2. Quality criteria for rating of the results (Terwee, et al., 2007). Psychometric property Rating Quality criteria Internal consistency + Cronbach alpha >.70 - Cronbach alpha <.70 ? Cronbach alpha not determined Reliability + ICC >.70 OR r>.70 - ICC <.70 OR r<.70 ? Neither ICC nor weighted kappa Measurement error + MIC > SDC OR MID > SDC OR MIC outside the LoA - MIC < SDC OR MID < SDC OR MIC equals or inside LoA ? MIC not defined Content validity + The target population considers all items in the questionnaire to be relevant AND considers the questionnaire to be complete - The target population considers items in the questionnaire to be irrelevant OR considers the questionnaire to be incomplete ? No target population involvement Structural validity + Factors should explain > 50% of the variance - Factors explain < 50% of the variance ? Explained variance not mentioned Hypothesis testing + Correlation with an instrument measuring the same construct > . 50 OR > 75% of the results were in accordance with the hypotheses AND correlation with related constructs was higher than with unrelated constructs - Correlation with an instrument measuring the same construct > 50 OR < 75% of the results were in accordance with the hypotheses OR correlation with related constructs was lower than with unrelated constructs ? Solely correlations determined with unrelated constructs Cross cultural validity + Original factor structure confirmed OR no important DIF between language versions - Original factor structure not confirmed OR important DIF found between language versions ? Confirmatory factor analysis not applied and DIF not assessed Criterion validity (predictive or concurrent) + Convincing arguments that gold standard is “gold” AND correlation with gold standard > .70 - Correlation with gold standard < .70 despite adequate design and method ? No convincing arguments that gold standard is “gold”OR doubtful design or method