Please use this identifier to cite or link to this item:
http://hdl.handle.net/10397/105983
Title: | Sensitivity and specificity of conventional and new face validation in determining the incomprehensible items by older people : empirical evidence of testing 106 quality-of-life items | Authors: | Lam, SC Suen, LKP Huang, EYZ Wong, EML Cheung, DSK Kwan, RYC |
Issue Date: | Sep-2023 | Source: | Aging medicine, Sept 2023, v. 6, no. 3, p. 230-238 | Abstract: | Objective: This methodological research aimed to investigate and compare the sensitivity and specificity of conventional and new face validation in identifying incomprehensible items empirically. Methods: A purposive sample of 15 older people living in three residential care homes (RCHs) in Hong Kong was used to evaluate a newly developed 106 items covering seven quality-of-life dimensions. The abbreviated Mental Test (Hong Kong version; AMT) was used as a screening tool for excluding those with impaired cognition. The interview was audiotaped, and incomprehensible items were identified by the research panel accordingly (served as the gold standard). The socio-demographics of the respondents were described. Understandability (yes/no, conventional face validation method) and interpretability (4-point Likert scale, new method) were compared and used to compute the Kappa value (representing chance agreement), sensitivity, and specificity analysis. Results: Fifteen older people were interviewed and responded to the structured interview of 106 items regarding understandability and interpretability. 61 items (57%) obtained 100% positive understandability while only 35 items (33%) obtained 100% correct interpretability. The Kappa coefficient was 0.388 (P < 0.001) of the chance agreement between understandability and interpretability. The panel confirmed that 32% of items required revision (i.e., incomprehensible items). The false negative rate of using the conventional approach was up to 70.59% while both the false positive and negative rates of using the new approach were low (0%–5.88%). Conclusion: This empirical evidence indicated that the conventional approach of face validation for checking incomprehensible items by older people encountered a high false negative rate. On the contrary, the new approach was recommended because it demonstrated high sensitivity and specificity and low false positive and negative rates in identifying incomprehensible items. |
Keywords: | Empirical evidence Face validation Interpretability Older people Understandability |
Publisher: | Wiley-Blackwell Publishing Ltd. | Journal: | Aging medicine | EISSN: | 2475-0360 | DOI: | 10.1002/agm2.12254 | Rights: | © 2023 The Authors. Aging Medicine published by Beijing Hospital and John Wiley & Sons Australia, Ltd. Kwan1This is an open access article under the terms of the Creative Commons Attribution-NonCommercial-NoDerivs License (http://creativecommons.org/licenses/by/4.0/), which permits use and distribution in any medium, provided the original work is properly cited, the use is non-commercial and no modifications or adaptations are made. The following publication Lam SC, Suen LKP, Huang E-Z, Wong EML, Cheung DSK, Kwan RYC. Sensitivity and specificity of conventional and new face validation in determining the incomprehensible items by older people: Empirical evidence of testing 106 quality-of-life items. Aging Med, 2023, 6(3): 230-238 is available at https://doi.org/10.1002/agm2.12254. |
Appears in Collections: | Journal/Magazine Article |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Lam_Sensitivity_Specificity_Conventional.pdf | 355.43 kB | Adobe PDF | View/Open |
Page views
14
Citations as of Jun 30, 2024
Downloads
3
Citations as of Jun 30, 2024
Google ScholarTM
Check
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.