Sequential dependencies of responses in a questionnaire survey and their effects on the reliability and validity of measurement

被引:0
|
作者
Daisuke Shimada
Kentaro Katahira
机构
[1] Nagoya University,Department of Cognitive and Psychological Sciences, Graduate School of Informatics
[2] National Institute of Advanced Industrial Science and Technology (AIST),Human Informatics and Interaction Research Institute
[3] The University of Tokyo,Graduate School of Education
来源
Behavior Research Methods | 2023年 / 55卷
关键词
Sequential dependencies; Reliability; Validity; Questionnaire survey;
D O I
暂无
中图分类号
学科分类号
摘要
The reliability and validity of measurements in questionnaire surveys are affected by the survey design. Previous studies have discussed whether the items on a multidimensional scale should be grouped by subscale or randomized to increase the reliability and validity of the measurement. However, it is not clear what effect item order has on the true reliability and validity and whether the order causes bias in these estimates. Furthermore, it is not clear whether there are sequential dependencies of responses, which refers to the effect of past responses on current responses and, if so, what effects that they have on reliability, coefficient α, and validity. Study 1 empirically revealed that each respondent's previous response had a positive effect on his or her current response. In Study 2, we conducted a theoretical investigation and found that the first-order positive sequential dependencies of responses reduced the reliability, coefficient α, and validity of the subscales. In addition, sequential dependencies were found to render these indicators higher when the items were grouped than when they were randomized and caused an overestimation of reliability by coefficient α. Study 3 confirmed the effects of sequential dependencies and item order on coefficient α using real data. Thus, this study showed the potential impact of sequential dependencies of responses on psychological measurements.
引用
收藏
页码:3241 / 3259
页数:18
相关论文
共 50 条
  • [31] Reliability and validity of the Functional Status Questionnaire
    Paul D. Cleary
    Alan M. Jette
    Quality of Life Research, 2000, 9 : 747 - 753
  • [32] Validity and Reliability of a Food Skills Questionnaire
    Kennedy, Lauren G.
    Kichler, Emily J.
    Seabrook, Jamie A.
    Matthews, June, I
    Dworatzek, Paula D. N.
    JOURNAL OF NUTRITION EDUCATION AND BEHAVIOR, 2019, 51 (07) : 857 - 864
  • [33] Validity and reliability of the parent satisfaction questionnaire
    Stallard, P
    BRITISH JOURNAL OF CLINICAL PSYCHOLOGY, 1996, 35 : 311 - 318
  • [34] Validity and reliability of the Youth/Adolescent Questionnaire
    Rockett, HRH
    JOURNAL OF THE AMERICAN DIETETIC ASSOCIATION, 2005, 105 (12) : 1867 - 1867
  • [35] Reliability and validity of the facility membership questionnaire
    Drummond, JL
    Lenes, HS
    PERCEPTUAL AND MOTOR SKILLS, 1996, 82 (03) : 826 - 826
  • [36] Reliability and validity of the Divided Attention Questionnaire
    Salthouse, TA
    Siedlecki, KL
    AGING NEUROPSYCHOLOGY AND COGNITION, 2005, 12 (01) : 89 - 98
  • [37] Reliability and validity of the conceptions of mathematics questionnaire
    Mji, A
    PSYCHOLOGICAL REPORTS, 1999, 85 (02) : 579 - 582
  • [38] THE MEANING OF ILLNESS QUESTIONNAIRE - RELIABILITY AND VALIDITY
    BROWNE, GB
    BYRNE, C
    ROBERTS, J
    STREINER, D
    FITCH, M
    COREY, P
    ARPIN, K
    NURSING RESEARCH, 1988, 37 (06) : 368 - 373
  • [39] Validity and reliability of the ERSA questionnaire in Turkish
    Ozturk, Huseyin
    Karabulut, Mustafa
    Baydan-Aran, Mine
    Tokgoz-Yilmaz, Suna
    JOURNAL OF DEAF STUDIES AND DEAF EDUCATION, 2024, 29 (02): : 258 - 264
  • [40] RELIABILITY, VALIDITY, AND VERIDICALITY OF QUESTIONNAIRE ITEMS
    AIKEN, LR
    PERCEPTUAL AND MOTOR SKILLS, 1978, 47 (01) : 161 - 162