Nový přístup v testování ekvivalence na příkladu měření subjektivního blahobytu
Roč.18,č.1(2021)
Nové přístupy v metodologii sociálněvědního výzkumu
Survey-based measures of subjective well-being are more and more often analyzed cross-culturally. However, international comparison of these measures requires measurement invariance. Therefore, the major goal of this study was to investigate the cross-country comparability of the five-item subjective well-being scales used in the International Social Survey Programme (2011, 2017). This study applied both the traditional exact and the more recent Bayesian approximate approach to assess whether the subjective well-being scales were measurement invariant. The Bayesian approach detected several non‑invariant items that were problematic for cross-national comparison and could be dropped from the scales. Consequently, measurement invariance was established in all countries for the reduced scales, allowing researchers to meaningfully compare their latent mean scores and the relationships with other theoretical constructs of interest. Thus, the study highlighted the advantages of using multiple indicators and the necessity of measurement invariance testing in subjective well-being research.
subjective well-being; measurement invariance; International Social Survey Programme; MG-BSEM
ANÝŽOVÁ, Petra. 2014. „Srovnatelnost Schwartzovy hodnotové škály v mezinárodních datech.“ Sociologický časopis/Czech Sociological Review 50(4): 547–580. https://doi.org/10.13060/00380288.2014.50.4.108
ANÝŽOVÁ, Petra. 2015. Srovnatelnost postojových škál v komparativním výzkumu. Olomouc: Univerzita Palackého.
ASPAROUHOV, Tihomir a Bengt MUTHÉN. 2014. „Multiple-Group Factor Analysis Alignment.“ Structural Equation Modeling: A Multidisciplinary Journal 21(4): 495–508. https://doi.org/10.1080/10705511.2014.919210
ASPAROUHOV, Tihomir a Bengt MUTHÉN. 2010. Bayesian Analysis of Latent Variable Models Using Mplus. Muthén & Muthén. Technical report (www.statmodel.com). Los Angeles, CA.
BENÍTEZ, Isabel, José Luis PADILLA, Fons van de VIJVER a Amaya CUEVAS. 2018. „What Cognitive Interviews Tell Us about Bias in Cross-Cultural Research: An Illustration Using Quality-of-Life Items.“ Field Methods 30(4): 277–294. https://doi.org/10.1177/1525822X18783961
BJØRNSKOV, Christian. 2010. „How Comparable Are the Gallup World Poll Life Satisfaction Data?“ Journal of Happiness Studies 11(1): 41–60. https://doi.org/10.1007/s10902-008-9121-6
BUJACZ, Aleksandra, Joar VITTERSØ, Veronika HUTA a Lukasz D. KACZMAREK. 2014. „Measuring Hedonia and Eudaimonia as Motives for Activities: Cross-National Investigation Through Traditional and Bayesian Structural Equation Modeling.“ Frontiers in Psychology 5: Article 984. https://doi.org/10.3389/fpsyg.2014.00984
BYRNE, Barbara M. 2010. Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming. Second Edition. New York, NY: Taylor & Francis Group.
BYRNE, Barbara M., Richard J. SHAVELSON a Bengt MUTHÉN. 1989. „Testing for the Equivalence of Factor Covariance and Mean Structures: The Issue of Partial Measurement Invariance.“ Psychological Bulletin 105(3): 456–466. https://doi.org/10.1037/0033-2909.105.3.456
CIECIUCH, Jan a Eldad DAVIDOV. 2012. „A Comparison of the Invariance Properties of the PVQ-40 and the PVQ-21 to Measure Human Values across German and Polish Samples.“ Survey Research Methods 6(1): 37–48.
CIECIUCH, Jan, Eldad DAVIDOV, René ALGESHEIMER a Peter SCHMIDT. 2018. „Testing for Approximate Measurement Invariance of Human Values in the European Social Survey.“ Sociological Methods & Research 47(4): 665–686. https://doi.org/10.1177/0049124117701478
CIECIUCH, Jan, Eldad DAVIDOV, Peter SCHMIDT, René ALGESHEIMER a Shalom H. SCHWARTZ. 2014. „Comparing Results of an Exact vs. an Approximate (Bayesian) Measurement Invariance Test: A Cross-Country Illustration with a Scale to Measure 19 Human Values.“ Frontiers in Psychology 5: Article 982. https://doi.org/10.3389/fpsyg.2014.00982
CUMMINS, Robert A., Richard ECKERSLEY, Julie PALLANT, Jackie van VUGT a RoseAnne MISAJON. 2003. „Developing a National Index of Subjective Wellbeing: The Australian Unity Wellbeing Index.“ Social Indicators Research 64(2): 159–190. https://doi.org/10.1023/A:1024704320683
DAVIDOV, Eldad, Jan CIECIUCH, Bart MEULEMAN, Peter SCHMIDT, René ALGESHEIMER a Mirjam HAUSHERR. 2015. „The Comparability of Measurements of Attitudes toward Immigration in the European Social Survey.“ Public Opinion Quarterly 79(S1): 244–266. https://doi.org/10.1093/poq/nfv008
DAVIDOV, Eldad, Bart MEULEMAN, Jan CIECIUCH, Peter SCHMIDT a Jaak BILLIET. 2014. „Measurement Equivalence in Cross-National Research.“ Annual Review of Sociology 40(1): 55–75. https://doi.org/10.1146/annurev-soc-071913-043137
DAVIDOV, Eldad, Jan CIECIUCH a Peter SCHMIDT. 2018. „The Cross-Country Measurement Comparability in the Immigration Module of the European Social Survey 2014–15.“ Survey Research Methods 12(1): 15–27.
DAVIDOV, Eldad, Peter SCHMIDT a Jaak BILLIET (eds.). 2011. Cross-cultural Analysis: Methods and Applications. New York, NY: Routledge. https://doi.org/10.4324/9780203882924
DEMARS, Christine. 2010. Item Response Theory. Oxford: University Press. https://doi.org/10.1093/acprof:oso/9780195377033.001.0001
DIENER, Ed. 2009. The Science of Well-Being. The Collected Works of Ed Diener. Dordrecht: Springer. https://doi.org/10.1007/978-90-481-2350-6
DIENER, Ed, Robert A. EMMONS, Randy J. LARSEN a Sharon GRIFFIN. 1985. „The Satisfaction With Life Scale.“ Journal of Personality Assessment 49(1): 71–75. https://doi.org/10.1207/s15327752jpa4901_13
DIENER, Ed, Richard E. LUCAS a Shigehiro OISHI. 2018. „Advances and Open Questions in the Science of Subjective Well-Being.“ Collabra: Psychology 4(1): 15. https://doi.org/10.1525/collabra.115
DIENER, Ed, Derrick WIRTZ, Robert BISWAS-DIENER, William TOV, Chu KIM-PRIETO, Dong-won CHOI a Shigehiro OISHI. 2009. „New Measures of Well-Being.“ Pp. 247–266 in Ed DIENER (ed.). Assessing Well-Being. The Collected Works of Ed Diener. Dordrecht: Springer Netherlands. https://doi.org/10.1007/978-90-481-2354-4_12
DIENER, Ed a Richard E. LUCAS. 1999. „Personality and Subjective Well-Being.“ Pp. 213–229 in Daniel KAHNEMAN, Ed DIENER a Norbert SCHWARZ (eds.). Well-Being: The Foundations of Hedonic Psychology. New York: Russell Sage Found.
EMBRETSON, Susan E. a Steven P. REISE. 2000. Item Response Theory for Psychologists. Mahwah, NJ: L. Erlbaum Associates.
EMERSON, Scott D., Martin GUHN a Anne M. GADERMANN. 2017. „Measurement Invariance of the Satisfaction with Life Scale: Reviewing Three Decades of Research.“ Quality of Life Research 26(9): 2251–2264. https://doi.org/10.1007/s11136-017-1552-2
FORS, Filip a Joakim KULIN. 2016. „Bringing Affect Back in: Measuring and Comparing Subjective Well-Being Across Countries.“ Social Indicators Research 127(1): 323–339. https://doi.org/10.1007/s11205-015-0947-0
HUPPERT, Felicia A., Nic MARKS, Andrew CLARK, Johannes SIEGRIST, Alois STUTZER, Joar VITTERSØ a Morten WAHRENDORF. 2009. „Measuring Well-Being Across Europe: Description of the ESS Well-Being Module and Preliminary Findings.“ Social Indicators Research 91(3): 301–315. https://doi.org/10.1007/s11205-008-9346-0
HUPPERT, Felicia A. a Timothy T. C. SO. 2013. „Flourishing Across Europe: Application of a New Conceptual Framework for Defining Well-Being.“ Social Indicators Research 110(3): 837–861. https://doi.org/10.1007/s11205-011-9966-7
CHEN, Fang Fang. 2007. „Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance.“ Structural Equation Modeling: A Multidisciplinary Journal 14(3): 464–504. https://doi.org/10.1080/10705510701301834
JOVANOVIĆ, Veljko, Robert A. CUMMINS, Melissa WEINBERG, Ljiljana KALITERNA a Zvjezdana PRIZMIC-LARSEN. 2019. „Personal Wellbeing Index: A Cross-Cultural Measurement Invariance Study Across Four Countries.“ Journal of Happiness Studies 20(3): 759–775. https://doi.org/10.1007/s10902-018-9966-2
KAHNEMAN, Daniel, Ed DIENER a Norbert SCHWARZ (eds.). 1999. Well-Being: The Foundations of Hedonic Psychology. New York: Russell Sage Found.
KIM, Eun Sook, Chunhua CAO, Yan WANG a Diep T. NGUYEN. 2017. „Measurement Invariance Testing with Many Groups: A Comparison of Five Approaches.“ Structural Equation Modeling: A Multidisciplinary Journal 24(4): 524–544. https://doi.org/10.1080/10705511.2017.1304822
McGILLIVRAY, Mark a Matthew CLARKE. 2006. Understanding Human Well-being. Tokyo: UNU Press. https://doi.org/10.1057/9780230625600
MEITINGER, Katharina. 2017. „Necessary but Insufficient.“ Public Opinion Quarterly 81(2): 447–472. https://doi.org/10.1093/poq/nfx009
MEREDITH, William. 1993. „Measurement Invariance, Factor Analysis and Factorial Invariance.“ Psychometrika 58(4): 525–543. https://doi.org/10.1007/BF02294825
MEULEMAN, Bart, Eldad DAVIDOV a Jaak BILLIET. 2009. „Changing Attitudes toward Immigration in Europe, 2002–2007: A Dynamic Group Conflict Theory Approach.“ Social Science Research 38 (2): 352–365. https://doi.org/10.1016/j.ssresearch.2008.09.006
MÎNDRILĂ, Diana. 2010. „Maximum Likelihood (ML) and Diagonally Weighted Least Squares (DWLS) Estimation Procedures: A Comparison of Estimation Bias with Ordinal and Multivariate Non-Normal Data.“ International Journal of Digital Society 1(1): 60–66. https://doi.org/10.20533/ijds.2040.2570.2010.0010
MONROE, Scott a Li CAI. 2015. „Evaluationg Structural Equation Models for Categorical Outcomes: A New Test Statistic and a Practical Challenge of Interpretation.“ Multivariate Behavioral Research 50(6): 569–583. https://doi.org/10.1080/00273171.2015.1032398
MUTHÉN, Bengt a Tihomir ASPAROUHOV. 2012. „Bayesian Structural Equation Modeling: A More Flexible Representation of Substantive Theory.“ Psychological Methods 17(3): 313–335.https://doi.org/10.1037/a0026802
MUTHÉN, Bengt a Tihomir ASPAROUHOV. 2013. „BSEM Measurement Invariance Analysis.“ Mplus Web Notes 17: 1–48.
MUTHÉN, K. Linda a Bengt O. MUTHÉN. 1998–2017. Mplus User’s Guide (8.). Los Angeles, CA: Muthén & Muthén.
MUTHÉN, Bengt O. 1999. „Fit Indices for Categorical Outcumes.“ Mplus Discussion. 2. listopadu. Cit. 16. srpna 2020 (http://www.statmodel.com/discussion/messages/23/26.html).
NAVRUZ, Bilgin. 2016. „The Behaviors of Robust Weighted Least Squares Estimation Techniques for Categorical/Ordinal Data in Multilevel CFA Models.“ Doctoral dissertation. Texas A & M University.
OECD. 2013. OECD Guidelines on Measuring Subjective Well-Being. OECD.
POKROPEK, Artur, Eldad DAVIDOV a Peter SCHMIDT. 2019. „A Monte Carlo Simulation Study to Assess the Appropriateness of Traditional and Newer Approaches to Test for Measurement Invariance.“ Structural Equation Modeling: A Multidisciplinary Journal 26(5): 724–744. https://doi.org/10.1080/10705511.2018.1561293
POKROPEK, Artur, Peter SCHMIDT a Eldad DAVIDOV. 2020. „Choosing Priors in Bayesian Measurement Invariance Modeling: A Monte Carlo Simulation Study.“ Structural Equation Modeling: A Multidisciplinary Journal online: 1–15. https://doi.org/10.1080/10705511.2019.1703708
RAUDENSKÁ, Petra. 2020. „The Cross-Country and Cross-Time Measurement Invariance of Positive and Negative Affect Scales: Evidence from European Social Survey.“ Social Science Research 86: 102369. https://doi.org/10.1016/j.ssresearch.2019.102369
REEVE, Bryce B. a Peter FAYERS. (2005). „Applying Item Response Theory Modelling for Evaluating Questionnaire Item and Scale Properties.“ Pp. 55–73 in Peter FAYERS a Ron HAYS (eds.). Assessing Quality of Life in Clinical Trials: Methods and Practice, 2nd Edition. Oxford: Oxford University Press.
RUTKOWSKI, Leslie a Dubravka SVETINA. 2014. „Assessing the Hypothesis of Measurement Invariance in the Context of Large-Scale International Surveys.“ Educational and Psychological Measurement 74(1): 31–57. https://doi.org/10.1177/0013164413498257
RUTKOWSKI, Leslie a Dubravka SVETINA. 2017. „Measurement Invariance in International Surveys: Categorical Indicators and Fit Measure Performance.“ Applied Measurement in Education 30(1): 39–51. https://doi.org/10.1080/08957347.2016.1243540
RYAN, Richard M. a Edward L. DECI. 2001. „On Happiness and Human Potentials: A Review of Research on Hedonic and Eudaimonic Well-Being.“ Annual Review of Psychology 52(1): 141–166. https://doi.org/10.1146/annurev.psych.52.1.141
SEDDIG, Daniel a Heinz LEITGÖB. 2018. „Approximate Measurement Invariance and Longitudinal Confirmatory Factor Analysis: Concept and Application with Panel Data.“ Survey Research Methods 12(1): 29–41.
STEENKAMP, Jan‐Benedict E. M. a Hans BAUMGARTNER. 1998. „Assessing Measurement Invariance in Cross‐National Consumer Research.“ Journal of Consumer Research 25(1): 78–107. https://doi.org/10.1086/209528
TAY, Louis, Quiming HUANG a Jeroen K. VERMUNT. 2016. „Item Response Theory With Covariates (IRT-C): Assessing Item Recovery and Differential Item Functioning for the Three-Parameter Logistic Model.“ Educational and Psychological Measurement 76(1): 22–42. https://doi.org/10.1177/0013164415579488
TAY, Louis, Jeroen K. VERMUNT a Chun WANG. 2013. „Assessing the Item Response Theory With Covariate (IRT-C) Procedure for Ascertaining Differential Item Functioning.“ International Journal of Testing 13(3): 201–222. https://doi.org/10.1080/15305058.2012.692415
TERESI, Jeanne A. 2006. „Different Approaches to Differential Item Functioning in Health Applications: Advantages, Disadvantages and Some Neglected Topics.“ Medical Care 44(11): 152–170. https://doi.org/10.1097/01.mlr.0000245142.74628.ab
VAN DE SCHOOT, Rens, Anouck KLUYTMANS, Lars TUMMERS, Peter LUGTIG, Joop HOX a Bengt MUTHÉN. 2013. „Facing Off with Scylla and Charybdis: A Comparison of Scalar, Partial, and the Novel Possibility of Approximate Measurement Invariance.“ Frontiers in Psychology 4: Article 770. https://doi.org/10.3389/fpsyg.2013.00770
VANDENBERG, Robert J. a Charles E. LANCE. 2000. „A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research.“ Organizational Research Methods 3(1): 4–70. https://doi.org/10.1177/109442810031002
WATERMAN, Alan S. 1993. „Two Conceptions of Happiness: Contrasts of Personal Expressiveness (Eudaimonia) and Hedonic Enjoyment.“ Journal of Personality and Social Psychology 64(4): 678–691. https://doi.org/10.1037/0022-3514.64.4.678
WHO. 1998. Wellbeing Measures in Primary Health Care/The Depcare Project. WHO Regional Office for Europe: Copenhagen.
XIA, Yan. 2016. Investigating the Chi-Square-Based Model-Fit Indexes for WLSMV and ULSMV Estimators. Doctoral disseration. Florida State University.
ZERCHER, Florian, Peter SCHMIDT, Jan CIECIUCH a Eldad DAVIDOV. 2015. „The Comparability of the Universalism Value Over Time and Across Countries in the European Social Survey: Exact Vs. Approximate Measurement Invariance.“ Frontiers in Psychology 6: Article 733. https://doi.org/10.3389/fpsyg.2015.00733
ŻEMOJTEL-PIOTROWSKA, Magdalena et al. 2017. „Measurement Invariance of Personal Well-Being Index (PWI-8) Across 26 Countries.“ Journal of Happiness Studies 18(6): 1697–1711. https://doi.org/10.1007/s10902-016-9795-0
Tato práce je licencována pod Mezinárodní licencí Creative Commons Attribution 4.0 .
Copyright © 2021 Petra Raudenská, Radka Hanzlová