Smíšený mód a online dotazování: mezinárodní praxe a tuzemská připravenost na implementaci
Bd.18,Nr.1(2021)
Nové přístupy v metodologii sociálněvědního výzkumu
The cost of interviewer-administered data collection (CAPI, CATI) has been gradually rising, while response rates have been declining over time. This situation has led to the domination of online data collection (CAWI), which tends to suffer from poor population coverage and even lower response rates. This could be overcome by combining this method with another mode of data collection. This paper aims to summarise the main principles of mixed-mode design, its implementation in major international surveys, and the first results of a project testing the feasibility of the push-to-web mixed-mode design in the Czech context. The results illustrate that together, unequal distribution of technological skills and willingness to participate distort the recruitment of random samples for CAWI towards middle-aged and more educated respondents. The mixed-mode design – together with the described components – has the potential to better involve underrepresented groups, while it is essential to follow the rules for achieving comparable answers across modes and devices. Finally, we emphasize the need to disseminate findings to researchers and other users of survey data, as the use of mixed-mode design has been rapidly increasing.
mixed-mode design; social surveys; CAWI; the Czech Republic; methodological research
ANTOUN, Christopher. 2015. „Who Are the Internet Users, Mobile Internet Users, and Mobile-Mostly Internet Users? Demographic Differences across Internet-Use Subgroups in the U.S.“ Pp. 99–117 in Daniele TONINELLI, Robert PINTER, Pablo DE PEDRAZA (eds.). Mobile Research Methods: Opportunities and Challenges of Mobile Research Methodologies. London: Ubiquity Press.
BETHLEHEM, Jelke a Silvia BIFFIGNANDI. 2011. Handbook of Web Surveys (Vol. 567). Hoboken, NJ: John Wiley & Sons. https://doi.org/10.1002/9781118121757
BOSNJAK, Michael, Robert BAUER a Kai W. WEYANDT. 2018. „Mixed Devices in Online Surveys: Prevalence, Determinants, and Consequences.“ Pp. 53–65 in Axel THEOBALD (ed.). Mobile Research. Wiesbaden: Springer Gabler. https://doi.org/10.1007/978-3-658-18903-7_5
BUELENS, Bart, Jan A. VAN DEN BRAKEL a Barry SCHOUTEN. 2018. Current Methodologies to Deal with Mode Effects and Mode Bias in Mixed-Mode Designs (Project MIMOD, WP2, Deliverable 1). Cit. 20. října 2020 (https://www.istat.it/it/files//2011/07/WP2-deliverables.zip).
BUCHTÍK, Martin. 2012. „Smíšené módy sběru dat v kvantitativním sociálněvědním výzkumu.“ Data a výzkum-SDA Info 6(2): 129–149.
CALLEGARO, Mario, Katja Lozar MANFREDA a Vasja VEHOVAR. 2015. Web Survey Methodology. London: Sage.
CONRAD Frederick G., Mick P. COUPER, Roger TOURANGEAU a Chan ZHANG. 2017. „Reducing Speeding in Web Surveys by Providing Immediate Feedback.“ Survey Research Methods 11(1): 45–61.
COUPER, Mick P. 2017. „New Developments in Survey Data Collection.“ Annual Review of Sociology 43: 121–145. https://doi.org/10.1146/annurev-soc-060116-053613
COURTRIGHT, Melanie a Kartik PASHUPATI. 2014. „The Impact of Digital Fingerprinting and Identity Verification on Data Quality.“ Journal of Advertising Research 54(3): 263–269. https://doi.org/10.2501/JAR-54-3-263-269
COUPER, Mick P. a Gregg J. PETERSON. 2017. „Why Do Web Surveys Take Longer on Smartphones?“ Social Science Computer Review 35(3): 357–377. https://doi.org/10.1177/0894439316629932
CRAIG, Benjamin M., Ron D. HAYS, A. Simon PICKARD, David CELLA, Dennis A. REVICKI a Bryce B. REEVE. 2013. „Comparison of US Panel Vendors for Online Surveys.“ Journal of Medical Internet Research 15(11): e260. https://doi.org/10.2196/jmir.2903
ČSÚ. 2018. Informační společnost v číslech 2018. Česká republika a EU. Praha: Český statistický úřad. Cit. 15. dubna 2020 (https://www.czso.cz/documents/10180/61601892/061004-18.pdf/5c26ca38-ec13-4aef-8fca-d30ae38291f3?version=1.1).
ČSÚ. 2019. „Využívání informačních a komunikačních technologií v domácnostech a mezi jednotlivci“. Tabulky 1.1, 1.3, 3.1, 5.1. Cit 25. září 2020 (https://www.czso.cz/csu/czso/vyuzivani-informacnich-a-komunikacnich-technologii-v-domacnostech-a-mezi-jednotlivci-2019).
DE BRUIJNE, Marika a Adriaan KALWIJ. 2018. SHARE-NL CAWI Data Collection for Wave 7. Tilburg: CentERdata.
DE BRUIJNE, Marika, Boukje CUELENAERE, Josette JANSSEN a Marije OUDEJANS. 2016. SHARE-NL: CAWI + CATI Data Collection for Wave 6. Tilburg: CentERdata.
DE LEEUW, Edith D. a Vera TOEPOEL. 2018. „Mixed-Mode and Mixed-Device Surveys.“ Pp. 51–61 in David L. VANNETTE a Jon A. KROSNICK (eds). The Palgrave Handbook of Survey Research. Cham: Palgrave Macmillan. https://doi.org/10.1007/978-3-319-54395-6_8
DE LEEUW, Edith D., Z. Tuba SUZER‐GURTEKIN a Joop J. HOX. 2018. „The Design and Implementation of Mixed‐mode Surveys.“ Pp. 387–408 in Timothy P. JOHNSON, Beth-Ellen PENNELL, Ineke A. L. STOOP a Brita DORER (eds.). Advances in Comparative Survey Methods: Multinational, Multiregional, and Multicultural Contexts (3MC). New York: John Wiley & Sons. https://doi.org/10.1002/9781118884997.ch18
DE LEEUW, Edith. D. a Joop J. HOX. 2011. „Internet Surveys As Part Of A Mixed-Mode Design.“ Pp. 45–76 in Marcel DAS et al. (eds.). Social and Behavioral Research and the Internet: Advances in Applied Methods and Research Strategies. New York: Routledge/ Taylor & Francis Group. https://doi.org/10.4324/9780203844922-3
DILLMAN, Don A., Jolene D. SMYTH a Leah M.CHRISTIAN. 2014. Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method. Hoboken, NJ: John Wiley & Sons.
EMERY, Tom, Susanna CABAÇO a Luisa FADEL. 2019. The Generations & Gender Survey: Breakoffs In A Very Long Online Survey. European Survey Research Association Conference, Zagreb.
ESOMAR. 2015. „ESOMAR/GRBN Guideline for Online Sample Quality.“ Cit 23. února 2021 (https://www.esomar.org/what-we-do/code-guidelines/esomargrbn-guideline-on-online-sample-quality).
ESS. N.d. „CROss-National Online Survey (CRONOS) Panel.“ Cit. 15. září 2020 (https://www.europeansocialsurvey.org/methodology/methodological_research/modes_of_data_collection/cronos.html).
EVS. 2017. „European Values Study 2017. Mixed-Mode Strategy Guidelines: Recommendations and Guidelines for the Implementation of the CAWI Version of the EVS 2017.“ Dostupné z archivu GESIS. Cit. 15. září 2020 (https://dbk.gesis.org/dbksearch/download.asp?id=65218).
FUCHS, Marek, Mick COUPER a Sue Ellen HANSEN. 2000. „Technology Effects: Do CAPI or PAPI Interviews Take Longer?“ Journal of Official Statistics 16(3): 273–286.
GGP. 2018. „GGP Technical Case and E-Needs, Deliverable 2.1 of the GGP-EPI Project Funded under the European Union’s Horizon 2020 Research and Innovation Programme GA No: 739511.“ Cit. 2. března 2019 (www.ggp-i.org/ggpepi).
GGP. 2020. „Country Reports – GGP Council of Partners.“ The Hague: Netherlands Interdisciplinary Demographic Institute.
GUMMER, Tobias a Joss ROßMANN. 2015. „Explaining Interview Duration in Web Surveys: A Multilevel Approach.“ Social Science Computer Review 3(2): 217–234. https://doi.org/10.1177/0894439314533479
HERZING, Jessica M. a Annelies G. BLOM. 2019. „The Influence Of a Person’s Digital Affinity on Unit Nonresponse nd Attrition in an Online Panel.“ Social Science Computer Review 37(3): 404–424. https://doi.org/10.1177/0894439318774758
HOX, Joop, Edith D. DE LEEUW a Thoma KLAUSCH. 2017. „Mixed Mode Research: Issues in Design and Analysis.“ Pp. 511–530 in Paul BIEMER et al. (eds.). Total Survey Error in Practice: Improving Quality in the Era of Big Data. New York: Wiley. https://doi.org/10.1002/9781119041702.ch23
CHANG, LinChiat a Jon A. KROSNICK. 2009. „National Surveys Via RDD Telephone Interviewing Versus the Internet: Comparing Sample Representativeness and Response Quality.“ Public Opinion Quarterly 73(4): 641–678. https://doi.org/10.1093/poq/nfp075
CHRISTMANN, Pablo, Tobias GUMMER, Sascha HÄHNEL a Christof WOLF. 2018. Probability Based Mixed-Mode Surveys: Experimental Evidence from the EVS-Germany. Natcen-ESS ERIC-City Methodology Seminar Series.
CHYLÍKOVÁ, Johana. 2011. „Úvod do problematiky výzkumu citlivých témat ve výběrových šetřeních.“ Data a výzkum – SDA Info 5(2): 185–203.
JONES, Michael S., Lisa A. HOUSE a Zhifeng GAO. 2015. „Respondent Screening and Revealed Preference Axioms: Testing Quarantining Methods for Enhanced Data Quality in Web Panel Surveys.“ Public Opinion Quarterly 79(3): 687–709. https://doi.org/10.1093/poq/nfv015
KREJČÍ, Jindřich. 2008. Kvalita sociálněvědních výběrových šetření v České republice. Praha: Sociologické nakladatelství (SLON).
KUDRNÁČOVÁ, Michaela. 2019. České panelové šetření domácností: Dokumentace k datům, vlna 1 (2015) – vlna 4 (2018). Praha: Sociologický ústav AV ČR.
LIU, Mingnan a Alexandru CERNAT. 2018. „Item-by-Item Versus Matrix Questions: A Web Survey Experiment.“ Social Science Computer Review 36(6): 690–706. https://doi.org/10.1177/0894439316674459
LOZAR MANFREDA, Katja, Nejc BERZELAK a Vasja VEHOVAR. 2013. Paradata Insight into Survey Response Behaviour: An Analysis of a Set of Hosted Web Surveys. General Online Research Conference (GOR), Mannheim, Germany.
LÜCK, Detlev, Almut SCHUMANN, Robert NADERI, Martin BUJARD, Tom EMERY, Susana CABAÇO, Peter LUGTIG a Vera TOEPOEL. 2019. Improving Data-Quality in the GGS: Are Modifications in the Questionnaire and Survey Design in the Generations and Gender Survey Able to Resolve Measurement Errors? European Survey Research Association Conference, Zagreb.
LYNN, Peter. 2020. „Evaluating Push-To-Web Methodology for Mixed-Mode Surveys Using Address-Based Samples.“ Survey Research Methods 14(1): 19–30.
MARTIN, Peter. 2011. „A Good Mix? Mixed Mode Data Collection and Cross-National Surveys.“ Ask. Research & Methods 20: 5–26.
MURGIA, Manuela et al. 2019. Methodological Report: Mixed-Mode Strategies for Social Surveys: How to Best Combine Data Collection Modes (Project MIMOD, WP1, Deliverable 2). Cit. 15. září 2020 (https://www.istat.it/it/files//2011/07/WP1-deliverables.zip).
MURGIA, Manuela, Martina LO CONTE, Dag F. GRAVEM. 2018. Report on MIMOD Survey on the State of the Art of Mixed Mode for EU Social Surveys (Project MIMOD, WP1, Deliverable 1). Cit. 15. září 2020 (https://www.istat.it/it/files//2011/07/WP1-deliverables.zip).
RYŠAVÝ, Dušan. 2011. „Úskalí on-line dotazování při měření postojů vysokoškoláků a pracovníků vysokých škol.“ Data a výzkum-SDA Info 5(1): 85–103.
SELKÄLÄ, Arto a Mick. P. COUPER. 2018. „Automatic Versus Manual Forwarding in Web Surveys.“ Social Science Computer Review 36(6): 669–689. https://doi.org/10.1177/0894439317736831
SCHERPENZEEL, Annette, Kathrin AXT, Michael BERGMANN, Salima DOUHOU, Andrea OEPEN, Gregor SAND, Karin SCHULLER, Stephanie STUCK, Melanie WAGNER a Axel BÖRSCH-SUPAN. 2020. „Collecting Survey Data among the 50+ Population during the COVID-19 Outbreak: The Survey of Health, Ageing and Retirement in Europe (SHARE).“ Survey Research Methods 14(2): 217–221.
SCHRÄPLER, Jörg-Peter, Jürgen SCHUPP a Gert G. WAGNER. 2010. „Changing from PAPI to CAPI: Introducing CAPI in a Longitudinal Study.“ Journal of Official Statistics 26(2): 239–269.
SCHUMANN, Almut. 2019. Which Incentive Works Best? Findings from a Push-to-Web Experiment in the GGP Context in Germany. European Survey Research Association Conference, Zagreb.
SMYTH, Jolene D. a Jennie E. PEARSON. 2011. „Internet Survey Methods: A Review of Strengths, Weaknesses, and Innovations.“ Pp. 11–44 in Marcel DAS et al. (eds.). Social and Behavioral Research and the Internet: Advances in Applied Methods and Research Strategies. New York: Routledge/ Taylor & Francis Group. https://doi.org/10.4324/9780203844922-2
STRUMINSKAYA, Bella, Kai WEYANDT a Michael BOSNJAK. 2015. „The Effects of Questionnaire Completion Using Mobile Devices on Data Quality. Evidence from a Probability-Based General Population Panel.” Methods, Data, Analyses 9(2): 261–292.
SUZER‐GURTEKIN, Z. Tuba, Richard VALLIANT, Steven G. HEERINGA a Edith D. de LEEUW. 2018. „Mixed‐mode Surveys: Design, Estimation, and Adjustment Methods.“ Pp. 409–430 in Timothy P. JOHNSON, Beth-Ellen PENNELL, Ineke A. L. STOOP a Brita DORER (eds.). Advances in Comparative Survey Methods: Multinational, Multiregional, and Multicultural Contexts (3MC). New York: John Wiley & Sons. https://doi.org/10.1002/9781118884997.ch19
TOEPOEL, Vera a Peter LUGTIG. 2015. „Introduction: Online Surveys are Mixed-Device Surveys. Issues Associated with the Use of Different (Mobile) Devices in Web Surveys.“ Methods, Data, Analyses 9(2): 155–162.
TOEPOEL, Vera a Peter LUGTIG. 2018. „Modularization in an Era of Mobile Web: Investigating the Effects of Cutting a Survey into Smaller Pieces on Data Quality.“ Social Science Computer Review [online first]. https://doi.org/10.1177/0894439318784882
TOURANGEAU, Roger. 2017. „Mixing Modes: Tradeoffs among Coverage, Nonresponse, and Measurement Error.“ Pp. 115–132 in Paul BIEMER et al. (eds.). Total Survey Error in Practice: Improving Quality in the Era of Big Data. New York: Wiley. https://doi.org/10.1002/9781119041702.ch6
TOURANGEAU, Roger, Aaron MAITLAND, Gonzalo RIVERO, Hanyu SUN, Douglas WILLIAMS a Ting YAN. 2017. „Web Surveys by Smartphone and Tablets: Effects on Survey Responses.“ Public Opinion Quarterly 81(4): 896–929. https://doi.org/10.1093/poq/nfx035
VILLAR, Ana a Rory FITZGERALD. 2017. „Using Mixed Modes in Survey Data Research: Results from Six Experiments.“ Pp. 273–310 in Michael J. BREEN (ed.). Values and Identities in Europe: Evidence from the European Social Survey. London: Routledge.
Copyright (c) 2021 Barbora Hubatková, Martin Lakomý