Using eye-tracking to investigate teacher gaze: Data accuracy and drawing of meaningful dynamic areas of interest in video stimuli
Bd.29,Nr.4(2019)
ENGLISH ISSUE
Studies that investigate teacher attention via eye-tracking methodology display variety in their reporting styles and consideration of their data quality. This may be due to the fact that eye-tracking has been newly introduced in teacher research, and systematic guidelines are not yet established. This especially accounts for the influence of the quality of the raw data (i.e., accuracy level) and the way that the raw data is processed through the drawing of dynamic areas of interest (AOIs) in video stimuli. The present study investigates the influence of various accepted accuracy levels on the number of fixations and three variations of AOI drawings (student shape, indicated by outlined areas; face, indicated by ovals; and student area, indicated by rectangles) on common eye-tracking metrics: number of fixations, glances, and fixation duration. Sixty-two participants observed a video stimulus with five marked students as the targeted AOIs. A one-way ANOVA was conducted to examine the influence of different accuracy levels (>1°, > 0.5° to ≤ 1.0°, and ≤ 0.5°) of the data on the number of fixations, while the effect of three different dynamic AOI shapes (student shape, face, rectangle) was investigated with a series of repeated-measure one-way ANOVAs. The results indicated no significant difference between the accuracy levels and the number of fixations. For the different AOI shapes, significant differences were observed. When using rectangles, more fixations and glances were recorded in contrast to the other two forms. The average fixation duration was greatest when only the faces were marked. This indicates that depending on the research question and the position of the AOIs, researchers may choose different forms of AOIs and consider the accuracy of their data.
eye-tracking methodology; teacher attention; data accuracy; areas of interest; dynamic video stimuli
Amso, D., Haas, S., & Markant, J. (2014). An eye tracking investigation of developmental change in bottom-up attention orienting to faces in cluttered natural scenes. PloS one, 9(1), e85701. https://doi.org/https://doi.org/10.1371/journal.pone.0085701
Blignaut, P., & Beelders, T. (2009). The effect of fixational eye movements on fixation identification with a dispersion-based fixation detection algorithm. Journal of Eye Movement Research, 2(5). https://doi.org/10.16910/jemr.2.5.4
Blignaut, P., & Wium, D. (2014). Eye-tracking data quality as affected by ethnicity and experimental design. Behavior research methods, 46(1), 67–80. https:// doi.org/10.3758/s13428-013-0343-0
Borji, A., Sihite, D. N., & Itti, L. (2013). What stands out in a scene? A study of human explicit saliency judgment. Vision research, 91, 62–77. https://doi.org/10.1016/j.visres.2013.07.016
Cerf, M., Frady, E. P., & Koch, C. (2009). Faces and text attract gaze independent of the task: Experimental data and computer model. Journal of vision, 9(12), 10–10. https://doi.org/10.1167/9.12.10
Cortina, K. S., Miller, K. F., McKenzie, R., & Epstein, A. (2015). Where low and high inference data converge: Validation of CLASS assessment of mathematics instruction using mobile eye tracking with expert and novice teachers. International Journal of Science and Mathematics Education, 13(2), 389–403. https://doi.org/10.1007/s10763-014-9610-5
Gullberg, M., & Holmqvist, K. (2001, April). Visual attention towards gestures in face-to-face interaction vs. on screen. In International Gesture Workshop, 206–214. https://doi.org/10.1007/3-540-47873-6_23
Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., & Van de Weijer, J. (2011). Eye tracking: A comprehensive guide to methods and measures. OUP Oxford. http://lup.lub. lu.se/record/1852359
Holmqvist, K., Nyström, M., & Mulvey, F. (2012). Eye tracker data quality: What it is and how to measure it. Proceedings of the symposium on eye tracking research and applications, 45–52. https://doi.org/10.1145/2168556.2168563
Jarodzka, H., Gruber, H., & Holmqvist, K. (2017). Eye tracking in educational science: Theoretical frameworks and research agendas. Journal of Eye Movement Research, 10(1). https://doi.org/10.16910/jemr.10.1.3
Judd, T., Ehinger, K., Durand, F., & Torralba, A. (2009). Learning to predict where humans look. In IEEE 12th International Conference on Computer Vision, Kyoto, Japan. https://doi. org/10.1109/ICCV.2009.5459462
Just, M. A., & Carpenter, P. A. (1976). Eye fixations and cognitive processes. Cognitive psychology, 8(4), 441–480. https://doi.org/https://doi.org/10.1016/0010-0285(76)90015-3
Komogortsev, O. V., & Khan, J. I. (2008). Eye movement prediction by Kalman filter with integrated linear horizontal oculomotor plant mechanical model. In Proceedings of the 2008 symposium on Eye tracking research & applications (pp. 229–236). https://doi.org/10.1145/1344471.1344525
Lai, M.-L., Tsai, M.-J., Yang, F.-Y., Hsu, C.-Y., Liu, T.-C., Lee, S. W.-Y., Lee, M.-H., Chiou, G.-L., Liang, J.-C., & Tsai, C.-C. (2013). A review of using eye-tracking technology in exploring learning from 2000 to 2012. Educational research review, 10, 90–115. https://doi.org/10.1016/j.edurev.2013.10.001
McIntyre, N. A., & Foulsham, T. (2018). Scanpath analysis of expertise and culture in teacher gaze in real-world classrooms. Instructional Science, 46(3), 435–455. https://doi.org/10.1007/s11251-017-9445-x
McIntyre, N. A., Jarodzka, H., & Klassen, R. M. (2019). Capturing teacher priorities: Using real-world eye-tracking to investigate expert teacher priorities across two cultures. Learning and Instruction, 60, 215–224. https://doi.org/10.1016/j.learninstruc.2017.12.003
McIntyre, N. A., Mainhard, M. T., & Klassen, R. M. (2017). Are you looking to teach? Cultural, temporal and dynamic insights into expert teacher gaze. Learning and Instruction, 49, 41–53. https://doi.org/10.1016/j.learninstruc.2016.12.005
Nyström, M., Andersson, R., Holmqvist, K., & Van De Weijer, J. (2013). The influence of calibration method and eye physiology on eyetracking data quality. Behavior research methods, 45(1), 272–288. https://doi.org/10.3758/s13428-012-0247-4
Ooms, K., Dupont, L., Lapon, L., & Popelka, S. (2015). Accuracy and precision of fixation locations recorded with the low-cost Eye Tribe tracker in different experimental setups. Journal of eye movement research, 8(1). https://doi.org/10.16910/jemr.8.1.5
Orquin, J. L., Ashby, N. J., & Clarke, A. D. (2016). Areas of interest as a signal detection problem in behavioral eye‐tracking research. Journal of Behavioral Decision Making, 29(2–3), 103–115. https://doi.org/10.1002/bdm.1867
Parkhurst, D., & Niebur, E. (2003). Scene content selected by active vision. Spatial vision, 16(2), 125–154. https://doi.org/10.1163/15685680360511645
Rayner, K. (2009). The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search. Quarterly journal of experimental psychology, 62(8), 1457–1506. https://doi.org/10.1080/17470210902816461
Rayner, K., & Castelhano, M. S. (2008). Eye movements during reading, scene perception, visual search, and while looking at print advertisements. In M. Wedel & R. Pieters (Eds.), Visual marketing: From attention to action (pp. 9–42). Taylor & Francis Group/Lawrence Erlbaum Associates. https://psycnet.apa.org/record/2007-15678-002
Rayner, K., Li, X., Williams, C. C., Cave, K. R., & Well, A. D. (2007). Eye movements during information processing tasks: Individual differences and cultural effects. Vision research, 47(21), 2714–2726. https://doi.org/10.1016/j.visres.2007.05.007
Reichle, E. D. (2006). Computational models of eye-movement control during reading: Theories of the“ eye-mind“ link. Cognitive systems research, 7(1), 2–3. https://doi.org/10.1016/j.cogsys.2005.07.001
Shayan, S., Abrahamson, D., Bakker, A., Duijzer, C. A., & van der Schaaf, M. (2017). Eye-tracking the emergence of attentional anchors in a mathematics learning tablet activity. In Eye-tracking technology applications in educational research (pp. 166–194). IGI Global. https://doi.org/10.4018/978-1-5225-1005-5.ch009
SMI, S. I. (2014). BeGaze Manual: Version 3.4. Retrieved 20.10.2020 from https://psychologie. unibas.ch/fileadmin/user_upload/psychologie/Forschung/N-Lab/SMI_BeGaze_Manual. pdf
Stürmer, K., Seidel, T., Mueller, K., Häusler, J., & Cortina, K. S. (2017). What is in the eye of preservice teachers while instructing? An eye-tracking study about attention processes in different teaching situations. Zeitschrift für Erziehungswissenschaft, 20(1), 75–92. https://doi.org/10.1007/s11618-017-0731-9
Van den Bogert, N., van Bruggen, J., Kostons, D., & Jochems, W. (2014). First steps into understanding teachers’ visual perception of classroom events. Teaching and Teacher Education, 37, 208–216. https://doi.org/10.1016/j.tate.2013.09.001
Wolff, C. E., Jarodzka, H., van den Bogert, N., & Boshuizen, H. P. (2016). Teacher vision: Expert and novice teachers’ perception of problematic classroom management scenes. Instructional Science, 44(3), 243–265. https://doi.org/10.1007/s11251-016-9367-z
Yamamoto, T., & Imai-Matsumura, K. (2013). Teachers’ gaze and awareness of students’ behavior: Using an eye tracker. Comprehensive Psychology, 2, article 6. https://doi.org/10.2466/01.IT.2.6
Zhang, Y., & Hornof, A. J. (2011). Mode-of-disparities error correction of eye-tracking data. Behavior research methods, 43(3), 834–842. https://doi.org/10.3758/s13428-011-0073-0
Dieses Werk steht unter der Lizenz Creative Commons Namensnennung - Nicht-kommerziell - Keine Bearbeitungen 4.0 International.
Copyright (c) 2021 Christina Ioanna Pappa, Christian Kosel, Katharina Schnitzler, Tina Seidel