Eye tracking: empirical foundations for a minimal reporting guideline (Retracted Article)

Kenneth Holmqvist; Saga Lee Örbom; Ignace T.C. Hooge; Diederick C. Niehorster; Robert G. Alexander; Richard Andersson; Jeroen S. Benjamins; Pieter Blignaut; Anne Marie Brouwer; Lewis L. Chuang; Kirsten A. Dalrymple; Denis Drieghe; Matt J. Dunn; Ulrich Ettinger; Susann Fiedler; Tom Foulsham; Jos N. van der Geest; Dan Witzner Hansen; Samuel B. Hutton; Enkelejda Kasneci; Alan Kingstone; Paul C. Knox; Ellen M. Kok; Helena Lee; Joy Yeonjoo Lee; Jukka M. Leppänen; Stephen Macknik; Päivi Majaranta; Susana Martinez-Conde; Antje Nuthmann; Marcus Nyström; Jacob L. Orquin; Jorge Otero-Millan; Soon Young Park; Stanislav Popelka; Frank Proudlock; Frank Renkewitz; Austin Roorda; Michael Schulte-Mecklenbeck; Bonita Sharif; Frederick Shic; Mark Shovman; Mervyn G. Thomas; Ward Venrooij; Raimondas Zemblys; Roy S. Hessels

doi:10.3758/s13428-021-01762-8

Eye tracking: empirical foundations for a minimal reporting guideline (Retracted Article)

Kenneth Holmqvist^*
, Saga Lee Örbom
, Ignace T.C. Hooge
, Diederick C. Niehorster
, Robert G. Alexander
, Richard Andersson
, Jeroen S. Benjamins
, Pieter Blignaut
, Anne Marie Brouwer
, Lewis L. Chuang
, Kirsten A. Dalrymple
, Denis Drieghe
, Matt J. Dunn
, Ulrich Ettinger
, Susann Fiedler
, Tom Foulsham
, Jos N. van der Geest
, Dan Witzner Hansen
, Samuel B. Hutton
, Enkelejda Kasneci

Alan Kingstone, Paul C. Knox, Ellen M. Kok, Helena Lee, Joy Yeonjoo Lee, Jukka M. Leppänen, Stephen Macknik, Päivi Majaranta, Susana Martinez-Conde, Antje Nuthmann, Marcus Nyström, Jacob L. Orquin, Jorge Otero-Millan, Soon Young Park, Stanislav Popelka, Frank Proudlock, Frank Renkewitz, Austin Roorda, Michael Schulte-Mecklenbeck, Bonita Sharif, Frederick Shic, Mark Shovman, Mervyn G. Thomas, Ward Venrooij, Raimondas Zemblys, Roy S. Hessels

^*Corresponding author for this work

Nicolaus Copernicus University in Toruń
University of The Free State
University of Regensburg
Utrecht University
Lund University
State University of New York (SUNY)
Tobii Pro AB
Unit Healthy Living
Leibniz Research Centre for Working Environment and Human Factors
Ludwig Maximilian University of Munich
University of Minnesota Twin Cities
University of Southampton
Cardiff University
University of Bonn
Vienna University of Economics and Business
University of Essex
IT University of Copenhagen
SR Research
University of Tübingen
University of British Columbia
University of Liverpool
Open Universiteit
Maastricht University
University of Turku
Tampere University
Kiel University
Aarhus University
Reykjavík University
University of California at Berkeley
University of Veterinary Medicine Vienna
Palacký University Olomouc
University of Leicester
University of Erfurt
University of Bern
Max Planck Institute for Human Development
University of Nebraska-Lincoln
Children's Hospital and Regional Medical Center Seattle
University of Washington School of Medicine
Eyeviation Systems
Bezalel Academy of Art and Design Jerusalem
University of Twente
Smart Eye AB

Research output: Contribution to journal › Article › Academic › peer-review

139 Citations (Scopus)

269 Downloads (Pure)

Abstract

In this paper, we present a review of how the various aspects of any study using an eye tracker (such as the instrument, methodology, environment, participant, etc.) affect the quality of the recorded eye-tracking data and the obtained eye-movement and gaze measures. We take this review to represent the empirical foundation for reporting guidelines of any study involving an eye tracker. We compare this empirical foundation to five existing reporting guidelines and to a database of 207 published eye-tracking studies. We find that reporting guidelines vary substantially and do not match with actual reporting practices. We end by deriving a minimal, flexible reporting guideline based on empirical research (Section “An empirically based minimal reporting guideline”).

Original language	English
Pages (from-to)	364-416
Number of pages	53
Journal	Behavior Research Methods
Volume	55
Issue number	1
DOIs	https://doi.org/10.3758/s13428-021-01762-8
Publication status	Published - Jan 2023

Bibliographical note

Access to Document

10.3758/s13428-021-01762-8Licence: CC BY

s13428-021-01762-8Final published version, 1.83 MBLicence: CC BY

Cite this

Holmqvist, K., Örbom, S. L., Hooge, I. T. C., Niehorster, D. C., Alexander, R. G., Andersson, R., Benjamins, J. S., Blignaut, P., Brouwer, A. M., Chuang, L. L., Dalrymple, K. A., Drieghe, D., Dunn, M. J., Ettinger, U., Fiedler, S., Foulsham, T., van der Geest, J. N., Hansen, D. W., Hutton, S. B., ... Hessels, R. S. (2023). Eye tracking: empirical foundations for a minimal reporting guideline (Retracted Article). Behavior Research Methods, 55(1), 364-416. https://doi.org/10.3758/s13428-021-01762-8

@article{7f4bb0b756fc4f5aa7d8ade15bd0bc3d,

title = "Eye tracking: empirical foundations for a minimal reporting guideline (Retracted Article)",

abstract = "In this paper, we present a review of how the various aspects of any study using an eye tracker (such as the instrument, methodology, environment, participant, etc.) affect the quality of the recorded eye-tracking data and the obtained eye-movement and gaze measures. We take this review to represent the empirical foundation for reporting guidelines of any study involving an eye tracker. We compare this empirical foundation to five existing reporting guidelines and to a database of 207 published eye-tracking studies. We find that reporting guidelines vary substantially and do not match with actual reporting practices. We end by deriving a minimal, flexible reporting guideline based on empirical research (Section “An empirically based minimal reporting guideline”).",

author = "Kenneth Holmqvist and {\"O}rbom, \{Saga Lee\} and Hooge, \{Ignace T.C.\} and Niehorster, \{Diederick C.\} and Alexander, \{Robert G.\} and Richard Andersson and Benjamins, \{Jeroen S.\} and Pieter Blignaut and Brouwer, \{Anne Marie\} and Chuang, \{Lewis L.\} and Dalrymple, \{Kirsten A.\} and Denis Drieghe and Dunn, \{Matt J.\} and Ulrich Ettinger and Susann Fiedler and Tom Foulsham and \{van der Geest\}, \{Jos N.\} and Hansen, \{Dan Witzner\} and Hutton, \{Samuel B.\} and Enkelejda Kasneci and Alan Kingstone and Knox, \{Paul C.\} and Kok, \{Ellen M.\} and Helena Lee and Lee, \{Joy Yeonjoo\} and Lepp{\"a}nen, \{Jukka M.\} and Stephen Macknik and P{\"a}ivi Majaranta and Susana Martinez-Conde and Antje Nuthmann and Marcus Nystr{\"o}m and Orquin, \{Jacob L.\} and Jorge Otero-Millan and Park, \{Soon Young\} and Stanislav Popelka and Frank Proudlock and Frank Renkewitz and Austin Roorda and Michael Schulte-Mecklenbeck and Bonita Sharif and Frederick Shic and Mark Shovman and Thomas, \{Mervyn G.\} and Ward Venrooij and Raimondas Zemblys and Hessels, \{Roy S.\}",

note = "Publisher Copyright: {\textcopyright} 2022, The Author(s).",

year = "2023",

month = jan,

doi = "10.3758/s13428-021-01762-8",

language = "English",

volume = "55",

pages = "364--416",

journal = "Behavior Research Methods",

issn = "1554-351X",

publisher = "Springer Nature",

number = "1",

}

Holmqvist, K, Örbom, SL, Hooge, ITC, Niehorster, DC, Alexander, RG, Andersson, R, Benjamins, JS, Blignaut, P, Brouwer, AM, Chuang, LL, Dalrymple, KA, Drieghe, D, Dunn, MJ, Ettinger, U, Fiedler, S, Foulsham, T, van der Geest, JN, Hansen, DW, Hutton, SB, Kasneci, E, Kingstone, A, Knox, PC, Kok, EM, Lee, H, Lee, JY, Leppänen, JM, Macknik, S, Majaranta, P, Martinez-Conde, S, Nuthmann, A, Nyström, M, Orquin, JL, Otero-Millan, J, Park, SY, Popelka, S, Proudlock, F, Renkewitz, F, Roorda, A, Schulte-Mecklenbeck, M, Sharif, B, Shic, F, Shovman, M, Thomas, MG, Venrooij, W, Zemblys, R & Hessels, RS 2023, 'Eye tracking: empirical foundations for a minimal reporting guideline (Retracted Article)', Behavior Research Methods, vol. 55, no. 1, pp. 364-416. https://doi.org/10.3758/s13428-021-01762-8

TY - JOUR

T1 - Eye tracking

T2 - empirical foundations for a minimal reporting guideline (Retracted Article)

AU - Holmqvist, Kenneth

AU - Örbom, Saga Lee

AU - Hooge, Ignace T.C.

AU - Niehorster, Diederick C.

AU - Alexander, Robert G.

AU - Andersson, Richard

AU - Benjamins, Jeroen S.

AU - Blignaut, Pieter

AU - Brouwer, Anne Marie

AU - Chuang, Lewis L.

AU - Dalrymple, Kirsten A.

AU - Drieghe, Denis

AU - Dunn, Matt J.

AU - Ettinger, Ulrich

AU - Fiedler, Susann

AU - Foulsham, Tom

AU - van der Geest, Jos N.

AU - Hansen, Dan Witzner

AU - Hutton, Samuel B.

AU - Kasneci, Enkelejda

AU - Kingstone, Alan

AU - Knox, Paul C.

AU - Kok, Ellen M.

AU - Lee, Helena

AU - Lee, Joy Yeonjoo

AU - Leppänen, Jukka M.

AU - Macknik, Stephen

AU - Majaranta, Päivi

AU - Martinez-Conde, Susana

AU - Nuthmann, Antje

AU - Nyström, Marcus

AU - Orquin, Jacob L.

AU - Otero-Millan, Jorge

AU - Park, Soon Young

AU - Popelka, Stanislav

AU - Proudlock, Frank

AU - Renkewitz, Frank

AU - Roorda, Austin

AU - Schulte-Mecklenbeck, Michael

AU - Sharif, Bonita

AU - Shic, Frederick

AU - Shovman, Mark

AU - Thomas, Mervyn G.

AU - Venrooij, Ward

AU - Zemblys, Raimondas

AU - Hessels, Roy S.

PY - 2023/1

Y1 - 2023/1

N2 - In this paper, we present a review of how the various aspects of any study using an eye tracker (such as the instrument, methodology, environment, participant, etc.) affect the quality of the recorded eye-tracking data and the obtained eye-movement and gaze measures. We take this review to represent the empirical foundation for reporting guidelines of any study involving an eye tracker. We compare this empirical foundation to five existing reporting guidelines and to a database of 207 published eye-tracking studies. We find that reporting guidelines vary substantially and do not match with actual reporting practices. We end by deriving a minimal, flexible reporting guideline based on empirical research (Section “An empirically based minimal reporting guideline”).

AB - In this paper, we present a review of how the various aspects of any study using an eye tracker (such as the instrument, methodology, environment, participant, etc.) affect the quality of the recorded eye-tracking data and the obtained eye-movement and gaze measures. We take this review to represent the empirical foundation for reporting guidelines of any study involving an eye tracker. We compare this empirical foundation to five existing reporting guidelines and to a database of 207 published eye-tracking studies. We find that reporting guidelines vary substantially and do not match with actual reporting practices. We end by deriving a minimal, flexible reporting guideline based on empirical research (Section “An empirically based minimal reporting guideline”).

UR - https://www.scopus.com/pages/publications/85128036972

U2 - 10.3758/s13428-021-01762-8

DO - 10.3758/s13428-021-01762-8

M3 - Article

C2 - 35384605

AN - SCOPUS:85128036972

SN - 1554-351X

VL - 55

SP - 364

EP - 416

JO - Behavior Research Methods

JF - Behavior Research Methods

IS - 1

ER -

Eye tracking: empirical foundations for a minimal reporting guideline (Retracted Article)

Abstract

Bibliographical note

Access to Document

Other files and links

Fingerprint

Cite this