Please use this identifier to cite or link to this item:
http://hdl.handle.net/10397/89024
Title: | Overt attentional correlates of memorability of scene images and their relationships to scene semantics | Authors: | Lyu, M Choe, KW Kardan, O Kotabe, HP Henderson, JM Berman, MG |
Issue Date: | 2020 | Source: | Journal of vision, 2020, v. 20, no. 9, p. 1-17 | Abstract: | Computer vision-based research has shown that scene semantics (e.g., presence of meaningful objects in a scene) can predict memorability of scene images. Here, we investigated whether and to what extent overt attentional correlates, such as fixation map consistency (also called inter-observer congruency of fixation maps) and fixation counts, mediate the relationship between scene semantics and scene memorability. First, we confirmed that the higher the fixation map consistency of a scene, the higher its memorability. Moreover, both fixation map consistency and its correlation to scene memorability were the highest in the first 2 seconds of viewing, suggesting that meaningful scene features that contribute to producing more consistent fixation maps early in viewing, such as faces and humans, may also be important for scene encoding. Second, we found that the relationship between scene semantics and scene memorability was partially (but not fully) mediated by fixation map consistency and fixation counts, separately as well as together. Third, we found that fixation map consistency, fixation counts, and scene semantics significantly and additively contributed to scene memorability. Together, these results suggest that eye-tracking measurements can complement computer vision-based algorithms and improve overall scene memorability prediction. | Publisher: | Association for Research in Vision and Ophthalmology | Journal: | Journal of vision | EISSN: | 1534-7362 | DOI: | 10.1167/jov.20.9.2 | Rights: | Copyright 2020 The Authors. This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (https://creativecommons.org/licenses/by-nc-nd/4.0/). The following publication Muxuan Lyu, Kyoung Whan Choe, Omid Kardan, Hiroki P. Kotabe, John M. Henderson, Marc G. Berman; Overt attentional correlates of memorability of scene images and their relationships to scene semantics. Journal of Vision 2020;20(9):2, is available at https://doi.org/10.1167/jov.20.9.2. |
Appears in Collections: | Journal/Magazine Article |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Lyu_Overt_attentional_correlates.pdf | 4.81 MB | Adobe PDF | View/Open |
Page views
25
Last Week
0
0
Last month
Citations as of Apr 28, 2024
Downloads
13
Citations as of Apr 28, 2024
SCOPUSTM
Citations
6
Citations as of Apr 4, 2024
WEB OF SCIENCETM
Citations
5
Citations as of May 2, 2024
Google ScholarTM
Check
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.