Please use this identifier to cite or link to this item: http://hdl.handle.net/1893/27925
Appears in Collections:Computing Science and Mathematics Journal Articles
Peer Review Status: Refereed
Title: Benefiting from users' gaze: selection of image regions from eye tracking information for provided tags
Author(s): Walber, Tina
Scherp, Ansgar
Staab, Steffen
Contact Email: ansgar.scherp@stir.ac.uk
Keywords: Region identification
region labeling
gaze analysis
eye tracking
tagging
Issue Date: Jul-2014
Citation: Walber T, Scherp A & Staab S (2014) Benefiting from users' gaze: selection of image regions from eye tracking information for provided tags. Multimedia Tools and Applications, 71 (1), pp. 363-390. https://doi.org/10.1007/s11042-013-1390-3.
Abstract: Providing image annotations is a tedious task. This becomes even more cumbersome when objects shall be annotated in the images. Such region-based annotations can be used in various ways like similarity search or as training set in automatic object detection. We investigate the principle idea of finding objects in images by looking at gaze paths from users, viewing images with an interest in a specific object. We have analyzed 799 gaze paths from 30 subjects viewing image-tag-pairs with the task to decide whether a tag could be found in the image or not. We have compared 13 different fixation measures analyzing the gaze paths. The best performing fixation measure is able to correctly assign a tag to a region for 63 % of the image-tag-pairs and significantly outperforms three baselines. We look into details of the image region characteristics such as the position and size for incorrect and correct assignments. The influence of aggregating multiple gaze paths from several subjects with respect to improving the precision of identifying the correct regions is also investigated. In addition, we look into the possibilities of discriminating different regions in the same image. Here, we are able to correctly identify two regions in the same image from different primings with an accuracy of 38%.
DOI Link: 10.1007/s11042-013-1390-3
Rights: The publisher does not allow this work to be made publicly available in this Repository. Please use the Request a Copy feature at the foot of the Repository record to request a copy directly from the author. You can only request a copy if you wish to use this work for your own research or private study.

Files in This Item:
File Description SizeFormat 
Walber et al 2014.pdfFulltext - Published Version2.94 MBAdobe PDFUnder Permanent Embargo    Request a copy

Note: If any of the files in this item are currently embargoed, you can request a copy directly from the author by clicking the padlock icon above. However, this facility is dependent on the depositor still being contactable at their original email address.



This item is protected by original copyright



Items in the Repository are protected by copyright, with all rights reserved, unless otherwise indicated.

If you believe that any material held in STORRE infringes copyright, please contact library@stir.ac.uk providing details and we will remove the Work from public display in STORRE and investigate your claim.