Link Anchors in Images: Is there Truth?

Franciska de Jong, RBN Aly, Martijn Kleppe, RJF Ordelman, N O'Connor

Research output: Chapter/Conference proceedingConference proceedingAcademicpeer-review


While automatic linking in text collections is well understood, little is known about links in images. In this work, we investigate two aspects of anchors, the origin of a link, in images: 1) the requirements of users for such anchors, e.g. the things users would like more information on, and 2) possible evaluation methods assessing anchor selection algorithms. To investigate these aspects, we perform a study with 102 users. We find that 59% of the required anchors are image segments, as opposed to the whole image, and most users require information on displayed persons. The agreement of users on the required anchors is too low (often below 30%) for a ground truth-based evaluation, which is the standard IR evaluation method. As an alternative, we propose a novel evaluation method based on improved search performance and user experience.
Original languageEnglish
Title of host publicationProceedings of the 12th Dutch Belgian Information Retrieval Workshop
Place of PublicationGhent, Belgium
Number of pages4
Publication statusPublished - 24 Feb 2012
Externally publishedYes


Dive into the research topics of 'Link Anchors in Images: Is there Truth?'. Together they form a unique fingerprint.

Cite this