Exploring Image Collections via Eye Tracking

The goal of this project is to use state of the art in eye tracking to design, implement and evaluate different eye-tracking interfaces for Exquisitor.

The project is suitable for 1-3 well-qualified MSc students.

Image and media collections are becoming a central information resource for a growing number of domains. This calls for very effective tools for interactive exploration of the contents of those collections [1]. Since humans typically look at the targets of interest before making a selection, the eyes can become a very efficient means browsing media collections (e.g. to make selections and inform about user interest) [2]. We propose projects that intend to investigate eyetracking for efficient exploration of media using Exquisitor, a very scalable image browser based on relevance feedback [3]. The goal of the project is to use the state of the art in eye tracking to design, implement and evaluate different eye-tracking interfaces for the Exquisitor system. The project is suitable for 1-3 well-qualified MSc students. The intention is to publish the results, and demonstrate the system, in international research conferences. And the presentation of the MSc project should be quite interactive!References * [1]Björn Þór Jónsson, Marcel Worring, Jan Zahálka, Stevan Rudinac, Laurent Amsaleg. ​Ten ResearchQuestions for Scalable Multimedia Analytics​. Proceedings of the International Conference onMultimedia Modeling (MMM), Miami, FL, USA, January 2016. * [2]Dan Witzner Hansen, Qiang Ji. ​In the Eye of the Beholder: A Survey of Models for Eyes and Gaze​.IEEE Transactions on Pattern Recognition and Machine Intelligence (TPAMI), 32(3), March 2010.[3]Jan Zahálka, Stevan Rudinac, Björn Þór Jónsson, Dennis C. Koelma, Marcel Worring. ​Blackthorn: Large-Scale Interactive Multimodal Learning​. IEEE Transactions on Multimedia (TMM), 20(3), March2018.