Radosław Mantiuk

West Pomeranian University of Technology, Szczecin, Poland

Gaze-driven Object Tracking for Real Time Rendering

Radosław Mantiuk ¹, Bartosz Bazyluk ¹, and Rafał Mantiuk ²

¹ West Pomeranian University of Technology, Szczecin, Poland,   ² Bangor University, Bangor, United Kingdom

Left: location of the attention targets used by the GDOT technique to estimate an observer gaze direction. Middle: results of the quality experiment after JND-scaling, the surface shows the best fitting function. Right: example eye movements captured by eye tracker.


To efficiently deploy eye-tracking within 3D graphics applications, we present a new probabilistic method that predicts the patterns of user’s eye fixations in animated 3D scenes from noisy eye-tracker data. The proposed method utilises both the eye-tracker data and the known information about the 3D scene to improve the accuracy, robustness and stability. Eye-tracking can thus be used, for example, to induce focal cues via gaze-contingent depth-of-field rendering, add intuitive controls to a video game, and create a highly reliable scene-aware saliency model. The computed probabilities rely on the consistency of the gaze scan-paths to the position and velocity of a moving or stationary target. The temporal characteristic of eye fixations is imposed by a Hidden Markov model, which steers the solution towards the most probable fixation patterns. The derivation of the algorithm is driven by the data from two eye-tracking experiments: the first experiment provides actual eye-tracker readings and the position of the target to be tracked. The second experiment is used to derive a JND-scaled (Just Noticeable Differ- ence) quality metric that quantifies the perceived loss of quality due to the errors of the tracking algorithm. Data from both experiments are used to justify design choices, and to calibrate and validate the tracking algorithms. This novel method outperforms commonly used fixation algorithms and is able to track objects smaller then the nominal error of an eye-tracker.

Publications (pre-prints): Mantiuk R., Bazyluk B., Mantiuk R. K., “Gaze-driven Object Tracking for Real Time Rendering”, Computer Graphics Forum (Proc. of Eurographics’13), Vol. 32, No. 2, 2013, pp.163-173, pdf, doibibtex, video.

Matlab implementation of the GDOT algorithm with a sample gaze data (gdot_matlab.zip).


journal = {Computer Graphics Forum}, 
title = {Gaze-driven Object Tracking for Real Time Rendering}, 
author = {Radoslaw Mantiuk and Bartosz Bazyluk and Rafal K. Mantiuk },
pages = {163--173},
volume= {32},
number= {2},
year = {2013},
URL = {http://diglib.eg.org/EG/CGF/volume32/issue2/v32i2pp163-173.pdf},
DOI = {10.1111/cgf.12036}