Skip to main content

Eye Gaze Data

caution

Aria Pilot Dataset documentation is stored in Archive: Aria Data Tools, because it was Project Aria's first open source initiative and it uses a different data structure compared to our latest open releases. For the most up to date tooling and to find out about our other open datasets go to Project Aria Tools.

This website will be deleted in September 2024.

Eye Gaze Data

Eye Gaze derived data uses data from Project Aria devices’ eye tracking cameras to estimate where the user is looking. Data from the eye tracking cameras are used to estimate a vector expressing the gaze direction. That vector is translated into a 2D pixel coordinate on the 120 degree FOV RGB camera image.

The Eye Gaze Data for each recording is stored in eyetracking/et_in_rgb_stream.csv.

In the csv file (x,y) represents the calibrated 2D pixel coordinate of gaze position.

Table 1: et_in_rgb_stream.csv Structure

timestamp_unix_ns Calibrated gaze position (pixel coordinate)
t x y
note

The provided timestamp is the timestamp of the eye camera image used to compute the gaze, not an RGB camera timestamp. To query the approximate location of eye gaze at RGB image timestamp, we suggest you interpolate gaze results from neighboring frames.

Figure 1: Eye Tracking Visualization