Does Gaze Interaction work for UWP app on HoloLens 2 using its inbuilt eye tracker

360 views Asked by At

I'm trying to get gaze interaction to work for buttons in my UWP application on HoloLens 2. The MS Dynamics Guides example does work.

I've tried the simple application described below and ran that - no luck.

https://learn.microsoft.com/en-us/windows/uwp/design/input/gaze-interactions

I've downloaded the community toolkit below and ran that - no luck.

https://learn.microsoft.com/en-us/windows/communitytoolkit/gaze/gazeinteractionlibrary

The eye tracker privacy options have been manually set to allow for the apps, the ask for permissions box is not appearing automatically. The toolkit has a "Please attach eye tracking device" error message.

Gaze Error from Community Toolkit Sample

I must be missing something obvious - any help appreciated.

Cheers

Mark

1

There are 1 answers

1
Hernando - MSFT On

What we want to point out is that you should use the SpatialPointerPose API to access head and eye-gaze rays on the HoloLens2. For more detailed information about how to access eye tracking data, please refer to our developer guides for using eye-gaze in DirectX

Besides, OpenXR is another way Windows Mixed Reality supports to do that, you can start developing OpenXR applications for HoloLens 2 with this guide. And Microsoft provided the EyeGazeInteractionUwp Sample shows the usage of XR_EXT_eye_gaze_interaction extension.