Apple has reportedly filed a patent for a new mixed reality headset that tracks eyes, gestures and facial expressions of its user.
According to Variety, the patent is titled ‘Display System Having Sensors’ and features light sensors that collect light information like colour, intensity and direction; head pose sensors to track the user’s orientation and motion; world mapping sensors to track movement and location; eye tracking sensors; lower jaw sensors to track expression; hand sensors to track position, movement and gestures; eyebrow sensors to track facial expressions; an inertial measurement unit to augment the sensor information; and left and right cameras.
The headset’s processors would be in the controller.
“The controller is configured to render an avatar of the user’s face for display in the 3D virtual view based at least in part on information collected by the one or more eye tracking sensors, the one or more eyebrow sensors, and the one or more lower jaw sensors,” said the patent filing.
According to Apple, the VR system could use LCD, digital light processing or liquid crystal on silicon technology or even “a direct retinal projector system that scans left and right images, pixel by pixel, to the subject’s eyes.”
