There is a 3D world reflection in your eyes

There is a 3D world reflection in your eyes

Technology News |
By Wisse Hettinga

Rendering three-dimensional images from eye reflections with NeRF

Vision depends on light entering the eyes through the transparent tissues of the cornea, pupil and lens. When the light reaches the retina, photoreceptors produce signals and transmit them via the optical nerve to the brain, where an image is formed. Some of that light entering the eye is reflected back into the world by a highly reflective thin film of fluid covering the cornea.

Researchers at the University of Maryland were able to capture this reflected light and extract a three-dimensional model of the surroundings. In a paper on the pre-print server arXiv, titled “Seeing the World through Your Eyes,” the team describes the methods used to capture the eye reflections and transform them into coherent 3D renderings using a specially trained AI visual rendering algorithm called NeRF.

A neural radiance field (NeRF) is an AI neural network that can generate novel continuous views of complex 3D scenes based on multiple 2D images. Typically with a few dozen still images at different angles, NeRF can generate a 3D representation with enough depth and detail to be almost indistinguishable from a video that can move around an object or space.

Source: Techexplore

See for yourself here


Linked Articles