AI-designed material enables super-resolution display

Technology News |
By Rich Pell

Researchers at UCLA say they have created a deep learning-designed transmissive material that can project super-resolved images using low-resolution image displays. The researchers used deep learning to spatially-engineer transmissive diffractive layers at the wavelength scale, and created a material-based physical image decoder that achieves super-resolution image projection as the light is transmitted through its layers.

This diffractive image decoder, say the researchers, can be scaled to operate at visible wavelengths and used to design large SBP displays that are compact, low power, and computationally efficient. This holds promise for next-generation augmented/virtual reality (AR/VR) systems with holographic image displays that use coherent light illumination to emulate the 3D optical waves representing, for example, the objects within a scene.

These holographic image displays can potentially simplify the optical setup of a wearable display, leading to compact and lightweight form factors. Traditionally, however, the capabilities of holographic image projection systems are restricted mainly due to the limited number of independently controllable pixels in existing image projectors and spatial light modulators.

“Imagine there is a stream of high-resolution images waiting in the cloud or your local PC to be sent to your head-mounted or wearable display for your visualization,” say the researchers. “Instead of sending these high-resolution images to your wearable display, this new technology first runs them through a digital neural network (the encoder) to compress them into lower-resolution images that look like bar-codes, not meaningful to the human eye.”

However, this image compression is unlike other digital image compression methods because it is not decoded or decompressed in a computer. Instead, the transmissive material-based diffractive decoder decompresses these lower-resolution images all optically and projects the desired high-resolution images as the light from the low-resolution display passes through thin layers of the diffractive decoder.

Therefore, the image decompression from low to high resolution is completed using only light diffraction through a passive and thin structured material, making the whole process extremely fast since the transparent diffractive decoder could be as thin as a stamp. In addition to being ultra-fast, this diffractive image decoding scheme is also energy-efficient since the image decompression process follows light diffraction through a passive material and does not consume power except for the illumination light.

The researchers say they showed that these diffractive decoders designed by deep learning can achieve a super-resolution factor of ~4 in each lateral direction of an image, corresponding to a ~16-fold increase in the effective number of useful pixels in the projected images. In addition to improving the resolution of the projected images, this diffractive image display also provides a significant decrease in data transmission and storage requirements thanks to encoding the high-resolution images into compact optical representations with a lower number of pixels, which significantly reduces the amount of information that needs to be transmitted to a wearable display.

The researchers say they have experimentally demonstrated their diffractive super-resolution image display using 3D-printed diffractive decoders that operate at the terahertz part of the electromagnetic spectrum, which is frequently used in, for example, security image scanners at airports. The researchers also reported that the super-resolution capabilities of the presented diffractive decoders could be extended to project color images with red, green and blue wavelengths.

“This diffractive super-resolution image display design will inspire display solutions with enhanced resolution, potentially forming the building blocks of next-generation 3D display technology including, for example, head-mounted devices,” says Professor Aydogan Ozcan, the principal investigator of the research.

For more, see “Super-resolution image display using diffractive decoders.”


Linked Articles