2D to 3D conversion adds texture on top
Based on what the researchers call a beat phenomenon of voltage waveforms, the company demonstrated regional electrostatic stimulation by using a matrix of transparent Indium Tin Oxide (ITO) electrodes over the display’s glass substrate, covered by an acrylic insulator layer.
By driving the X (horizontal) and Y (vertical) electrodes at varying frequencies around 1000Hz, the researchers were able to modulate the resulting electrostatic forces at the cross points, so as to obtain a localized stimulus in the excited regions and create different textures – see figure 1.
Fig. 1: Electrostatic tactile display using beat phenomenon of voltage waveforms between electrodes.
When sliding your fingers across the display, this surface haptic effect reproduces skin sensations as if you were tracing actual objects on the display. With electrode pitches of 1.73mm (X) and 1.75mm (Y), the current prototype is able to emulate a given texture within an area covering multiple electrodes, roughly 4x4mm2 to be felt correctly via skin sensation.
This multi-touch haptic effect can be synchronized with the actual image on the display, so that users can feel the appropriate texture as they would expect from touching the real object.
In a statement, the company claimed that the technology could easily scale up for larger higher touch-density displays for applications ranging from texture sharing across the web to cockpit displays in autos and aircraft, and for devices aimed at the visually impaired, though Braille reading would require a finer resolution (around 1mm2 discrete patches).
While power consumption is under investigation, response time seems inherently faster than alternative haptic solutions, we were told in an email exchange with the company. The main feature here is the regional stimulation, something that piezo-based haptics would not be able to provide at such a fine resolution.
Now, creating the appropriate textures for such a haptic 2D display will require some form of automated image feature extraction, very much like for 2D to 3D content conversion, but adding tactile data on top of the display.
Last May, NLT Technologies also announced a new auto-stereoscopic display system relying on 3D eye-tracking to optimize parallax for an arbitrary viewpoint, so the company certainly has the knowhow to convert 2D content into a 2D + texture feel or 3D + tactile content.
When asking who would develop this, we were only told by the spokesperson: “I’m afraid that is confidential”, which hints at further exciting announcements.
The company makes these haptic effects available now.