AI imaging app turns smartphones into 3D capture devices
Based on the company’s cloud-based image processing software, the Matterport 3D Capture for Smartphones will create 3D experiences derived from standard smartphone cameras. This new capability, says the company, is made possible by advancements in its Cortex AI-powered image-processing technology.
“Matterport aims to achieve full camera and capture ubiquity that will allow us to digitize the entire built world,” says Matterport CEO RJ Pittman. “Creating a 3D solution compatible with smartphones is a huge step towards reaching that goal, allowing the broader community of billions of iPhone and Android users to access the capabilities of our technology.”
The company’s Cortex technology features three-dimensional intelligence that can understand objects, rooms, and the detailed characteristics of any physical space. The technology is trained on the company’s dataset comprising billions of 3D data points and can construct 3D digital twins from two-dimensional images.
“The digital transformation of the built world will fundamentally change the way people interact with buildings and the physical world around them,” says Pittman. “Matterport’s 3D capture is foundational to this transformation because our unique technology is creating the data layer on which businesses and individuals can interoperate across industries.”
In addition to the 3D capture for smartphones announcement, the company also announced a new spatial awareness functionality that enables users to interactively measure and share the dimensions of any space – including floor plans, doorways, windows and walls – automatically. This feature, says the company, strengthens the impact of Matterport 3D experiences across applications and industries, from helping prospective home buyers know whether furniture will fit in a space, to making it easier for contractors to more accurately and efficiently document dimensions during the construction or renovation process.
The new spatial data features were announced and demonstrated alongside planned updates to the company’s flagship app and cloud services, which include:
- Android compatibility for the Matterport Capture app, enabling anyone with an Android device to scan a space when connected to a compatible camera.
- The announcement of a planned developer program and updated SDK, offering extended functionality and robust developer APIs.
The new 3D Capture for Smartphones feature will support iPhone and Android devices. The first iPhone version is expected to be available in beta by the end of the year.
Related articles:
AI-enhanced 3D imaging coming to smartphones
Handheld AR system blends digital models with real-world environments
On-device AI growing fast among smartphones