Apple’s Depth Pro AI: Revolutionizing Augmented Reality with Single-Image 3D Capture in Seconds
Apple's new AI tool, Depth Pro, may revolutionize augmented reality by capturing 3D spaces from a single image in just seconds.
A Leap Forward in Artificial Intelligence
Every week, the technological evolution of artificial intelligence (AI) astonishes us with new breakthroughs. This time, the innovation comes from a small company based in Cupertino.
Depth Pro: Apple’s New AI
While all eyes are on Apple Intelligence and its upcoming release, promising to bring context-specific AI features to everyday use, the company has also unveiled a new AI model named Depth Pro.
As the name suggests, this new AI is capable of mapping the depth of an image in real time. Its standout feature, however, is its ability to perform this task on standard home computing hardware, without the need for an Nvidia H100.
Potential Applications of Depth Pro
Depth Pro is a research model, not necessarily intended for production by Apple. However, should we one day see “Apple Glasses”, Depth Pro could certainly enhance the company’s augmented reality features, possibly even improving the functionalities of Vision Pro.
Apple’s new model assesses both relative and absolute depth, using them to create a “metric depth”. This data can then be utilized in various ways, in conjunction with the imagery.
When a user takes a photo, Depth Pro provides precise measurements between elements in the image. The model should also avoid inconsistencies, such as mistaking the sky as part of the background, or wrongly judging the foreground and background of a photo.
Diverse Uses for a Promising Technology
The potential applications of Depth Pro are nearly limitless. Autonomous vehicles, drones, and robot vacuums could use precise depth detection to enhance object avoidance. Augmented reality technology and online furniture stores could help more accurately place items in a room, whether real or virtual.
Medical technology could also be enhanced by depth perception, aiding in the reconstruction of anatomical structures and the mapping of internal organs. Lastly, Depth Pro could contribute to a more precise transition from images to video using generative AI like Luma Dream Machine.