{"id":67522,"date":"2025-05-02T04:52:08","date_gmt":"2025-05-02T04:52:08","guid":{"rendered":"https:\/\/www.europesays.com\/uk\/67522\/"},"modified":"2025-05-02T04:52:08","modified_gmt":"2025-05-02T04:52:08","slug":"quest-devs-can-now-publish-apps-that-use-the-headsets-cameras-to-scan-the-world","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/uk\/67522\/","title":{"rendered":"Quest Devs Can Now Publish Apps That Use the Headset’s Cameras to Scan the World"},"content":{"rendered":"

While Meta\u2019s Quest has always relied heavily on cameras for tracking location of the headset, controllers, and the world around the user, developers haven\u2019t had the same privileged access to the headset\u2019s cameras. Earlier this year Meta gave developers the ability to experiment with direct access to the headset\u2019s cameras in private projects; starting this week developers can now publicly release apps that make use of the new feature.<\/p>\n

This week\u2019s update of the Passthrough Camera API for Quest<\/a> means that developers can now publish apps to the Horizon store that directly access the front-facing cameras of Quest 3 and 3S. This opens the door to third-party applications which can scan the world around the user to understand more about it. For instance, developers could add computer-vision capabilities to track objects or people in the scene, or to build a map of the environment for analysis and interaction.<\/p>\n

For a long time this was impossible due to limitations Meta placed on what developers could and couldn\u2019t do with the headset\u2019s hardware. Despite computer-vision capabilities being widely available to developers on smartphones, Meta was hesitant to allow the same on its headsets, apparently due to privacy concerns (and surely amplified by the many privacy controversies the company has faced in the past).<\/p>\n

Previously, third-party apps could learn some information about the world around the user\u2014like the shape of the room and objects within it\u2014but this information was provided by the system in a way that prevented apps from directly seeing what the cameras could see. This made it possible for developers to build mixed reality applications that were, to some extent, aware of the space around the user. But it made some use-cases difficult or even impossible; for example, tracking a specific object held by the user.<\/p>\n

Last year Meta announced it would finally unlock direct access to the headset\u2019s cameras. In March, it began offering an experimental version of the capability to developers, allowing them to build apps that accessed the headset\u2019s cameras. But they weren\u2019t allowed to publish those apps to the public, until now.<\/p>\n

The company has also specified the technical capabilities and performance of the cameras that the developers can access on Quest 3 and 3S:<\/p>\n