Built for Snap\u2019s fifth-generation AR glasses (Snap Spectacles), the prototype uses Google\u2019s Gemini AI to identify branded content and instantly mask it.<\/p>\n
Instead of the original imagery, the app places a bright red square over the detected ad. <\/p>\n
These red blocks also name the hidden brand, like \u201cBol. billboard,\u201d turning ad removal into a kind of real-time brand callout.<\/p>\n
\u201cIt\u2019s exciting to imagine a future where you control the physical content you see,\u201d Spanhove posted on X (formerly Twitter). In follow-up replies, he hinted at additional features, including options to replace the red square with personal photos or text from a notes app. Check it out below \u2013 <\/p>\n
\n\ud83d\udeab\ud83d\udd76\ufe0f I’ve been building an XR app for a real-world ad blocker using Snap @Spectacles<\/a>. It uses Gemini to detect and block ads in the environment.<\/p>\n
It\u2019s still early and experimental, but it\u2019s exciting to imagine a future where you control the physical content you see. pic.twitter.com\/ySkFfF6rxS<\/a><\/p>\n<\/blockquote>\n
The app relies on Snap\u2019s Depth Cache API to register objects in 3D space and maintain spatial consistency as the user moves. <\/p>\n
Gemini, Google<\/a>\u2019s generative AI model, identifies the ads themselves, whether on large posters, newspaper pages, or food packaging.<\/p>\n
This allows the blocker to function beyond obvious signage. In demo clips shared by Spanhove, it successfully covers ads on cereal boxes, magazines, and public signage, though not without a delay of a second or two. <\/p>\n
The red overlays appear to float stably, following head movements and perspective shifts with accuracy.<\/p>\n
Still, it\u2019s early days. Spanhove describes the software as \u201cexperimental,\u201d and the user experience reflects that.<\/p>\n
Because Snap Spectacles use transparent displays<\/a>, the overlays can\u2019t fully block light, so the original ad sometimes faintly shows through. <\/p>\n
Also, the Spectacles\u2019 narrow 46-degree field of view limits coverage to only what\u2019s directly ahead.<\/p>\n