DeepMind update<\/a>\u00a0that\u00a0with a simple text prompt, Genie 3 can create dynamic, navigable scenes that run at 24 frames-per-second in 720p resolution.<\/p>\nGranted, Genie 3 can be only be used on flatscreen monitors, so there\u2019s no telling when we\u2019ll get something similar for VR headsets. For example, Quest 3\u2019s display has a per-eye resolution of 2,064 \u00d7 2,208, clocked at a base refresh rate of 90Hz, putting VR on the far end of the performance fringe (as usual).<\/p>\n
It\u2019s undoubtedly prescient look at things to come though. Unlike static or pre-rendered simulations, Google says the model generates each frame on the fly, allowing for quicker user interaction and environmental feedback.<\/p>\n<\/p>\n
What\u2019s more, these generated worlds can remain visually and physically consistent for several minutes, Google says, with the system retaining a form of short-term memory to reflect past actions.<\/p>\n
Genie 3 is also capable of simulating a wide range of scenarios, including natural environments, historical settings, and both fictional and animated worlds. Meanwhile, users can trigger \u201cpromptable world events,\u201d where users can insert in-world changes via text commands, like altering the weather or introducing new objects.<\/p>\n
Beyond the fun of recreating 1800\u2019s Osaka, or making a jet ski appear in the canals of Amsterdam, Google says Genie 3 will also be a tool for embodied AI training, with potential applications in fields like robotics, gaming, and artificial general intelligence research.<\/p>\n
For now, there are a few limitations. Google says Genie 3 currently has a limited \u201caction space\u201d for agents, and struggles with accurately modeling multi-agent interactions in shared environments. By \u201cagents,\u201d the company\u2019s referring to AI systems that operate autonomously within the virtual environments, in a way making decisions, taking actions, and learning from experience.<\/p>\n
It also faces challenges with simulating real-world locations with \u201cperfect geographic accuracy\u201d, rendering text clearly, and maintaining long-duration interactions beyond a few minutes.<\/p>\n
Still, it\u2019s a pretty amazing leap from the sort of non-interactive videos we\u2019re seeing online now, many of which are pretty difficult to tell from the real deal. Will Smith spaghetti-eating simulations are only going to get more lifelike and,\u00a0with systems like Genie 3, interactive too.<\/p>\n","protected":false},"excerpt":{"rendered":"DeepMind, Google\u2019s\u00a0AI research lab, announced the release of Genie 3, a new AI system capable of generating interactive…\n","protected":false},"author":2,"featured_media":323144,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3162],"tags":[53,16,15,3243,3244],"class_list":{"0":"post-323143","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-virtual-reality","8":"tag-technology","9":"tag-uk","10":"tag-united-kingdom","11":"tag-virtual-reality","12":"tag-vr"},"share_on_mastodon":{"url":"https:\/\/pubeurope.com\/@uk\/114983177527120275","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts\/323143","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/comments?post=323143"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts\/323143\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/media\/323144"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/media?parent=323143"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/categories?post=323143"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/tags?post=323143"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}