The goal of Codec Avatars is to deliver social presence, the subconscious feeling that you’re truly with another person, despite them not physically being there. No flatscreen technology can do this. Video calls don’t even come close.<\/p>\n
To eventually ship Codec Avatars, Meta has been working on increasing the system’s realism and adaptability, reducing the real-time rendering requirements, and making it possible to generate them with a smartphone scan<\/a>.<\/p>\n For example, last week we reported on Meta’s latest progress<\/a> on highly realistic head-only Codec Avatars that can be generated from a selfie video of you rotating your head, plus around an hour of processing on a server GPU. This has become possible thanks to Gaussian splatting, which in recent years has done for realistic volumetric rendering what large language models (LLMs) did for chatbots.<\/p>\n <\/p>\n Meta\u2019s Photorealistic \u2018Codec Avatars\u2019 Now Have Changeable Hairstyles<\/p>\n Meta\u2019s prototype photorealistic \u2018Codec Avatars\u2019 now support changeable hairstyles, separately modeling the head and hair.<\/p>\n But that system was still designed to run on a powerful PC graphics card. Now, Meta researchers have figured out how to get their full-body<\/a> Codec Avatars running in real-time on Quest 3.<\/p>\n In a paper<\/a> called “SqueezeMe: Mobile-Ready Distillation of Gaussian Full-Body Avatars”, the researchers describe how they distilled their full-body photorealistic avatars to run on a mobile chipset, leveraging both the NPU and GPU.<\/p>\n You may have heard the term distillation in the context of LLMs, or AI in general. It refers to using the output of a large, computationally expensive model to train a much smaller model. The idea is that the small model can replicate the larger model efficiently, with minimal quality loss.<\/p>\n The researchers say SqueezeMe can render 3 full-body avatars at 72 FPS on a Quest 3, with almost no quality loss compared to the versions rendered on a PC.<\/p>\n However, there are a couple of key tradeoffs to note.<\/p>\n These avatars are generated using the traditional massive custom capture array of more than 100 cameras and hundreds of lights, not the new ‘universal model’ smartphone-scan approach of Meta’s other recent Codec Avatars research.<\/p>\n They also have flat lighting, and do not support dynamic relighting. This support is a flagship feature of Meta’s latest PC-based Codec Avatars, and would be crucial for making them fit into VR environments and mixed reality.<\/p>\n Still, this research is a promising step towards Meta eventually shipping Codec Avatars as an actual feature of its Horizon OS headsets.<\/p>\n Public pressure for Meta to ship what it has been researching for a decade has built up significantly this year as Apple is shipping its\u00a0new Personas<\/a>\u00a0in\u00a0visionOS 26<\/a>, effectively delivering on Meta’s promise.<\/p>\n However, neither Quest 3 nor Quest 3S have eye tracking or face tracking, and there’s no indication that Meta plans to imminently launch another headset with these capabilities. Quest Pro had both, but\u00a0was discontinued<\/a>\u00a0at the start of this year.<\/p>\n <\/p>\n Meta Connect 2025 Takes Place September 17 & 18<\/p>\n Meta Connect 2025 will take place on September 17 and 18, promising to \u201cpeel back the curtain on tomorrow\u2019s tech\u201d. Here\u2019s what we expect might be announced.<\/p>\n One possibility is that Meta launches a rudimentary flatscreen version of Codec Avatars with AI simulated face tracking first, to let you join WhatsApp and Messenger video calls with a more realistic form than\u00a0your Meta Avatar<\/a>.<\/p>\n![\"\"](\"https:\/\/www.europesays.com\/uk\/wp-content\/uploads\/2025\/08\/1754330171_551_Meta-Codec-Avatars-HairCUP-research-featured.png\"){kind=avatar}
<\/a><\/p>\n![\"\"](\"https:\/\/www.europesays.com\/uk\/wp-content\/uploads\/2025\/08\/Meta-SqueezeMe-distilled-full-body-Codec-Avatars-architecture.png\"){kind=avatar}
<\/p>\n![\"\"](\"https:\/\/www.europesays.com\/uk\/wp-content\/uploads\/2025\/08\/Meta-SqueezeMe-distilled-full-body-Codec-Avatars-quality-comparison.png\"){kind=avatar}
<\/p>\n![\"\"](\"https:\/\/www.europesays.com\/uk\/wp-content\/uploads\/2025\/08\/Meta-Connect-2025-3.png\")
<\/a><\/p>\n