Since the launch of the Galaxy Z Fold8 series, one feature has been generating buzz among K-pop fans as a must-have \u2014 My FanCam. Users simply select a person in a video and My FanCam automatically tracks their movements throughout.<\/p>\n
The feature makes it easy to put someone in the spotlight, from a favorite artist in concert footage to family and friends in everyday moments.<\/p>\n
<\/p>\n
(From left) Sherry Hong, Sunghwan Kim, and Hwangpil Park<\/p>\n
\u00a0<\/p>\n
Behind this experience is Samsung Research\u2019s AI technology for reliably tracking people in video, integrated into a mobile feature through close collaboration with the MX Business. Samsung Newsroom spoke with Hwangpil Park of the Visual Technology Team at Samsung Research as well as Sunghwan Kim and Sohee Hong of the Multimedia Development Group at the MX Business about My FanCam.<\/p>\n
A User-Centered Approach
\n
Q. What inspired My FanCam?<\/p>\n
Hong:\u00a0We started by asking how we could make it easier for users to create videos focused on the people they want to see. As shooting, editing, and sharing content on smartphones have become commonplace, fan cams of favorite artists have gained popularity on social media. In response to this trend, we envisioned My FanCam \u2014 a feature that lets anyone create a video centered on a person of their choice with just a few taps \u2014 and worked with Samsung Research to bring the idea to life.<\/p>\n
The Technology Behind Reliable Tracking
\n
Q. What technology enables My FanCam to continuously track someone in a video?<\/p>\n
Park:\u00a0The key to My FanCam\u2019s ability to follow a selected person even in complex scenes is an AI model that precisely recognizes individuals. The model identifies and remembers each person\u2019s location and visual characteristics, allowing it to recognize the same person throughout the video and continue tracking them.<\/p>\n
<\/p>\n
My FanCam\u2019s process<\/p>\n
\u00a0<\/p>\n
Q. What was the main focus for the user experience?<\/p>\n
Kim:\u00a0We focused on reducing wait times while editing. Users may want to switch between people in group videos, but reanalyzing the video each time would mean waiting again. We designed My FanCam to analyze multiple people at once, letting users switch between subjects and instantly see the results once the initial analysis is complete.
\u00a0<\/p>\n
Users can switch between people after the initial video analysis
\u00a0<\/p>\n
We also simplified the editing process. Users can easily adjust the aspect ratio to fit the scene and create a video that suits their needs.<\/p>\n
<\/p>\n
My FanCam\u2019s aspect ratio adjustment feature<\/p>\n
Q. How did the two teams collaborate to turn the technology into a Galaxy feature?<\/p>\n
Hong:\u00a0It was crucial not only to identify the issues, but also finding a solution for the said issues; validating that the results were key to our process. The more the concept was solidified, the more full-fledged the development process took. In order to keep up with the development progress, weekly meetings turned into daily meetings and in those daily meetings, we made sure to track progress every morning.<\/p>\n
Testing a large range of scenarios is important before rolling out new features. To help the development team test with a wide range of scenarios, multiple team members helped with the process. Some brought in old videos from the college days, such as dance club videos. Others would bring a phone and film new footage, such as climbing hobbies.<\/p>\n
<\/p>\n
Hong shows a personal video used for testing<\/p>\n
\u00a0<\/p>\n
Park:\u00a0Technology that worked well in a research environment sometimes performed differently with real-world footage due to variables such as fast movement and people overlapping in the frame. When the MX Business shared these cases, Samsung Research analyzed the causes and refined the AI model and tracking methods. We then validated the changes in the product environment, repeating the process to improve the feature.<\/p>\n
<\/p>\n
Park discusses the development of My FanCam<\/p>\n
\u00a0<\/p>\n
Q. What was the biggest challenge in bringing My FanCam to mobile devices?<\/p>\n
Kim:\u00a0The key challenge was processing AI workloads entirely on-device without a separate server. Longer videos require more computation, so we had to consider processing speed, power consumption, and heat generation. Samsung Research optimized the AI model to achieve the required results with less computation, while the MX Business streamlined the entire process \u2014 from video decoding to data transfer and analysis \u2014 reducing computational load with minimal impact on performance.<\/p>\n
<\/p>\n
Kim explains how My FanCam was optimized for on-device performance<\/p>\n
\u00a0<\/p>\n
Park:\u00a0We also had to account for situations that can make it difficult to select a person in videos. At school performances or sports days, for example, the person users want to focus on may not appear until midway through the video or may be obscured by others. We therefore designed My FanCam so users can find a moment when their subject is clearly visible and select them at any point in the video.<\/p>\n
From Favorite Artists to Everyday Moments
\n
Q. Any tips for getting the most out of My FanCam?<\/p>\n
Kim:\u00a0When filming, I recommend using a high-resolution setting and framing the shot a little wider to leave space around the person. When selecting a subject, choose a frame where they don\u2019t overlap too much with others and their face, upper body or full body is clearly visible.<\/p>\n
My FanCam also works with existing footage, such as videos of past concerts, trips or children\u2019s activities. Because users don\u2019t need to follow a particular person while filming, they can focus more on the moment itself.<\/p>\n
For example, users can set up a tripod to film a workout, then use My FanCam to create a video centered on themselves without someone else behind the camera.\u00a0<\/p>\n
<\/p>\n
My FanCam in different scenarios<\/p>\n
\u00a0<\/p>\n
Q. How do you hope users will use My FanCam?<\/p>\n
Park:\u00a0Since My FanCam works with videos not shot on a Galaxy device, I hope people will try it with a wide range of footage. It can offer a fresh perspective on old videos, helping users revisit meaningful moments by focusing on someone special.<\/p>\n
Hong:\u00a0Some may think that being a fan is only about liking an idol or celebrity. But to me, it simply means caring deeply about someone or something \u2014 whether that\u2019s an artist, family member, friend, or even yourself. I\u2019d like to see people use My FanCam to capture the people and moments that matter to them.<\/p>\n
<\/p>\n
Developers discuss how collaboration made My FanCam possible<\/p>\n
What began as an idea focused on user convenience has evolved into My FanCam, a new video experience combining AI, mobile optimization and close teamwork. From concerts to everyday life, My FanCam makes it easier to capture and edit videos of moments worth remembering.<\/p>\n
In part two of this series, Samsung Newsroom will explore how the large-aperture camera lens emulation technology brings the expressive qualities of professional lenses to mobile devices and the collaboration behind its development<\/p>\n","protected":false},"excerpt":{"rendered":"Since the launch of the Galaxy Z Fold8 series, one feature has been generating buzz among K-pop fans…\n","protected":false},"author":2,"featured_media":138530,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[17],"tags":[13251,11653,11589,45836,68403,127,223,9138],"class_list":["post-138529","post","type-post","status-publish","format-standard","has-post-thumbnail","category-samsung","tag-camera","tag-galaxy-ai","tag-galaxy-z-fold8","tag-galaxy-z-series","tag-my-fancam","tag-samsung","tag-samsung-group","tag-samsung-research"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/korea\/wp-json\/wp\/v2\/posts\/138529","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/korea\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/korea\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/korea\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/korea\/wp-json\/wp\/v2\/comments?post=138529"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/korea\/wp-json\/wp\/v2\/posts\/138529\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/korea\/wp-json\/wp\/v2\/media\/138530"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/korea\/wp-json\/wp\/v2\/media?parent=138529"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/korea\/wp-json\/wp\/v2\/categories?post=138529"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/korea\/wp-json\/wp\/v2\/tags?post=138529"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}