{"id":25867,"date":"2026-05-03T13:15:15","date_gmt":"2026-05-03T13:15:15","guid":{"rendered":"https:\/\/www.europesays.com\/ai\/25867\/"},"modified":"2026-05-03T13:15:15","modified_gmt":"2026-05-03T13:15:15","slug":"mnw-deepfake-detector-tracks-evolving-ai-artifacts","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/ai\/25867\/","title":{"rendered":"MNW Deepfake Detector Tracks Evolving AI Artifacts"},"content":{"rendered":"

This article is part of our exclusive IEEE Journal Watch series<\/a> in partnership with IEEE Xplore.<\/p>\n

With the rise of AI-generated content online, it\u2019s becoming more difficult\u2014and more important\u2014to help the public identify whether an image, audio clip or video is real or fake. To combat the problem, a team of researchers from Microsoft<\/a>, Northwestern University<\/a> in Evanston, Ill., and Witness, a non-profit organization that assists activists and journalists in addressing the challenges associated with AI-generated content, have come together to create a novel dataset of AI-generated media to help build more robust detection systems.<\/p>\n

The researchers describe their new dataset, called the Microsoft-Northwestern-Witness (MNW) deepfake detection benchmark<\/a>, in a study<\/a> published 10 April in IEEE Intelligent Systems<\/a>. The dataset was intentionally built using diverse samples of AI-generated media in order to reflect the current AI-generation landscape as much as possible. <\/p>\n

Thomas Roca<\/a> is a principal research scientist at Microsoft who researches security around generative AI<\/a>. He says that the quality of media produced by generative AI<\/a> is constantly improving, and virtually anyone can now use something as simple as an app on their phone to generate a voice message reproducing a person\u2019s voice, or an image or video mimicking someone\u2019s appearance. <\/p>\n

The harm of such fake media<\/a> can be profound, ranging from identity fraud and scams<\/a> to the generation of non-consensual intimate imagery and even child sexual abuse material<\/a>.<\/p>\n

But AI generators are not perfect. They leave behind artifacts\u2014tiny signals or traces when they generate video, imagery, or audio that can confirm the media is fake. \u201cArtifacts can include noise distributions, inconsistencies between pixel patches, gaps in audio signals, and other irregularities,\u201d says Roca.<\/p>\n

Improving Deepfake<\/a> Detection Systems<\/p>\n

Research groups around the world have been creating detectors, which are essentially AI models<\/a> trained to identify artifacts in AI-generated media. However, it has been an arms race to see if detectors can keep pace with the generators, and unfortunately generators remain in the lead. <\/p>\n

\u201cAsserting the authenticity of video, images, and audio has become crucial for society, but detection systems are not yet up to the challenge,\u201d says Roca. \u201cWe believe this is partly due to how these systems are evaluated.\u201d<\/p>\n

For example, researchers may use many examples of AI content from a small handful of generators to train their detector. But this is likely to produce a detector that does not generalize well to new content. Generative AI is evolving so fast that this becomes a real issue.<\/p>\n

As a result, these detection systems can perform well when tested against their training dataset or well-established benchmarks, but then perform poorly in the real-world. \u201cAI in the lab is not AI in the wild,\u201d Roca says.<\/p>\n

\"Collage These AI-generated images are part of the Microsoft-Northwestern-Witness benchmark aiming to provide a wider variety of AI media to test detectors on.Thomas Roca, Marco Postiglione, et al.<\/p>\n

To get a more well-rounded view of the challenges, experts from Microsoft, Northwestern, and Witness worked together on the new MNW benchmark. \u201cTogether, these perspectives\u2014academia, industry, and field-oriented non-profit\u2014create a more complete approach. None of us could achieve this alone,\u201d says Macro Postiglione<\/a>, a post-doctoral researcher at Northwestern University.<\/p>\n

The new dataset aims to include a very diverse sample of AI-generated material from different generators to boost detectors\u2019 applicability in real-world settings.<\/p>\n

Postiglione says that fake videos, audio, and images online have often undergone post-processing procedures, such as resizing, cropping, and compressing. People may also intentionally manipulate content to make it harder to detect.<\/p>\n

The MNW team hopes to provide the most comprehensive set of examples possible from different generators and subjected to different post-processing manipulations, to ensure that the dataset is a good representation of the current generative AI landscape. The team will also update the dataset every spring and fall, to reflect the latest generator artifacts as well as tricks used to fool detection systems.<\/p>\n

The researchers acknowledge that while the dataset was created to help developers in benchmarking their detectors, there\u2019s always the chance it could be used to try and develop new ways to evade detection. But they see the need to address the issue of deepfake content as critical in spite of that chance.<\/p>\n

\u201cOur goal with MNW is to contribute to that shared effort\u2014raising standards, encouraging transparency, and helping ensure that as generative AI advances, our ability to assess authenticity keeps pace,\u201d says Roca.<\/p>\n

From Your Site Articles<\/p>\n

Related Articles Around the Web<\/p>\n","protected":false},"excerpt":{"rendered":"This article is part of our exclusive IEEE Journal Watch series in partnership with IEEE Xplore. With the…\n","protected":false},"author":2,"featured_media":25868,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[24,25,2657,223,17385,320],"class_list":{"0":"post-25867","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-ai","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-deepfakes","11":"tag-generative-ai","12":"tag-journal-watch","13":"tag-microsoft"},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/25867","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=25867"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/25867\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/25868"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=25867"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=25867"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=25867"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}