{"id":48176,"date":"2026-05-22T13:08:28","date_gmt":"2026-05-22T13:08:28","guid":{"rendered":"https:\/\/www.europesays.com\/ai\/48176\/"},"modified":"2026-05-22T13:08:28","modified_gmt":"2026-05-22T13:08:28","slug":"why-enterprise-ai-keeps-stalling-and-how-data-streaming-could-unlock-it","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/ai\/48176\/","title":{"rendered":"Why enterprise AI keeps stalling \u2014 and how data streaming could unlock it"},"content":{"rendered":"<p>Enterprise AI is running into a problem. But it has more to do with data infrastructure than model quality. The snag is that most businesses still keep data fragmented across databases, SaaS tools, warehouses, and internal platforms, with security controls layered on top to protect each surface area separately.\u00a0<\/p>\n<p>That works fine in a batch world, but it becomes a serious constraint once agents and AI applications have to reason across live business data, <a href=\"https:\/\/www.linkedin.com\/in\/seanf\/\" class=\"ext-link\" rel=\"external  nofollow noopener\" onclick=\"this.target=&#039;_blank&#039;;\" target=\"_blank\">Sean Falconer<\/a>, head of AI at data streaming platform Confluent, tells The New Stack.<\/p>\n<p>\u201cMost AI projects fail before they even reach a single customer because the data layer breaks down,\u201d \u00a0Falconer says. \u201cTeams have the models and mandate, but security risks and fragmented data stop them from shipping.\u201d<\/p>\n<p>Confluent\u2019s aim is to make real-time data streaming the secure foundation for AI apps and agents, with controls and developer tooling that high-stakes industries need.<\/p>\n<p>Confluent\u2019s aim is to make real-time data streaming the secure foundation for AI apps and agents, with controls and developer tooling that high-stakes industries need.<\/p>\n<p>So while teams can build convincing demos, they often can\u2019t go beyond POCs. According to <a href=\"https:\/\/www.mckinsey.com\/capabilities\/mckinsey-technology\/our-insights\/building-the-foundations-for-agentic-ai-at-scale\" class=\"ext-link\" rel=\"external  nofollow noopener\" onclick=\"this.target=&#039;_blank&#039;;\" target=\"_blank\">McKinsey<\/a>, eight in ten companies cite data limitations as a roadblock to scaling agentic AI. It\u2019s the gap Confluent wants to close with its new <a href=\"https:\/\/www.confluent.io\/blog\/2026-q2-confluent-intelligence-update\/\" class=\"ext-link\" rel=\"external  nofollow noopener\" onclick=\"this.target=&#039;_blank&#039;;\" target=\"_blank\">Confluent Intelligence<\/a> and <a href=\"https:\/\/www.confluent.io\/blog\/2026-q2-confluent-cloud-launch\/\" class=\"ext-link\" rel=\"external  nofollow noopener\" onclick=\"this.target=&#039;_blank&#039;;\" target=\"_blank\">Confluent Cloud<\/a> capabilities, launched in London on May 19. The aim is to make real-time data streaming the secure foundation for AI apps and agents, with controls and developer tooling that high-stakes industries need.<\/p>\n<p>Plenty of firms built security controls across systems and carved their data into separate swimlanes decades ago. It made sense then, but now it gets in the way of AI. Leaders are faced with an ugly trade-off: over-provision access to agents, stall the projects, or centralize the data and hope performance and control hold up. None of those options is ideal.<\/p>\n<p>Why AI needs live context<\/p>\n<p>For Falconer, one of the biggest bottlenecks isn\u2019t the models, it\u2019s access to current data. \u201cI see a demo like a movie set, with a fake cityscape, where I\u2019ve paid the extras to be in the background,\u201d he says. \u201cReal cities are going to be a lot more complicated and unpredictable.\u201d The hard part comes when a polished demo has to survive real users and real data.<\/p>\n<p>Take an airline that uses a customer support agent to help passengers rebook flights. \u201cOld data could mean putting a customer on a flight that no longer exists, or into a seat that\u2019s already been taken \u2014 all of it is bad news,\u201d says Falconer, adding that the whole point is to create a better user experience and a more streamlined process. Real-time accuracy is no longer a nice-to-have for AI systems; it\u2019s the difference between a convincing demo and something that functions in the wild.<\/p>\n<p>\u201cI\u2019ve got 10,000 hours under my belt, so I have the historical reference on how to drive\u2026 But if my camera feed of the road ahead only updates every two hours, how long is it before I crash?\u201d<\/p>\n<p>To deliver on its promises, AI requires two kinds of intelligence: historical pattern recognition and real-time signals. Falconer likens it to driving. \u201cI\u2019ve got 10,000 hours under my belt, so I have the historical reference on how to drive,\u201d he says. \u201cBut if my camera feed of the road ahead only updates every two hours, how long is it before I crash?\u201d\u00a0<\/p>\n<p>The same logic applies to enterprise AI. Companies have spent decades building up historical data and batch systems, but have underinvested in the ability to process what\u2019s happening now. That\u2019s the leap: AI agents need both memory and live context if they\u2019re to make safe operational decisions.<\/p>\n<p>Easier, safer streaming<\/p>\n<p>Confluent wants to help teams move away from hand-crafted plumbing and towards a more guided way of working with streaming systems. The latest additions, including its managed MCP server, agent skills, and dbt adapter, are designed to reduce friction in configuration and setup while democratizing access for developers who aren\u2019t as familiar with, or don\u2019t live in, that environment day-to-day. In practice, that means people can express what they need in natural language, then use familiar workflows to build, manage, and debug streaming operations.\u00a0<\/p>\n<p>The point isn\u2019t just ease. Falconer argues that when teams have to work around cumbersome setup or opaque tooling, they often end up working around the security model too. By contrast, if the system is opinionated and easier to use, more people are likely to stay inside the approved path. As he puts it, the skills are really \u201crecipes\u201d that capture Confluent\u2019s own best practices, so developers don\u2019t have to reconstruct all that domain knowledge themselves.<\/p>\n<p>It comes with a warning label, though. Falconer is clear that models remain non-deterministic, so the question is also how to keep them controlled. Confluent\u2019s managed MCP server is read-only and maps back to existing RBAC, roles, and credentials. At the same time, the skills layer is more flexible and better suited to staging or development environments than direct production changes.<\/p>\n<p>An important distinction for enterprise teams, which reflects the reality of modern AI development: experimentation is useful, but production still needs determinism. \u201cWith production environments, use tools within a staging or deployment environment, and once you know it\u2019s working correctly, use a system like Terraform to push them into production in a repeatable way,\u201d says Falconer.<\/p>\n<p>The same logic applies to data movement. Confluent\u2019s stream processing layer can link to external databases, pull in context for AI, enrich a datastream, or talk to large language models in a customer\u2019s cloud environment \u2014 but those connections shouldn\u2019t need to travel over the public internet. When Confluent Cloud is running alongside a customer\u2019s own Azure-hosted systems, communication between those surfaces stays on Microsoft\u2019s private backbone.<\/p>\n<p>That\u2019s key because the enterprise case for AI is increasingly about securely moving context around, not just moving data quickly. Confluent is also pushing privacy deeper into the stack, with built-in PII detection and redaction in Flink SQL, so sensitive data can be handled in the stream rather than routed out to a warehouse first.<\/p>\n<p>Real-world proof<\/p>\n<p>Financial services already run on streams of events \u2014 card transactions, login attempts, wire transfers, and ATM activity. \u201cBut historically, it\u2019s been difficult to run advanced AI models directly within livestreams in a secure, governed way,\u201d points out Falconer. The usual fallback has been to batch everything into a warehouse and detect fraud later, which means action can come hours or days after the event.<\/p>\n<p>The launch, which includes support for TimesFM, shifts that work closer to the point of data creation, with more adaptive anomaly detection and less model tuning. That way, teams can spot account takeover patterns or abnormal transaction spikes immediately, rather than after costs have already mounted.<\/p>\n<p>Falconer\u2019s broader philosophy is one he learned as head of developer experience at Google: if the tooling is clunky, adoption stalls. He recalls how an API-first business messaging product was powerful, but hard to get started with. A click-through cut onboarding time and lifted the use of advanced features by 3x, while launches doubled. As he says, \u201cmake it easy and fun to use, and developers will be safer and more successful.\u201d<\/p>\n<p>\t<a class=\"row youtube-subscribe-block\" href=\"https:\/\/youtube.com\/thenewstack?sub_confirmation=1\" target=\"_blank\" rel=\"nofollow noopener\"><\/p>\n<p>\n\t\t\t\tYOUTUBE.COM\/THENEWSTACK\n\t\t\t<\/p>\n<p>\n\t\t\t\tTech moves fast, don&#8217;t miss an episode. Subscribe to our YouTube<br \/>\n\t\t\t\tchannel to stream all our podcasts, interviews, demos, and more.\n\t\t\t<\/p>\n<p>\t\t\t\tSUBSCRIBE<\/p>\n<p>\t<\/a><\/p>\n<p>    Group<br \/>\n    Created with Sketch.<\/p>\n<p>\t\t<a href=\"https:\/\/thenewstack.io\/author\/megan-carnegie\/\" class=\"author-more-link\" rel=\"nofollow noopener\" target=\"_blank\"><\/p>\n<p>\t\t\t\t\t<img decoding=\"async\" class=\"post-author-avatar\" src=\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/05\/e36dae7b-cropped-6c610b3e-megan-carnegie-square-sizing-600x600.jpg\"\/><\/p>\n<p>\n\t\t\t\t\t\t\tMegan is a London-based independent technology journalist with over a decade of experience writing analytical features for publications like WIRED, Fast Company, and the BBC. She specializes in the world of work, covering Big Tech, startups, AI, recruitment trends, and&#8230;\t\t\t\t\t\t<\/p>\n<p>\t\t\t\t\t\tRead more from Megan Carnegie\t\t\t\t\t\t<\/p>\n<p>\t\t<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"Enterprise AI is running into a problem. But it has more to do with data infrastructure than model&hellip;\n","protected":false},"author":2,"featured_media":48177,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[405,7537,26923,4898],"class_list":["post-48176","post","type-post","status-publish","format-standard","has-post-thumbnail","category-agentic-ai","tag-ai-agents","tag-artificial-intelligence-agents","tag-confluent","tag-post"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/48176","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=48176"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/48176\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/48177"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=48176"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=48176"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=48176"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}