![\"Breakthrough](\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/07\/1783470852_83_lintec_fig03.png\")
<\/a><\/p>\nBy Lintec\u00a0 07.06.2026<\/p>\n
\t\t\t\t\t By Landyn Murphy, Senior Content Marketing Specialist, Rochester Electronics\u00a0 07.01.2026<\/p>\n \t\t\t\t\t By MRPeasy\u00a0 07.01.2026<\/p>\n Compared to the majority of data center-scale applications, embedded software is considerably simpler and doesn\u2019t require huge models to analyze.<\/p>\n \u201cThe good news is, at the edge, it\u2019s very fixed-function,\u201d Minhazuddin said. \u201cIt\u2019s not that broad, so we can take these very fixed functions and turn them into agent skills, and then express them through an agentic layer to orchestration engines to build applications.\u201d<\/p>\n Embedded software could be one of the first sectors to fully adopt agentic AI for development, Minhazuddin said.<\/p>\n \u201cA lot of issues with MCP [model context protocol<\/a>] and agentic AI are still true in the large data center and cloud models because the number of permutations is so high,\u201d he said. \u201cWhat we\u2019re finding is [that the problem] is more confined at the edge, so it\u2019s actually more effective for us.\u201d<\/p>\n Ambarella has onboarded ISVs<\/a> onto its hardware platform across healthcare, retail, and robotics so far, some in as little as three days using the agent, Minhazuddin said, but the real test is whether they can translate this speed into faster proof-of-concept systems for end customers.<\/p>\n \u201cIn the last four months, [our ISV partners] have put our development kits into 20 large retail chains in the United States, large chains of coffee shops, and drive-throughs,\u201d he said.<\/p>\n On the retail side, many customers already have some kind of networking box on the premises, with a second box that serves point-of-sale systems and other applications that might run in the store. A third box can be added for AI inference on camera feeds and other analytics.<\/p>\n \u201cWhat\u2019s emerging as an interesting pattern is: Can you consolidate those three boxes?\u201d Minhazuddin said. \u201cCan you have a network function, a point of sale, an application system, and an AI function [in the same box]. There is a significant reduction in capex that you can achieve if you\u2019re able to consolidate three different workloads onto one system.\u201d<\/p>\n Retail industry customers are evaluating Ambarella SoCs for security camera aggregation and analysis as well as other AI functions, Minhazuddin said, noting that combining several boxes at several thousand dollars each could make a big saving across a chain of tens of thousands of stores.\u00a0<\/p>\n Agents at the edge<\/p>\n Agents will also need to run directly on edge devices eventually. For most other types of AI applications, a system\u2019s CPU runs as a host, and most of the compute is done on a GPU or accelerator. With agentic AI, the CPU is needed to run an agentic engine.<\/p>\n \u201cThe CPU-GPU ratio is changing fast because of agentic AI,\u201d Minhazuddin said. \u201cWe already have an Arm CPU core in our SoC\u2026 we can balance the CPU and on-chip accelerator to run agentic functions quite naturally.\u201d<\/p>\n Is Ambarella looking at changing the ratio of CPU to acceleration on its hardware to suit agentic applications?<\/p>\n \u201cMaybe in future products,\u201d Minhazuddin said. \u201cThat would align with where the industry is going.\u201d<\/p>\n Agents could run in an edge box or in the camera, or both, Minhazuddin said. Ambarella\u2019s edge box design features a single N1-655 chip; the company has publicly demonstrated inference for a 20B MoE model and now has 35B models up and running.<\/p>\n \u201c[An N1-655] is good enough to do local processing, inference, agentic, all of that, to a well-controlled degree,\u201d he said. \u201cCamera-box combinations can eliminate requirements for big servers.\u201d<\/p>\n How to distribute workloads between the camera and the edge box is a customer decision, Minhazuddin said.<\/p>\n \u201cWe\u2019ll continue to add more oomph into the camera itself,\u201d he said. \u201cIf you can aggregate those different streams, then you don\u2019t have to have a [rack-scale] server; you can still be a small appliance; that\u2019s the pattern.\u201d<\/p>\n Edge to cloud<\/p>\n Minhazuddin said the edge AI market is evolving in two directions: cloud to edge and edge to cloud.<\/p>\n In the cloud-to-edge sector, data center owners want to move inference to the edge using multi-rack-scale systems as an on-prem extension of their infrastructure, still with huge model sizes and powerful compute hardware. The software ecosystem here is similar to enterprise software, Minhazuddin said.<\/p>\n The edge-to-cloud sector has two sub-sectors, with industry-specific software ecosystems, and Ambarella is addressing both of them, he said.<\/p>\n One is physical AI. In previous iterations of the IoT, sensor data was digitized and analyzed, but humans made the decisions. Modern physical AI applications aggregate data from multi-modal sensors and combine them to faithfully represent a physical system with a higher level of autonomy, Minhazuddin said.<\/p>\n \u201cHigher autonomy means these systems need to not just perceive and sense; you have to make some decisions locally, and once you make a decision, you have to take action, so it\u2019s fully self-sufficient,\u201d he said. \u201cIf this system was tethered to the cloud, the decision to move a robotic arm would have to go to the cloud\u2026 it has to be fully autonomous.\u201d<\/p>\n The other edge-to-cloud sector is the edge box, sufficient to aggregate data from multiple sensors collecting data elsewhere, perhaps combining multiple sensor modalities, perhaps with multiple models running.<\/p>\n \u201cThe aggregation point doesn\u2019t have to be the cloud, and you don\u2019t really need a massive server,\u201d he said.<\/p>\n The N1-655 is being positioned in both these edge-to-cloud segments, he said, but multi-chip Ambarella systems may have to wait a bit longer.<\/p>\n \u201cArchitecturally, we have a lot of work to do to get there,\u201d he said. \u201cOur performance per watt is highly efficient on our SoC, but if we start adding a lot of SoCs, then we need HBM, PCIe\u2026 Could you take a lot of these SoCs and put them on M.2 cards and connect them, yes, but would it be a truly multi-chip cluster architecture? Not really, no.\u201d<\/p>\n AI workloads will probably continue to swing back and forth between the edge and the cloud, Minhazuddin said, noting that AI began in the data center, moved closer to the cloud, and is emerging at the edge.<\/p>\n \u201cAt some point, there\u2019ll be some level of equilibrium where some workloads run best in the cloud, some in the data center, and some work best in the edge, but they\u2019re all talking to each other; they\u2019re all connected to each other,\u201d he said. \u201cThat\u2019s where we\u2019ll hit the equilibrium, but I don\u2019t think we\u2019re there yet.\u201d<\/p>\n Read also: Scaling Down Is the New Scaling <\/a>Up<\/a><\/p>\n Agentic AI on edge devices will require hardware-aware design from the start, according to Meta\u2019s Vikas Chandra, a keynote speaker at the Embedded Vision Summit.<\/p>\n AGENTIC AI<\/a>, EDGE AI<\/a>, EMBEDDED<\/a>, EMBEDDED AI<\/a>, PHYSICAL AI<\/a>, SEMICONDUCTORS<\/a>, SOFTWARE<\/a>\n <\/p>\n![\"Rapid](\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/07\/1783470852_305_sponsored-article-thumbnail_600x340_Obsolescence.jpg\")
<\/a><\/p>\n![\"Sales](\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/07\/1783470852_946_Sales-Forecasting-Guide-for-Small-Electronics-Manufacturers_600x340.png\")
<\/a><\/p>\n![\"Krishna](\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/07\/Krishna-Rangasayee.jpg\")
<\/a>![\"Embedded](\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/07\/EmbeddedVision_main_EETimesEurope.jpg\")
<\/a><\/p>\n