Rising to meet demands for increasing latency and scale, Google LLC today introduced a mega-scale\u00a0datacenter\u00a0network\u00a0fabric and\u00a0cross-cloud infrastructure\u00a0aimed at\u00a0agentic\u00a0artificial\u00a0intelligence delivery.<\/p>\n
Virgo Network, Google\u2019s new networking system for AI infrastructure, is designed to speed communications both inside accelerator clusters and across the broader data center, where workloads need access to memory, compute and storage.<\/p>\n
The company said it accomplished that by \u201cflattening\u201d the network so traffic moves through fewer layers. The result, according to the company, is a system that can connect up to 134,000 chips \u2014 including its new eighth-generation TPU 8t training processors<\/a>\u00a0\u2014 and delivers as much as 47 petabits per second of bi-directional bandwidth.<\/p>\n Google claimed Virgo also provides more than four times the bandwidth per accelerator over the previous generation.<\/p>\n It is also extremely robust and uses its own\u00a0software suite to handle critical issues and failures within its network. At the scale that Virgo Network\u00a0operates, failures are inevitable, as are stragglers and glitches. To tackle this, the system provides deep observability and automated routing and architecture to heal and mitigate faults, deal with hangs and stragglers.\u00a0<\/p>\n At this scale, system-wide resilience requires a solid network foundation. Virgo Network integrates independent switching planes that provide robust fault isolation and protect cluster-wide throughput. This protects\u00a0large-scale\u00a0systems\u00a0from\u00a0being affected by\u00a0localized failures.\u00a0<\/p>\n Google said the scaling pattern behind Virgo is to be a completely different\u00a0product,\u00a0built to be a campus-as-supercomputer, custom-built to handle AI workloads. It provides sub-millisecond telemetry\u00a0to\u00a0monitor\u00a0systems and reports on transient issues,\u00a0congestion\u00a0and\u00a0optimize\u00a0buffer management across the hardware and software stack.\u00a0<\/p>\n The\u00a0objective\u00a0is to provide predictable latency at increasingly large scales and deliver on the needs for what Google calls the \u201cagentic AI era.\u201d This is where\u00a0more and more\u00a0AI models are making tool calls at the\u00a0millisecond range and require enough throughput to make certain those calls\u00a0don\u2019t\u00a0hang or hiccup.\u00a0<\/p>\n Building cross-cloud infrastructure for agentic AI workloads\u00a0<\/p>\n In addition to data center networking, Google also announced connectivity and security layers that\u00a0provide a foundation for agentic AI workloads in the cloud.\u00a0<\/p>\n The company focused its product and service updates around four areas: fluid compute to enable\u00a0cost-effective, high-speed\u00a0central processing unit access for AI agents; secure cross-cloud connectivity to deliver governed access to agents; a unified data layer that includes smart storage to transform passive into curated intelligence; and digital sovereignty for managing secure\u00a0keys to bring models into private enclaves where data lives instead of the other way around.\u00a0<\/p>\n With\u00a0fluid\u00a0compute, the otherwise spiky access model of AI agents can be tamed, allowing enterprises to access computation at the speed of logic. It provides access to CPUs\u00a0optimized\u00a0for high-speed inference and operations such as agentic orchestration\u00a0and retrieval-augmented generation. CPUs can be used to augment the sheer power of graphics processing units.\u00a0<\/p>\n To implement this,\u00a0the company\u00a0said it provides\u00a0virtual machines\u00a0\u2014 enabled by Google Compute Engine and Google Kubernetes services\u00a0\u2014\u00a0with C4N and M4N CPUs, capable of delivering up to 95 million packets per second, up to 40% faster than other leading\u00a0hyperscalers.\u00a0\u00a0<\/p>\n With secure cross-cloud connectivity, enterprises get access to Agent Gateway, a controller that watches access and natively controls\u00a0and governs\u00a0protocols such as Model Context Protocol and Agent 2 Agent.\u00a0It also provides visibility and security into multi-cloud\u00a0infrastructure, monitoring and protecting anything that flows between different networks.\u00a0<\/p>\n With the unified data layer, nothing is siloed. Smart storage transforms otherwise dark data into a knowledge asset by embedding metadata\u00a0into data objects that allow AI agents to understand its use. This annotates data so that AI agents can make use of all data, providing insight extraction,\u00a0annotation\u00a0and semantic search. Agents can then quickly find anything,\u00a0whether\u00a0it\u2019s\u00a0hidden in spreadsheets, documents, PDFs,\u00a0images\u00a0or elsewhere.\u00a0<\/p>\n The\u00a0Knowledge\u00a0Catalog maps business knowledge into a graph that allows AI agents to understand\u00a0how everything works and provide\u00a0accurate, grounded responses. It\u2019s a foundation that allows AI training without the need to migrate data \u2013 agents can interact with it directly.\u00a0<\/p>\n Image: Shutterstock\/Nepool<\/a><\/p>\n Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE\u2019s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.<\/p>\n 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more About SiliconANGLE Media<\/p>\n SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE<\/a>, theCUBE Network<\/a>, theCUBE Research<\/a>, CUBE365<\/a>, theCUBE AI<\/a> and theCUBE SuperStudios \u2014 with flagship locations in Silicon Valley and the New York Stock Exchange \u2014 SiliconANGLE Media operates at the intersection of media, technology and AI.<\/p>\n Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.<\/p>\n","protected":false},"excerpt":{"rendered":"Rising to meet demands for increasing latency and scale, Google LLC today introduced a mega-scale\u00a0datacenter\u00a0network\u00a0fabric and\u00a0cross-cloud infrastructure\u00a0aimed at\u00a0agentic\u00a0artificial\u00a0intelligence…\n","protected":false},"author":2,"featured_media":1843,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[179,7493,10368,999,396],"class_list":{"0":"post-13402","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-agentic-ai","8":"tag-agentic-ai","9":"tag-agentic-artificial-intelligence","10":"tag-google-announces-innovations-in-mega-scale-networking-for-the-agentic-era","11":"tag-kyt-dotson","12":"tag-siliconangle"},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/13402","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=13402"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/13402\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/1843"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=13402"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=13402"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=13402"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\n11.4k+ theCUBE alumni \u2014 Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.<\/p>\n