{"id":67539,"date":"2025-07-16T15:57:17","date_gmt":"2025-07-16T15:57:17","guid":{"rendered":"https:\/\/www.europesays.com\/us\/67539\/"},"modified":"2025-07-16T15:57:17","modified_gmt":"2025-07-16T15:57:17","slug":"extending-the-arm-of-atlas-computing","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/us\/67539\/","title":{"rendered":"Extending the ARM of ATLAS computing"},"content":{"rendered":"<p>With data from the ongoing LHC Run 3 continuing to mount, and the High-Luminosity LHC (HL-LHC) expected to deliver ten times more, the ATLAS experiment is being pushed to its computing limits. Traditional central processing units (CPUs) based on the widely used <a href=\"https:\/\/en.wikipedia.org\/wiki\/X86-64\" target=\"_blank\" rel=\"noopener\">x86_64<\/a> architecture \u2013 common in servers and desktop computers \u2013 are struggling to meet these growing demands in the resource projections. To keep pace, the ATLAS Collaboration is looking beyond traditional computing solutions to meet its growing needs.<\/p>\n<p><a href=\"https:\/\/cds.cern.ch\/images\/ATLAS-PHOTO-2025-046-1\" title=\"View on CDS\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" alt=\"Technology,Computing,ATLAS\" src=\"https:\/\/www.europesays.com\/us\/wp-content\/uploads\/2025\/07\/1752681435_233_file\"\/><\/a>Figure 1: The HepScore23 (HS23) benchmark score (a proxy for throughput) per Watt as a function of the processor frequency for seven CPU models. The first two listed models are ARM CPUs. (Image: ATLAS Collaboration\/CERN)<\/p>\n<p>One <a href=\"https:\/\/www.epj-conferences.org\/articles\/epjconf\/abs\/2024\/05\/epjconf_chep2024_05019\/epjconf_chep2024_05019.html\" target=\"_blank\" rel=\"noopener\">promising alternative<\/a> is <a href=\"https:\/\/en.wikipedia.org\/wiki\/ARM_architecture_family\" target=\"_blank\" rel=\"noopener\">ARM<\/a> CPU architecture, which offers <a href=\"https:\/\/cds.cern.ch\/record\/2920934\" target=\"_blank\" rel=\"noopener\">competitive performance<\/a> with significantly lower power consumption. Predominantly used in mobile devices like smartphones and tablets, ARM chips are increasingly being adopted in cloud data centres. As of 2024, ARM CPUs held around 15% of the commercial cloud computing market \u2013 a number expected to rise significantly, driven by the boom of artificial intelligence where these CPUs are often used as host chips.<\/p>\n<p>In 2022 and 2023, the ATLAS Collaboration successfully ported its entire software ecosystem, consisting of several million lines of code in C++ and Python, to run on ARM CPUs. As ATLAS software runs on the Linux operating system, already available for ARM CPUs, the porting effort primarily focused on adapting ATLAS-specific and high-energy-physics-specific code. For some packages this entailed updating the individual <a href=\"https:\/\/en.m.wikipedia.org\/wiki\/CMake\" target=\"_blank\" rel=\"noopener\">software build instructions<\/a> and configuration, as well as applying small changes to how <a href=\"https:\/\/en.m.wikipedia.org\/wiki\/Floating-point_arithmetic#Exception_handling\" target=\"_blank\" rel=\"noopener\">floating point exceptions<\/a> are handled. The porting effort was accomplished with the support of the CERN EP\/SFT group. All major ATLAS workflows for offline and online data processing, together with all external software packages, can now be used on ARM CPUs. Enabling ATLAS code on different platforms was found to make it more robust and numerically stable.<\/p>\n<p>All major ATLAS workflows for offline and online data processing can now be used on ARM CPU architecture \u2013 which offers competitive performance and significantly lower power consumption.<\/p>\n<p><a href=\"https:\/\/cds.cern.ch\/images\/ATLAS-PHOTO-2025-046-2\" title=\"View on CDS\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" alt=\"Technology,Computing,ATLAS\" src=\"https:\/\/www.europesays.com\/us\/wp-content\/uploads\/2025\/07\/1752681437_223_file\"\/><\/a>Figure 2: Number of concurrently running ATLAS production jobs in the past 12 months on ARM CPUs at various WLCG sites. (Image: ATLAS Collaboration\/CERN)<\/p>\n<p>After integrating ARM support into the <a href=\"https:\/\/en.wikipedia.org\/wiki\/Continuous_integration\" target=\"_blank\" rel=\"noopener\">automated software build system<\/a>, ATLAS teams conducted a large physics validation campaign. This series of tests ensured that results obtained from ARM-CPU-processed simulation samples matched those from traditionally-processed x86_64 samples. During this validation campaign, access to ARM CPUs from the Worldwide LHC Computing Grid (<a href=\"https:\/\/wlcg-public.web.cern.ch\" target=\"_blank\" rel=\"noopener\">WLCG<\/a>) resources was scarce. Thus, the ATLAS computing grid workflow management system was <a href=\"https:\/\/doi.org\/10.1142\/S0217751X24500544\" target=\"_blank\" rel=\"noopener\">enabled to run on cloud computing resources<\/a> from Amazon and Google, using several hundred ARM CPUs for a limited period of time.<\/p>\n<p>ATLAS production workflows have also been <a href=\"https:\/\/doi.org\/10.1051\/epjconf\/202429507024\" target=\"_blank\" rel=\"noopener\">integrated into HepScore23<\/a>, a benchmarking suite used to measure the processing power of WLCG resources. This allowed for direct comparisons between x86_64 and ARM processors, confirming that ARM CPUs offer comparable processing performance while consuming less energy \u2013 an important consideration, particularly <a href=\"https:\/\/arxiv.org\/abs\/2505.08530\" target=\"_blank\" rel=\"noopener\">in view of the HL-LHC\u2019s demanding data processing requirements<\/a>. A performance comparison of several ARM and x86_64 CPUs is shown in Figure 1 where the first two listed models are ARM CPUs.<\/p>\n<p>ATLAS was the first experiment at the LHC to accept pledged WLCG computing resources based on ARM CPUs. As of now, several WLCG sites are each delivering between a few hundred and a thousand ARM CPUs each, as part of their contributions to ATLAS grid computing. ATLAS routinely processes simulation and reconstruction workflows on approximately 10,000 ARM CPU cores running concurrently (see Figure 2). While this represents a small fraction of the approximately 500,000 CPU cores routinely running ATLAS grid jobs, it\u2019s an excellent start towards more energy efficient processing. Critically, it also positions ATLAS to tap into future large-scale computing facilities where ARM CPUs are expected to play a central role.<\/p>\n<p>Learn more<\/p>\n","protected":false},"excerpt":{"rendered":"With data from the ongoing LHC Run 3 continuing to mount, and the High-Luminosity LHC (HL-LHC) expected to&hellip;\n","protected":false},"author":3,"featured_media":67540,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[22],"tags":[26353,26371,6753,26351,18187,3213,807,10019,9416,745,21744,26369,4060,26362,26367,26366,26364,26363,26359,810,26355,26370,808,809,26354,26357,813,26368,492,159,26358,26356,26365,26361,26360,16997,158,26352,67,132,6747,68],"class_list":{"0":"post-67539","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-computing","8":"tag-alice","9":"tag-andreas-hoecker","10":"tag-atlas","11":"tag-atlas-experiment","12":"tag-big-bang","13":"tag-black-hole","14":"tag-cern","15":"tag-cms","16":"tag-collaboration","17":"tag-computing","18":"tag-dark-matter","19":"tag-david-charlton","20":"tag-experiment","21":"tag-extra-dimensions","22":"tag-fabiola-gianotti","23":"tag-geneva","24":"tag-hadron","25":"tag-heavy-ion","26":"tag-higgs","27":"tag-high-energy-physics","28":"tag-international-collaboration","29":"tag-karl-jakobs","30":"tag-large-hadron-collider","31":"tag-lhc","32":"tag-lhcb","33":"tag-particle","34":"tag-particle-physics","35":"tag-peter-jenni","36":"tag-physics","37":"tag-science","38":"tag-science-education","39":"tag-scientific-collaboration","40":"tag-stem","41":"tag-supersymmetry","42":"tag-susy","43":"tag-switzerland","44":"tag-technology","45":"tag-the-atlas-experiment","46":"tag-united-states","47":"tag-unitedstates","48":"tag-universe","49":"tag-us"},"share_on_mastodon":{"url":"","error":"Validation failed: Text character limit of 500 exceeded"},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts\/67539","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/comments?post=67539"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts\/67539\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/media\/67540"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/media?parent=67539"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/categories?post=67539"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/tags?post=67539"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}