For the first time since the web opened to the public, machines now generate most of the requests moving across it. Cloudflare co-founder and chief executive Matthew Prince said this week that automated systems account for 57.5% of HTTP requests to web content worldwide, against 42.5% from people. The shift matters to anyone who publishes online, pays for hosting, or relies on an AI assistant that quietly fetches pages on their behalf: the economic assumptions the web was built on, advertising, referral clicks, and human attention, are being rewritten in real time.

Cloudflare Radar Clocked 57.5% Bot Share Years Ahead of Forecast

Prince shared the data from Cloudflare Radar, the company’s internet-measurement dashboard, in a post on June 3. He had told audiences at SXSW only three months earlier that the crossover would not arrive until 2027. “Welp, that happened faster than I predicted,” he wrote, conceding that agentic traffic grew quickly enough to pull the milestone forward by more than a year. The live figure fluctuates, and NBC News logged a slightly different split of 57.4% bots to 42.6% humans; Prince himself called the underlying classification “a bit messy,” while insisting the web is now clearly on the other side of the line.

Agentic AI Browses Thousands of Pages Per Human Errand

The force behind the surge is not the search-engine crawler of a decade ago. It is agentic AI: semi-autonomous programs that browse and retrieve pages on behalf of assistants such as ChatGPT and Gemini. The arithmetic is what tips the balance. A person comparison-shopping for a camera might open five tabs; an agent completing the same task can hit thousands of pages in seconds. Multiply that by millions of people delegating chores to assistants, and the composition of traffic flips toward machines. Cloudflare’s own measurements show crawler activity climbing sharply, with OpenAI’s GPTBot growing 305% in a single year.

Wikipedia Bandwidth Surged 50% as AI Scrapers Hit Open Archives

The load is already expensive for the organizations carrying it. The Wikimedia Foundation reported that bandwidth for multimedia surged 50% since January 2024, driven not by curious humans but by scrapers harvesting training data. Roughly 65% of its most resource-intensive traffic came from bots, even though bots accounted for only about 35% of pageviews. The pain is not limited to giants: open-source developers Drew DeVault and Gergely Orosz have described AI crawlers ignoring the robots.txt files meant to wave them off, and smaller operators have watched scraper spikes slow or topple sites built for modest human audiences.

HTTP 402 Payment Required Turns AI Crawling Into Paid Transactions

Cloudflare’s answer revives a status code that sat dormant for decades. Its AI Crawl Control and Pay Per Crawl systems use HTTP 402, “Payment Required,” as a negotiation signal. When a crawler requests a protected page, the server can return a 402 carrying a crawler-price header that names the cost per request; if the bot agrees, it resends the request with a payment header and receives the content with a 200 OK. Cloudflare acts as the merchant of record and settles payments through Stripe, while a companion standard called Web Bot Auth uses cryptographic signatures so crawlers cannot simply spoof a friendly identity. The demand is real even before wide adoption: Cloudflare customers already send more than one billion 402 codes a day. That engineering tradeoff is the heart of Prince’s thesis that the web’s future is “pay to crawl,” a model he laid out as bots overtook human traffic.

Cloudflare Accuses Perplexity of Stealth Crawling Blocked Sites

The transition has already produced a marquee fight. In August 2025, Cloudflare accused the AI search startup Perplexity of stealth crawling, saying its bots rotated user-agent strings and shifted network routes to reach sites that had explicitly blocked them, and de-listed Perplexity from its verified-bot directory. Perplexity disputed the analysis, calling the report a publicity stunt and arguing that Cloudflare had conflated user-triggered fetches with automated scraping. The clash sharpened a question every site owner now faces: when an agent visits on a person’s behalf, is that a human request or a bot request, and who gets to decide?

Are There More Bots Than Humans Online Now?

By Cloudflare’s count, yes, but the headline number needs context. The 57.5% figure measures HTTP requests to HTML content, not human attention or time spent. By the metrics that track engagement, hours inside apps, video streamed, feeds scrolled, people remain the dominant presence online, because endless scrolling does not generate the rapid-fire page loads an agent produces. The data also comes from a single vendor and reflects the slice of the internet Cloudflare sees.

Bot Majority Counts Requests, Not Human Attention

The milestone revived talk of the “dead internet theory,” the idea that AI will leave the web populated mostly by bots talking to bots. Prince pushed back, telling reporters the theory is wrong on several counts: generative tools have lowered the barrier to publishing, so more people, not fewer, can now create content. Whatever the exact percentage, the direction is settled, and it forces a decision the open web has avoided. Sites can keep giving machines free access, block them and lose referral traffic, or charge them, and the infrastructure to charge them now exists.

Frequently Asked Questions

Are there more bots than humans on the internet?

According to Cloudflare Radar, yes, as of June 2026. Automated systems generate about 57.5% of HTTP requests to web content, versus 42.5% from humans, the first such crossover the company has recorded.

What is causing the rise in bot traffic?

The main driver is agentic AI, autonomous programs that browse the web for assistants like ChatGPT and Gemini. A single agent can visit thousands of pages to complete a task a person would finish in a handful of clicks.

What is pay per crawl?

It is a Cloudflare system that lets site owners charge AI crawlers for access using the HTTP 402 “Payment Required” status code. Cloudflare serves as the merchant of record and processes the payments, giving publishers a middle path between blocking bots and allowing free scraping.

Does this mean people use the internet less?

No. The figure counts page requests, not engagement. Measured by time spent in apps, streaming, and social feeds, humans still account for most real-world web activity.