HabrAugust 24, 2026🇷🇺Translated from Russian

Bot Traffic Overtakes Human Traffic in 2024 as AI Agents and Scrapers Surge

The theory of a so-called dead internet has circulated since at least 2014, but recent data shows automated traffic is indeed overtaking human activity. Anti-detect browser company Aurorium examined traffic composition from 2013 onward and concluded that bots now hold a majority share in many segments.

Modern internet traffic consists of human users who create content and drive searches, plus bots divided into good, bad, and gray categories. Good bots include search engine crawlers, uptime monitors, news aggregators, and social media bots. Bad bots range from simple scripts to advanced tools that rotate fingerprints, use proxies, and mimic human mouse movements. Gray bots encompass AI agents and neural crawlers whose long-term value to webmasters remains unclear.

Imperva statistics illustrate the shift. Human traffic stood at 57 percent in 2013, dipped in 2014 due to good-bot indexing, then recovered through 2019 as smartphone adoption and 4G networks brought hundreds of millions of new users from Asia. From 2020 onward, pandemic-driven automation reversed the trend. By 2023 human traffic had fallen to 50.4 percent while malicious bots climbed to 32 percent.

The acceleration continued after generative AI tools lowered the barrier to creating scrapers. In 2024 human traffic dropped below 50 percent for the first time, reaching 49 percent against 51 percent automated. Latest figures show humans at 47 percent and bots at 53 percent, with the majority of bot activity classified as harmful scraping rather than beneficial indexing.

Additional sources align with these findings. Cloudflare reports that automated requests account for 37.5 percent of HTTP traffic, 87 percent of which originates from desktop environments. Akamai analyzed 6.9 billion requests and found 49.3 percent human, 42.1 percent bot-driven, and 65.3 percent of bot traffic tied to malicious scraping.

Within the bad-bot category, gray AI agents represent a fast-growing subset. AI crawlers comprise 85 percent of neural traffic while interactive AI agents account for 15 percent and are expanding at roughly 7 percent per year. These agents already compare prices, read documentation, and complete bookings with minimal human input.

Businesses bear an infrastructure tax from this traffic. A site that once handled 200 daily visitors may now serve 5,000, forcing upgrades to costlier hosting plans even though a large share of requests come from non-converting bots. For a digital property with 100 million monthly views and 30 percent bot traffic, annual server costs attributable to automation can exceed $19,000, excluding expenses for CAPTCHA services.

Site owners face difficult choices about blocking AI crawlers. Aggressive filtering risks losing legitimate mobile users sharing the same carrier-grade NAT addresses. At the same time, media organizations such as BBC and CNN that strictly limit AI access still achieve high citation rates in neural search results, suggesting that voluntary openness may not be required for visibility.

The cumulative data lends increasing weight to the dead-internet hypothesis. Human users are becoming a minority in the network they created, and recommendation systems trained on bot-generated patterns risk producing an increasingly synthetic information environment with no clear reversal in sight.

Related articles

HabrOther

Understanding Security Alerts Only Becomes Clear When You Start Writing Detection Rules Yourself

A cybersecurity professional who spent years as a SOC analyst reviewing alerts before moving into detection engineering shares key insights on why alerts behave differently depending on perspective. The article explains the inherent trade-offs in tuning detection rules, the architectural reasons alerts often arrive without full context, and why default priorities rarely match any single organization's environment. It highlights how false positives are not simply developer errors but calculated risks between coverage and noise. The piece also stresses the value of feedback loops between SOC teams and detection developers to improve overall security effectiveness.

安全客Other

NVIDIA Accelerates Physical AI Push with $500 Billion Infrastructure Plan at 2026 World Robot Conference

The 2026 World Robot Conference opened with 373 companies showcasing over 3,000 exhibits and more than 300 new products focused on embodied intelligence. NVIDIA is deepening its commitment to physical AI by partnering with Apollo, Blackstone, KKR and other major asset managers to create an independent financing platform targeting over $500 billion in third-party capital for AI infrastructure. Madison Huang, NVIDIA’s Senior Director of Physical AI and Robotics, visited the event to review advances in human data, simulation, and real-world deployment. The company is reframing compute resources as revenue-generating AI factories that produce tokens, simulation data, and action policies rather than treating them as cost centers. Humanoid robot development faces a critical bottleneck because high-fidelity physics simulation for millions of virtual agents demands enormous cloud compute, while sim-to-real transfer gaps and edge inference constraints remain unsolved engineering challenges.

HabrOther

Anthropic Releases Eight Claude Code Updates in August Focused on Multi-Agent Workflows

Between August 13 and 21, Anthropic shipped eight consecutive Claude Code releases from version 2.1.232 to 2.1.239. The updates center on enabling multiple long-running agents that can share context, communicate across sessions, and continue work automatically after hitting usage limits. Key additions include subagent forking that inherits prompt cache and conversation history, cross-session messaging via @mentions, and an automatic mode that uses a classifier model to approve actions. Additional improvements cover GitLab merge request integration, memory management fixes for extended sessions, and support for native add-ons in musl-based Alpine environments. The changes significantly expand the scale of tasks that can be delegated to Claude Code without constant human oversight.

AntiMalwareOther

Selectel Revenue Exceeds 10 Billion Rubles as Cloud Services Drive Growth Amid Rising Costs

Selectel reported revenue of 10.2 billion rubles for the first half of 2026, marking a 14 percent increase compared with the same period a year earlier. Cloud infrastructure services remained the primary growth engine, contributing 8.9 billion rubles or 87 percent of total revenue. The customer base expanded by 14,400 clients over twelve months to reach 44,500, with smaller customers fueling much of the increase through new VDS configurations. Professional services showed the fastest consumption growth at 1.4 times, while financial and IT sectors raised infrastructure spending by 1.3 times. Adjusted EBITDA rose only 3 percent to 5.4 billion rubles, lowering its margin from 59 percent to 53 percent, and net profit stayed nearly flat at 1.9 billion rubles with margin declining from 21 percent to 18 percent. Operating expenses jumped 23 percent to 4.7 billion rubles, driven mainly by payroll costs that accounted for 65 percent of the total. The company invested 6.4 billion rubles in development, including 4.4 billion rubles on server equipment, a 1.8-fold increase, while expanding GPU purchases for AI workloads despite higher component prices, resulting in negative free cash flow of 3.4 billion rubles and a net debt to EBITDA ratio of 2.1.