Habr•August 24, 2026•🇷🇺Translated from Russian

Bot Traffic Overtakes Human Traffic in 2024 as AI Agents and Scrapers Surge

The theory of a so-called dead internet has circulated since at least 2014, but recent data shows automated traffic is indeed overtaking human activity. Anti-detect browser company Aurorium examined traffic composition from 2013 onward and concluded that bots now hold a majority share in many segments.

Modern internet traffic consists of human users who create content and drive searches, plus bots divided into good, bad, and gray categories. Good bots include search engine crawlers, uptime monitors, news aggregators, and social media bots. Bad bots range from simple scripts to advanced tools that rotate fingerprints, use proxies, and mimic human mouse movements. Gray bots encompass AI agents and neural crawlers whose long-term value to webmasters remains unclear.

Imperva statistics illustrate the shift. Human traffic stood at 57 percent in 2013, dipped in 2014 due to good-bot indexing, then recovered through 2019 as smartphone adoption and 4G networks brought hundreds of millions of new users from Asia. From 2020 onward, pandemic-driven automation reversed the trend. By 2023 human traffic had fallen to 50.4 percent while malicious bots climbed to 32 percent.

The acceleration continued after generative AI tools lowered the barrier to creating scrapers. In 2024 human traffic dropped below 50 percent for the first time, reaching 49 percent against 51 percent automated. Latest figures show humans at 47 percent and bots at 53 percent, with the majority of bot activity classified as harmful scraping rather than beneficial indexing.

Additional sources align with these findings. Cloudflare reports that automated requests account for 37.5 percent of HTTP traffic, 87 percent of which originates from desktop environments. Akamai analyzed 6.9 billion requests and found 49.3 percent human, 42.1 percent bot-driven, and 65.3 percent of bot traffic tied to malicious scraping.

Within the bad-bot category, gray AI agents represent a fast-growing subset. AI crawlers comprise 85 percent of neural traffic while interactive AI agents account for 15 percent and are expanding at roughly 7 percent per year. These agents already compare prices, read documentation, and complete bookings with minimal human input.

Businesses bear an infrastructure tax from this traffic. A site that once handled 200 daily visitors may now serve 5,000, forcing upgrades to costlier hosting plans even though a large share of requests come from non-converting bots. For a digital property with 100 million monthly views and 30 percent bot traffic, annual server costs attributable to automation can exceed $19,000, excluding expenses for CAPTCHA services.

Site owners face difficult choices about blocking AI crawlers. Aggressive filtering risks losing legitimate mobile users sharing the same carrier-grade NAT addresses. At the same time, media organizations such as BBC and CNN that strictly limit AI access still achieve high citation rates in neural search results, suggesting that voluntary openness may not be required for visibility.

The cumulative data lends increasing weight to the dead-internet hypothesis. Human users are becoming a minority in the network they created, and recommendation systems trained on bot-generated patterns risk producing an increasingly synthetic information environment with no clear reversal in sight.

Related articles

Habr•Other

Why Defending a Company Costs Millions While Attacks Can Succeed for Just Hundreds of Dollars

In the latest episode of Belyaev Podcast, CISO Vyacheslav Kasimov of Tochka Bank and Boris Evdokimov of ASNA pharmacy chain discussed the persistent asymmetry in cybersecurity spending. Attackers increasingly rely on affordable cloud services, automation, and rented infrastructure, while defenders must invest heavily in monitoring, access controls, backups, and skilled teams. The experts stressed that the absence of known breaches does not equal security, as undetected incidents or delayed discovery remain common risks. They advocated shifting from a "no" culture to risk-based decision making that helps business leaders understand potential losses, mitigation costs, and residual risk. The conversation also covered responsible use of AI in SOC operations and the long-term damage caused by loss of customer trust after incidents.

AntiMalware•Other

Beeline Offers One Month Free Access to Six Services for Prepaid Customers

Beeline has launched a promotional campaign allowing home users on prepaid plans to try up to six digital services for free over 30 days. The offer, tied to the operator's second annual Cellular Independence Day, runs from October 2 to October 9 and includes services such as Virtual Assistant PRO, unlimited mobile data, internet sharing without speed reduction, custom network name display, 250 GB of cloud storage, and access to over 650,000 e-books and audiobooks. Each selected service activates its own free period starting from the moment of connection and deactivates automatically afterward. Customers already paying for four or more of the listed services will receive 300 bonus rubles for communication instead. The unlimited data option is unavailable in the Chukotka Autonomous Okrug and Norilsk. Activation is handled exclusively through the Beeline mobile app, and users with existing paid subscriptions to any service cannot activate the free trial version of the same service.

Habr•Other

Enterprise-Grade Web Protection on a Budget: How Cloud WAF Lowers Barriers for SMBs

A new overview from Reg.cloud explains how cloud-based Web Application Firewalls reduce the cost and complexity of protecting websites, APIs, and web applications for small and medium-sized Russian businesses. According to Positive Technologies data cited in the article, 75% of successful web application attacks in 2025 disrupted organizational operations, while 82% of SMBs faced cyber incidents in the past year. The piece details the differences between traditional on-premises WAF deployments and cloud offerings, emphasizing ready-made protection profiles for CMS platforms, SaaS services, and digital agencies. It outlines a three-stage operational model covering preparation, DNS-based traffic redirection, and ongoing policy tuning that can be handled by existing DevOps or development teams without dedicated security staff. The service currently offers a free tier supporting up to three applications at 50 requests per second, along with seven preconfigured security profiles and dual audit/blocking modes. The article concludes by stressing that WAF remains only one layer and must be combined with patching, access controls, and separate DDoS or anti-bot solutions.

AntiMalware•Other

Yandex B2B Tech Integrates Hybrid Full-Text and Vector Search in Single YDB Query

Yandex B2B Tech has added hybrid search to its YDB database, allowing full-text and vector approaches to run together inside one SQL query. The update helps small and medium businesses as well as large corporations locate exact document identifiers while also matching semantic meaning in descriptions, even when wording differs. Full-text search handles precise elements such as policy numbers, codes, and names, whereas vector search identifies conceptual similarity. Results from both methods are merged and ranked within the same transaction, keeping all data inside a single database instance. This removes the need to maintain a separate search engine and vector store or to reconcile information between them. The technology is aimed at chatbots, recommendation systems, and AI assistants that process technical content where both exact codes and human-readable problem descriptions matter equally. Hybrid search is now available in the on-premises YDB 26.3 release and in the cloud-based Managed Service for YDB.