Google to Back Unified robots.txt Standard for Blocking AI Training Data Use
Google has confirmed it will support a unified mechanism inside robots.txt that lets website owners signal their preference regarding the use of site content for training generative AI models.
The company stated in its Search Central blog that the new capability will be introduced in 2027 and is based on proposals developed by the AIPREF working group at IETF. Rather than maintaining separate directives for every AI provider, publishers will be able to set one general policy marker that participating organizations are expected to honor.
Google has indicated it will interpret an unspecified general marker in the same manner as its existing Google-Extended directive. At the same time, current per-provider settings will remain fully supported, allowing site owners to establish a broad default rule while still applying different conditions to individual companies.
For publishers, the change is expected to reduce the operational burden of managing an expanding list of AI crawlers. However, the mechanism only communicates usage preferences and does not technically block access to servers. Its effectiveness will ultimately depend on which organizations join the initiative and consistently respect the declared rules.
The proposal is still under active development and will continue to be refined through the IETF standardization process before final implementation.
Related articles
I Know but Cannot Tell: The Forensic Expert's Struggle to Share Real Cases Under NDA Constraints
A cybersecurity journalist reflects on the inherent difficulties of writing about digital and financial forensics while bound by strict confidentiality agreements. The article explores how verifying financial documents involves far more than spotting Photoshop alterations, raising questions about data origin, accuracy, interpretation, and the validity of conclusions drawn by examiners. Automated verification systems often produce conflicting results because they assess different aspects of a document, yet lack transparent justification for their verdicts. Attempts to anonymize cases, obtain client consent, or use synthetic data each carry limitations that can still lead to identification or fail to demonstrate actual expertise. The author recounts collaborating with an AI to draft the piece, only to realize the meta-discussion about the inability to publish real cases itself became the only publishable story. Ultimately, the piece highlights the tension between the professional desire to share knowledge and the contractual and ethical barriers that prevent meaningful disclosure in the field of forensic analysis.
Three Hypotheses on Information Security Risk Assessment: Where Automation Truly Saves Time at Avito
Avito expert Irina Sozinova details how the company tested automation in its risk assessment process after scaling issues emerged with thousands of risks in the GRC system. The team formulated and piloted three hypotheses focused on automating typical risks, eliminating manual team preparation, and validating data to reduce InfoSec workload. Results showed a 16% drop in total risks registered, zero preparation time for teams, and improved coverage and context quality, though overall expert time savings were partially offset by new post-processing tasks. The pilot confirmed that automation works best on repeatable scenarios with stable data sources rather than promising immediate proportional time cuts. Avito plans to complete automation of context collection and finding classification this year to expand risk assessments across the company next year.
Integrating OAuth 2.0 with PDP Architectures Without Modifying Core Authorization Engines
The article explores how to combine OAuth 2.0 delegated access with traditional PEP/PDP authorization systems. It proposes an OAuth-aware PDP layer that translates access tokens into standard PDP checks while preserving the original PDP implementation. Three main use cases are analyzed: stored user grants, tenant-level administrative grants, and scopes carried directly inside tokens. The design relies on synthetic subjects such as u+c and t+c pairs, ephemeral policies for token-embedded scopes, and optional OAuth-aware PAP components. Special attention is given to token contents, policy storage via PAP, and the need for deterministic subject identifiers. The approach supports both classic scope models and structured RAR-style authorizations while maintaining separation between OAuth grants and subject permissions.
Russian Businesses Face 50-Ruble Fee per MVD Query for Passport and Residence Checks
The Russian government has backed a proposal requiring businesses to pay 50 rubles for each completed session querying Ministry of Internal Affairs databases. The fee covers checks on Russian passport validity, residence registration, residence permits, and foreign citizen migration records. Projected annual budget revenue reaches 120 billion rubles. Companies must still perform client identification under Federal Law 115-FZ and the Law on Communications, with fines up to 0.1 percent of own funds for banks or 500,000 rubles for telecom operators. Smart Engines highlights its Sherlock anti-fraud platform as a local alternative that detects over 600 forgery indicators, including deepfakes and NFC chip tampering, without repeated paid queries. The company cites a June 2026 legal opinion from the National Council of Financial Markets confirming that such tools can satisfy compliance requirements.