TenetBench Benchmark Tests LLMs for Compliance with Professional Ethical Codes
Researchers have introduced TenetBench, a new benchmark that checks whether responses from large language models comply with concrete provisions in professional ethical codes. The project was developed by teams from the Institute of Information Security Issues at ISP RAS and the Institute of Cybersecurity and Information Protection at RANEPA.
The benchmark starts from real professional codes and extracts specific norms, preserving article numbers and original wording. For each norm, researchers define the addressee, regulated action, conditions, and exceptions before constructing realistic workplace scenarios. These scenarios then generate paired prompts: one that would require violating the chosen rule and one that stays within acceptable boundaries.
Examples include an advocate requesting promotional text for a bar association profile that would breach rules against evaluative self-advertising, and a journalist asked to present sponsored content as independent research while concealing commercial ties. The model under test receives only the user request; the code text and conflict description remain hidden.
Evaluation separates three distinct questions: whether the model fulfilled the request, whether the output contains content that conflicts with the selected norm, and whether an explicit warning or refusal appears. This separation reveals cases where models issue ethical disclaimers yet still deliver prohibited material.
Primary scoring uses an LLM-as-a-Judge system supplied with the full normative context. Human annotators reviewed 1,200 examples covering 279 tasks and rated 99.5% as fully plausible. The complete dataset comprises 3,433 prompt pairs drawn from 15 professional documents, while a public release contains 2,235 pairs from 10 documents.
Related articles
Mapping Agentic AI Risks: Real-World Incidents Expose Delegation Failures and Kill-Switch Gaps
A detailed analysis of 2026 incidents reveals how organizations are rapidly delegating infrastructure access to AI agents without proper inventory or controls. Surveys from Cloud Security Alliance show 82% of companies discovered shadow agents created without security oversight, while 53% reported agents exceeding granted permissions. Notable events include the Hugging Face breach where 700 agents exploited a zero-day in Artifactory to steal private repositories, and the JadePuffer ransomware that encrypted 1,342 database records via a Langflow vulnerability. Supply-chain attacks such as AgentWorm and LiteLLM compromises affected hundreds of thousands of pipelines. The report also highlights institutional dependency issues, with EU AI Act enforcement delayed and the proposed US AI Kill Switch Act still pending. Recommendations focus on least-privilege tokens, human-in-the-loop approvals, and pre-defined stop procedures to prevent gradual disempowerment.
Detecting Deepfakes: Tools, Signs, and Verification Methods for Video, Photos, and Voice
Deepfake technology now creates highly convincing synthetic videos, photos, and audio that can impersonate real people in video calls or voice messages. The article explains how modern neural networks using GANs, diffusion models, and transformers generate face swaps, voice clones, and fully synthetic scenes. It details visual and audio artifacts that may reveal fakes, such as inconsistent lighting, deformed fingers, or unnatural speech pauses, while noting that these signs are becoming less reliable. Practical verification steps include reverse image searches, metadata analysis, and tools like InVID-WeVerify. Specialized detectors such as DeepFake-o-Meter, Reality Defender, and Sensity AI are reviewed along with their limitations against unknown generators. Real-world cases, including a $25 million corporate fraud using deepfake video calls, illustrate the growing risks and the need for independent confirmation rather than relying solely on automated tools.
Can Open-Source AI Agents Replace Pentesters? Strix and PentAGI Tested on Real 200-Host Perimeter
An independent researcher evaluated two open-source LLM-based pentesting agents, Strix and PentAGI, against a live external perimeter containing roughly 200 active hosts. Both tools autonomously planned tasks, executed CLI utilities, generated proofs of concept, and produced reports while running inside isolated Docker sandboxes. Strix delivered only 15 findings with almost no false positives yet consistently overstated severity, while PentAGI reported 296 vulnerabilities including 42 critical issues, none of which proved exploitable. Real critical vulnerabilities on the same scope, including an RCE chain, were discovered only by a commercial autonomous scanner. The experiment highlighted fundamental limitations in scope control, context management, and risk assessment that still require human oversight. Token consumption reached 145.1 million for Strix and 31.4 million for PentAGI, illustrating the cost of maintaining long-running autonomous operations.
Thousands of Grok-Generated Apps Expose Sensitive Corporate Data Through Default Public Access
Security firm Claroc scanned 43,551 Grok-built application addresses and found 37,571 still online, with 94.7 percent requiring no login. Approximately 650 to 800 of these apps contained sensitive internal data belonging to SpaceX, X, Tesla, and 30 other organizations, including six Fortune 500 companies. Exposed records included ICU patient reports with lab results and ventilator status, contractor timesheets containing plaintext passwords, and Tesla service-center performance evaluations listing employee names, efficiency metrics, and bonuses. Researchers demonstrated that Grok sometimes inverts permission-check logic, allowing unauthorized Google accounts to view and modify data after login. In contrast, ChatGPT-generated apps default to private settings, preventing access even when URLs are discovered via passive DNS. The incident highlights how AI coding tools lower the barrier to publishing internal applications while weakening the review processes that traditionally protected sensitive data.