AI-Powered Pentests Deliver Full Attack Chains Unlike Basic Vulnerability Scans
A new model of offensive testing is gaining traction in the market: AI-powered pentesting. Leading offensive cybersecurity companies are developing agents capable of executing increasingly large portions of a penetration test while complementing the work of human specialists. The technology increases speed, depth, and frequency of testing, yet it is still frequently confused with vulnerability scanning, a far simpler and more superficial solution.
Vulnerability scanning only searches for possible vulnerabilities. A scan runs pre-programmed checks to detect outdated versions, insecure configurations, and patterns associated with known vulnerabilities. It repeats payloads, compares responses, and generates alerts, often without understanding how the application works or confirming whether the flaw can actually be exploited. The output is typically an extensive list of possibilities that includes false positives and findings with little or no relevant business impact.
AI-powered pentesting operates differently. A specialized agent performs reconnaissance, enumeration, contextual analysis, business logic review, exploitation, and vulnerability validation. It interprets environment responses, forms hypotheses, selects new actions, and adapts its strategy throughout the test. The agent can also chain multiple weaknesses, advance through different attack paths, and produce evidence that demonstrates real-world impact. Each vulnerability is delivered with a technical description, business impact assessment, risk level, personalized recommendations, and a proof-of-concept containing detailed evidence. When applicable, the report includes reproduction steps, payloads, requests, and responses that prove exploitation.
This model currently complements manual pentesting, but its evolution points to a fundamental shift in how offensive testing will be conducted. Generic prompts alone do not create an AI pentest. A genuine AI pentest requires an architecture of specialized agents, memory systems, planning capabilities, scope controls, offensive tools, validation criteria, and a custom harness that guides the model through the entire operation. Many solutions marketed as AI pentesting remain scanners with new interfaces or generic models executing isolated actions.
Few companies have built proprietary offensive technology with the real ability to discover, exploit, and prove vulnerabilities. The majority of solutions labeled as AI pentesting still perform scans or connect generic models to offensive tools through prompts. A true AI pentest demands a complete architecture of specialized agents, proprietary tools, memory, planning, evidence validation, and a harness developed specifically to conduct the test from start to finish. In Brazil, only HackerSec has developed this capability with Yaga, its proprietary agent for web applications, APIs, mobile, and other environments. Internationally, XBOW and Aikido Security are also recognized in this category, yet the technical breadth, quality of deliverables, and integrations from the Brazilian company already place HackerSec ahead of XBOW in key criteria such as supported environments and results delivered.
Related articles
Local LLM Contract Analyzer Hit by Prompt Injection Despite Anti-Leak Instructions
A developer running a local nine-billion-parameter LLM for contract risk analysis discovered two suspicious log entries overnight. One contained repetitive garbage text, while the second embedded a classic prompt injection inside what appeared to be a legitimate contract: an instruction to ignore prior rules and output the full system prompt. The model partially complied by generating a fabricated risk entry titled SYSTEM PROMPT LEAK that described its own instructions, all while respecting the required JSON schema. Multiple defense layers were implemented, including input validation, regex-based injection phrase detection, an explicit rule inside the system prompt, and an output filter that replaces suspected leaks. Testing later revealed that the model still followed a hidden instruction to silently omit a specific contract clause, demonstrating that prompt-level rules only shift probabilities rather than enforce hard boundaries. The incident highlights that any document fed to an LLM must be treated as potentially hostile input.
GPT-6 Astra Shows Strong Tool Use and Math Results but Trails in Text Quality Tests
OpenAI released GPT-6 Astra on 3 September 2026 with capabilities for long-horizon tasks involving code, documents and external tools. Independent benchmarks from Artificial Analysis, Epoch AI and others reveal a mixed picture: the model leads in Epoch Capabilities Index and certain coding agent tests yet falls behind Claude Fable 5.1 in text generation and some professional document tasks. Astra solved two previously open problems on FrontierMath Erdős and reached 99.9 percent on ARC-AGI-3 when paired with a state-preserving adapter. The model was rated Critical for cyber capabilities after scoring 100 percent on ExploitBench and discovering two previously unknown vulnerabilities. Pricing starts at $10 per million input tokens, 2.5 times higher than GPT-5.6 Sol, while real-world costs vary sharply depending on task length and retries.
Stop Asking If AI Agent Skills Are Safe — Focus on Capability Disclosure Instead
A new approach called capability disclosure is proposed for evaluating skills used by AI agents, replacing unreliable safety badges. The shift comes after documented cases where malicious SKILL.md files survived system reinstalls through backups and executed data theft via prompt injection. Snyk's ToxicSkills analysis of 3984 public skills found 36.8% with security issues and 13.4% critical, including 76 confirmed malicious payloads. The skill-xray tool provides structural scanning and tiered reporting from T0 (inert text) to T4 (opaque runtime code loading) without issuing safety verdicts. Real-world examples include CVE-2025-6514 affecting mcp-remote with over 437,000 installations. The method emphasizes revealing what a skill can access rather than promising it is harmless.
OpenAI GPT-6 Astra Deploys Multi-Agent Parallel Processing, Increasing Local CPU Load and Security Risks
Early users of GPT-6 Astra have observed the model distributing complex tasks across multiple specialized agents that plan, solve, test code, verify results, and iterate after failures. This multi-agent approach enables faster handling of multi-step workflows compared to sequential chatbots. OpenAI states that Astra can control computers, operate browsers and applications, and install or test software, though it has not officially confirmed a native multi-agent architecture. Main computations run in the cloud, but agent tools can execute on user devices or corporate servers, leading to noticeable processor load when multiple agents compile code, launch browsers, run tests, and operate containers simultaneously. Corporate environments face added complexity as each agent requires virtual machines, sandboxes, internal data access, and careful environment cleanup. The increased autonomy has prompted OpenAI to strengthen monitoring of Astra actions and permission boundaries for subscribers of ChatGPT and enterprise clients.