OSINT for the Lazy Part 18: Extracting Value from Wayback Machine Archives for Bug Bounty and Security Research
The article examines how OSINT practitioners can leverage web archives for practical security research, particularly in bug bounty programs. Among the many available tools, those that query historical snapshots of websites stand out for their ability to reveal forgotten resources without active scanning.
Common findings from archived copies include old API endpoints, admin and test panels such as /admin, /test, and /debug, configuration and backup files with extensions like .bak, .sql, .old, and .git, as well as JavaScript files containing sensitive parameters or hardcoded keys. Outdated versions of applications may also expose vulnerabilities that have since been patched in the live site.
The primary advantage of this approach is its passive nature: queries are made only against public archives, so the target organization receives no direct requests and detection risk remains minimal.
waybackurls
waybackurls, developed by tomnomnom, is a lightweight Go utility that pulls every indexed URL for a given domain from the Wayback Machine CDX API. It supports subdomains and reveals parameters that can later be tested for issues such as IDOR, open redirect, LFI, and XSS. Installation requires Go and is performed with a single command: go install github.com/tomnomnom/waybackurls@latest.
gau (getallurls)
gau, created by lc, extends coverage by querying four sources simultaneously: Wayback Machine, Common Crawl, AlienVault OTX, and URLScan. It accepts domains via stdin or arguments, supports multiple targets, and offers rich filtering flags including --blacklist, --fc, --mc, --from, --to, and --providers. Installation command: go install github.com/lc/gau/v2/cmd/gau@latest.
waymore
For users preferring Python, waymore by xnl_h4ck3r provides the widest coverage and the ability to download full archived responses. It supports additional sources including VirusTotal, GhostArchive, and Intelligence X. While slower than the Go tools, it excels at retrieving content that can be further analyzed with tools such as xnLinkFinder or trufflehog for secrets and additional links.
Security researchers are encouraged to combine these utilities according to their needs: waybackurls or gau for quick results and waymore when maximum coverage and archived content analysis are required. All discovered URLs must only be tested on assets within authorized scope.
Related articles
Why Defending a Company Costs Millions While Attacks Can Succeed for Just Hundreds of Dollars
In the latest episode of Belyaev Podcast, CISO Vyacheslav Kasimov of Tochka Bank and Boris Evdokimov of ASNA pharmacy chain discussed the persistent asymmetry in cybersecurity spending. Attackers increasingly rely on affordable cloud services, automation, and rented infrastructure, while defenders must invest heavily in monitoring, access controls, backups, and skilled teams. The experts stressed that the absence of known breaches does not equal security, as undetected incidents or delayed discovery remain common risks. They advocated shifting from a "no" culture to risk-based decision making that helps business leaders understand potential losses, mitigation costs, and residual risk. The conversation also covered responsible use of AI in SOC operations and the long-term damage caused by loss of customer trust after incidents.
Beeline Offers One Month Free Access to Six Services for Prepaid Customers
Beeline has launched a promotional campaign allowing home users on prepaid plans to try up to six digital services for free over 30 days. The offer, tied to the operator's second annual Cellular Independence Day, runs from October 2 to October 9 and includes services such as Virtual Assistant PRO, unlimited mobile data, internet sharing without speed reduction, custom network name display, 250 GB of cloud storage, and access to over 650,000 e-books and audiobooks. Each selected service activates its own free period starting from the moment of connection and deactivates automatically afterward. Customers already paying for four or more of the listed services will receive 300 bonus rubles for communication instead. The unlimited data option is unavailable in the Chukotka Autonomous Okrug and Norilsk. Activation is handled exclusively through the Beeline mobile app, and users with existing paid subscriptions to any service cannot activate the free trial version of the same service.
Enterprise-Grade Web Protection on a Budget: How Cloud WAF Lowers Barriers for SMBs
A new overview from Reg.cloud explains how cloud-based Web Application Firewalls reduce the cost and complexity of protecting websites, APIs, and web applications for small and medium-sized Russian businesses. According to Positive Technologies data cited in the article, 75% of successful web application attacks in 2025 disrupted organizational operations, while 82% of SMBs faced cyber incidents in the past year. The piece details the differences between traditional on-premises WAF deployments and cloud offerings, emphasizing ready-made protection profiles for CMS platforms, SaaS services, and digital agencies. It outlines a three-stage operational model covering preparation, DNS-based traffic redirection, and ongoing policy tuning that can be handled by existing DevOps or development teams without dedicated security staff. The service currently offers a free tier supporting up to three applications at 50 requests per second, along with seven preconfigured security profiles and dual audit/blocking modes. The article concludes by stressing that WAF remains only one layer and must be combined with patching, access controls, and separate DDoS or anti-bot solutions.
Yandex B2B Tech Integrates Hybrid Full-Text and Vector Search in Single YDB Query
Yandex B2B Tech has added hybrid search to its YDB database, allowing full-text and vector approaches to run together inside one SQL query. The update helps small and medium businesses as well as large corporations locate exact document identifiers while also matching semantic meaning in descriptions, even when wording differs. Full-text search handles precise elements such as policy numbers, codes, and names, whereas vector search identifies conceptual similarity. Results from both methods are merged and ranked within the same transaction, keeping all data inside a single database instance. This removes the need to maintain a separate search engine and vector store or to reconcile information between them. The technology is aimed at chatbots, recommendation systems, and AI assistants that process technical content where both exact codes and human-readable problem descriptions matter equally. Hybrid search is now available in the on-premises YDB 26.3 release and in the cloud-based Managed Service for YDB.