reconFTW is a tool designed to perform automated recon on a target domain by running the best set of tools to perform scanning and finding out vulnerabilities
Shell bug-bountybugbountybugbounty-tooldnshackingnucleiosintpenetration-testingpentestpentest-toolpentestingreconreconnaissancescannersecuritysecurity-toolssubdomainsubdomain-enumerationvulnerabilities
New tools
six2dez31051edafb1e
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex ceeefd1..efdb4cf 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -86,6 +86,12 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0- Deep wildcard detection (`DEEP_WILDCARD_FILTER`) based on iterative wildcard checks.- Time-based certificate filtering (`DNS_TIME_FENCE_DAYS`).- Sensitive domain exclusion (`EXCLUDE_SENSITIVE`, `config/sensitive_domains.txt`).+- New integrated engines/tools:+ - `toxicache` for additional web cache poisoning coverage.+ - `postleaksNg` in `apileaks` for Postman leak discovery.+ - `favirecon` as `favirecon_tech` for favicon-based technology reconnaissance.+ - `TInjA` as the default `ssti` engine (`SSTI_ENGINE=tinja`, with legacy fallback).+ - `second-order` as default `brokenLinks` engine (`BROKENLINKS_ENGINE=second-order`, with legacy fallback).**Progress and UX**- Progress/ETA functions (`progress_init()`, `progress_step()`) integrated in recon flows.@@ -130,10 +136,10 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0**Dry-Run Mode**- Wrapped 83 unwrapped command executions across all modules to respect `DRY_RUN` flag:- - `osint.sh`: 24 commands (whois, dig, curl APIs, gitdorks_go, enumerepo, porch-pirate, misconfig-mapper, exiftool, interlace git clone, Python tools: dorks_hunter, metagoofil, SwaggerSpy, EmailHarvester, LeakSearch, msftrecon, Scopify, Spoofy)+ - `osint.sh`: 24 commands (whois, dig, curl APIs, gitdorks_go, enumerepo, porch-pirate, postleaksNg, misconfig-mapper, exiftool, interlace git clone, Python tools: dorks_hunter, metagoofil, SwaggerSpy, EmailHarvester, LeakSearch, msftrecon, Scopify, Spoofy)- `subdomains.sh`: 15 commands (asnmap, dig zone transfer, curl APIs, hakip2host, csprecon, regulator, cloud enumeration)- - `web.sh`: 20 commands (fav-up, grpcurl, CMSeeK, JSA, getjswords, jsluice, wget, interlace/ffuf, curl WebSocket, pydictor)- - `vulns.sh`: 5 commands (Corsy, Oralyzer, interlace/ffuf LFI, interlace/ffuf SSTI, interlace/ghauri SQLi)+ - `web.sh`: 20 commands (fav-up, favirecon, grpcurl, CMSeeK, JSA, getjswords, jsluice, wget, interlace/ffuf, curl WebSocket, pydictor, second-order)+ - `vulns.sh`: 6 commands (Corsy, Oralyzer, interlace/ffuf LFI, TInjA/legacy SSTI, interlace/ghauri SQLi, toxicache)- `core.sh`: 8 commands (tar/curl uploads, Telegram/Discord/Slack notifications, connectivity checks)- `modes.sh`: 8 commands (faraday-cli reporting)- `axiom.sh`: 3 commands (hakip2host, mapcidr)@@ -149,7 +155,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0- Command normalization removes newlines/extra whitespace from multi-line command strings for cleaner display- Dry-run command previews now redact sensitive CLI values (for example `-token-string`, API keys, and bearer tokens).- Dry-run in parallel mode now aggregates commands emitted from child subshells, so module summaries reflect full command volume.-- Dry-run no longer produces noisy parser/file errors in guarded paths (`apileaks`, `sub_crt`, `prototype_pollution`, `fuzzparams`, `sub_tls`, `sub_permut`, `urlchecks`).+- Dry-run no longer produces noisy parser/file errors in guarded paths (`apileaks`, `sub_crt`, `prototype_pollution`, `fuzzparams`, `sub_tls`, `sub_permut`, `urlchecks`, `favirecon_tech`, `webcache`, `brokenLinks`, `ssti`).- `test_ssl` now respects `run_command`, preventing real execution during dry-run.- `sub_asn` now applies timeout fencing with kill semantics (`-k`) when timeout tooling is available and reports non-OK outcomes correctly.- `subdomains` finalization now safely creates missing incremental files before counting to avoid stderr noise.diff --git a/Docker/amass_config.ini b/Docker/amass_config.inideleted file mode 100644index 56063d9..0000000--- a/Docker/amass_config.ini+++ /dev/null@@ -1,367 +0,0 @@-# Copyright © by Jeff Foley 2017-2022. All rights reserved.-# Use of this source code is governed by Apache 2 LICENSE that can be found in the LICENSE file.-# SPDX-License-Identifier: Apache-2.0--# Should results only be collected passively and without DNS resolution? Not recommended.-#mode = passive-# Would you like to use active techniques that communicate directly with the discovered assets,-# such as pulling TLS certificates from discovered IP addresses and attempting DNS zone transfers?-#mode = active--# The directory that stores the Cayley graph database and other output files-# The default for Linux systems is: $HOME/.config/amass-#output_directory = amass--# Another location (directory) where the user can provide ADS scripts to the engine.-#scripts_directory =--# The maximum number of DNS queries that can be performed concurrently during the enumeration.-#maximum_dns_queries = 20000--# DNS resolvers used globally by the amass package.-#[resolvers]-#resolver = 1.1.1.1 ; Cloudflare-#resolver = 8.8.8.8 ; Google-#resolver = 64.6.64.6 ; Verisign-#resolver = 74.82.42.42 ; Hurricane Electric-#resolver = 1.0.0.1 ; Cloudflare Secondary-#resolver = 8.8.4.4 ; Google Secondary-#resolver = 64.6.65.6 ; Verisign Secondary-#resolver = 77.88.8.8 ; Yandex.DNS Secondary--[scope]-# The network infrastructure settings expand scope, not restrict the scope.-# Single IP address or range (e.g. a.b.c.10-245)-#address = 192.168.1.1-#cidr = 192.168.1.0/24-#asn = 26808-port = 80-port = 443-#port = 8080-#port = 8443--# Root domain names used in the enumeration. The findings are limited by the root domain names provided.-#[scope.domains]-#domain = owasp.org-#domain = appsecusa.org-#domain = appsec.eu-#domain = appsec-labs.com--# Are there any subdomains that are out of scope?-#[scope.blacklisted]-#subdomain = education.appsec-labs.com-#subdomain = 2012.appsecusa.org--# The graph database discovered DNS names, associated network infrastructure, results from data sources, etc.-# This information is then used in future enumerations and analysis of the discoveries.-#[graphdbs]-# postgres://[username:password@]host[:port]/database-name?sslmode=disable of the PostgreSQL-# database and credentials. Sslmode is optional, and can be disable, require, verify-ca, or verify-full.-#[graphdbs.postgres]-#primary = false ; Specify which graph database is the primary db, or the local database will be selected.-#url = "postgres://[username:password@]host[:port]/database-name?sslmode=disable"-#options="connect_timeout=10"--# MqSQL database and credentials URL format:-# [username:password@]tcp(host[:3306])/database-name?timeout=10s-#[graphdbs.mysql]-#url = [username:password@]tcp(host[:3306])/database-name?timeout=10s--# Settings related to DNS name brute forcing.-#[bruteforce]-#enabled = true-#recursive = true-# Number of discoveries made in a subdomain before performing recursive brute forcing: Default is 1.-#minimum_for_recursive = 1-#wordlist_file = /usr/share/wordlists/all.txt-#wordlist_file = /usr/share/wordlists/all.txt # multiple lists can be used--# Would you like to permute resolved names?-#[alterations]-#enabled = true-# edit_distance specifies the number of times a primitive edit operation will be-# performed on a name sample during fuzzy label searching.-#edit_distance = 1 ; Setting this to zero will disable this expensive feature.-#flip_words = true # test-dev.owasp.org -> test-prod.owasp.org-#flip_numbers = true # test1.owasp.org -> test2.owasp.org-#add_words = true # test.owasp.org -> test-dev.owasp.org-#add_numbers = true # test.owasp.org -> test1.owasp.org-# Multiple lists can be used.-#wordlist_file = /usr/share/wordlists/all.txt-#wordlist_file = /usr/share/wordlists/all.txt--[data_sources]-# When set, this time-to-live is the minimum value applied to all data source caching.-minimum_ttl = 1440 ; One day--# Are there any data sources that should be disabled?-#[data_sources.disabled]-#data_source = Ask-#data_source = Bing--# Provide data source configuration information.-# See the following format:-#[data_sources.SOURCENAME] ; The SOURCENAME must match the name in the data source implementation.-#ttl = 4320 ; Time-to-live value sets the number of minutes that the responses are cached.-# Unique identifier for this set of SOURCENAME credentials.-# Multiple sets of credentials can be provided and will be randomly selected.-#[data_sources.SOURCENAME.CredentialSetID]-#apikey = ; Each data source uses potentially different keys for authentication.-#secret = ; See the examples below for each data source.-#username =-#password =--# https://passivedns.cn (Contact)-#[data_sources.360PassiveDNS]-#[data_sources.360PassiveDNS.Credentials]-#apikey =--# https://ahrefs.com (Paid)-#[data_sources.Ahrefs]-#ttl = 4320-#[data_sources.Ahrefs.Credentials]-#apikey =--# https://otx.alienvault.com (Free)-#[data_sources.AlienVault]-#[data_sources.AlienVault.Credentials]-#apikey =--# https://app.binaryedge.com (Paid/Free-trial)-#[data_sources.BinaryEdge]-#ttl = 10080-#[data_sources.BinaryEdge.Credentials]-#apikey =--# https://tls.bufferover.run/dns?q=.example.com (Paid/Free)-#[data_sources.BufferOver]-#[data_sources.BufferOver.Credentials]-#apikey =--# https://builtwith.com (Paid/Free-trial)-#[data_sources.BuiltWith]-#ttl = 10080-#[data_sources.BuiltWith.Credentials]-#apikey =--# https://c99.nl (Paid)-#[data_sources.C99]-#ttl = 4320-#[data_sources.C99.account1]-#apikey =-#[data_sources.C99.account2]-#apikey =--# https://censys.io (Paid/Free-trial)-#[data_sources.Censys]-#ttl = 10080-#[data_sources.Censys.Credentials]-#apikey =-#secret =--# https://chaos.projectdiscovery.io (Invite-Only)-#[data_sources.Chaos]-#ttl = 4320-#[data_sources.Chaos.Credentials]-#apikey =--# https://cloudflare.com (Free)-# Cloudflare apikey is the API token with dns_records and zone read permission-#[data_sources.Cloudflare]-#[data_sources.Cloudflare.Credentials]-#apikey =--# https://circl.lu (Contact)-#[data_sources.CIRCL]-#[data_sources.CIRCL.Credentials]-#username =-#password =--# https://dnsdb.info (Paid)-#[data_sources.DNSDB]-#ttl = 4320-#[data_sources.DNSDB.Credentials]-#apikey =--# https://dnslytics.com (Paid)-#[data_sources.DNSlytics]-#[data_sources.DNSlytics.Credentials]-#apikey =--# https://dnsrepo.noc.org (Paid)-#[data_sources.DNSRepo]-#[data_sources.DNSRepo.Credentials]-#apikey =--# https://detectify.com (Paid)-#[data_sources.Detectify]-#[data_sources.Detectify.Credentials]-#apikey =--# https://developer.facebook.com (Free)-# Look here for how to obtain the Facebook credentials:-# https://goldplugins.com/documentation/wp-social-pro-documentation/how-to-get-an-app-id-and-secret-key-from-facebook/-#[data_sources.FacebookCT]-#ttl = 4320-#[data_sources.FacebookCT.app1]-#apikey =-#secret =-#[data_sources.FacebookCT.app2]-#apikey =-#secret =--# https://fofa.so (Paid)-#[data_sources.FOFA]-#ttl = 10080-#[data_sources.FOFA.Credentials]-#username =-#apikey =--# https://github.com (Free)-#[data_sources.GitHub]-#ttl = 4320-#[data_sources.GitHub.accountname]-#apikey =--# https://gitlab.com (Freemium)-#[data_sources.GitLab]-#[data_sources.GitLab.free]-#apikey =-#[data_sources.GitLab.premium]-#apikey =--# https://hackertarget.com (Paid/Free)-# HackerTarget can be used without an API key, but the key allows better results-#[data_sources.HackerTarget]-#ttl = 1440-#[data_sources.HackerTarget.Credentials]-#apikey =--# https://hunter.io (Paid/Free-trial)-#[data_sources.Hunter]-#[data_sources.Hunter.Credentials]-#apikey =--#[data_sources.IntelX]-#[data_sources.IntelX.Credentials]-#apikey =--# https://ipdata.co (Free)-#[data_sources.IPdata]-#[data_sources.IPdata.Credentials]-#apikey =--# https://ipinfo.io (Paid/Free-trial)-#[data_sources.IPinfo]-#[data_sources.IPinfo.Credentials]-#apikey =--# https://leakix.net/ (Free)-#[data_sources.LeakIX]-#[data_sources.LeakIX.Credentials]-#apikey =--# https://networksdb.io (Paid/Free-trial)-#[data_sources.NetworksDB]-#[data_sources.NetworksDB.Credentials]-#apikey =--# https://onyphe.io (Free)-#[data_sources.ONYPHE]-#ttl = 10080-#[data_sources.ONYPHE.Credentials]-#apikey =--# https://passivetotal.com (Paid/Free-trial)-#[data_sources.PassiveTotal]-#ttl = 10080-#[data_sources.PassiveTotal.Credentials]-#username =-#apikey =--# https://pentest-tools.com (Paid)-#[data_sources.PentestTools]-#ttl = 10080-#[data_sources.PentestTools.Credentials]-#apikey =--# https://quake.360.cn (Paid)-#[data_sources.Quake]-#ttl = 4320-#[data_sources.Quake.Credentials]-#apikey =--# https://securitytrails.com (Paid/Free-trial)-#[data_sources.SecurityTrails]-#ttl = 1440-#[data_sources.SecurityTrails.Credentials]-#apikey =--# https://shodan.io (Paid/Free-trial)-#[data_sources.Shodan]-#ttl = 10080-#[data_sources.Shodan.Credentials]-#apikey =--# https://spamhaus.com (Free)-#[data_sources.Spamhaus]-#ttl = 1440-#[data_sources.Spamhaus.Credentials]-#username =-#password =--# https://spyse.com (Paid/Free-trial)-#[data_sources.Spyse]-#ttl = 4320-#[data_sources.Spyse.Credentials]-#apikey =--# https://threatbook.cn (Paid)-#[data_sources.ThreatBook]-#[data_sources.ThreatBook.account1]-#apikey=--# https://developer.twitter.com (Free)-# Provide your Twitter App Consumer API key and Consumer API secret key-#[data_sources.Twitter]-#[data_sources.Twitter.account1]-#apikey =-#secret =-#[data_sources.Twitter.account2]-#apikey =-#secret =--# https://umbrella.cisco.com (Paid-Enterprise)-# The apikey must be an API access token created through the Investigate management UI-#[data_sources.Umbrella]-#[data_sources.Umbrella.Credentials]-#apikey =--# https://urlscan.io (Paid/Free-trial)-# URLScan can be used without an API key, but the key allows new submissions to be made-#[data_sources.URLScan]-#[data_sources.URLScan.Credentials]-#apikey =--# https://virustotal.com (Paid/Free-trial)-#[data_sources.VirusTotal]-#ttl = 10080-#[data_sources.VirusTotal.Credentials]-#apikey =--# https://whoisxmlapi.com (Paid/Free-trial)-#[data_sources.WhoisXMLAPI]-#[data_sources.WhoisXMLAPI.Credentials]-#apikey =--# https://zetalytics.com (Paid/Invite-Only)-#[data_sources.ZETAlytics]-#ttl = 1440-#[data_sources.ZETAlytics.Credentials]-#apikey =--#[data_sources.ZoomEye]-#ttl = 1440-#[data_sources.ZoomEye.Credentials]-#username =-#password =diff --git a/README.md b/README.mdindex ef09c7a..3281cea 100644--- a/README.md+++ b/README.md@@ -8,28 +8,35 @@</h1><p align="center">- <a href="https://github.com/six2dez/reconftw/releases/tag/v4.0">- <img src="https://img.shields.io/badge/release-v4.0-green">- </a>- </a>- <a href="https://opensource.org/licenses/MIT">- <img src="https://img.shields.io/badge/License-MIT-yellow.svg">- </a>- <a href="https://twitter.com/Six2dez1">- <img src="https://img.shields.io/badge/twitter-%40Six2dez1-blue">- </a>- <a href="https://github.com/six2dez/reconftw/issues?q=is%3Aissue+is%3Aclosed">- <img src="https://img.shields.io/github/issues-closed-raw/six2dez/reconftw.svg">- </a>- <a href="https://github.com/six2dez/reconftw/wiki">- <img src="https://img.shields.io/badge/doc-wiki-blue.svg">- </a>- <a href="https://t.me/joinchat/H5bAaw3YbzzmI5co">- <img src="https://img.shields.io/badge/[email protected]">- </a>- <a href="https://discord.gg/R5DdXVEdTy">- <img src="https://img.shields.io/discord/1048623782912340038.svg?logo=discord">- </a>+ <a href="https://github.com/six2dez/reconftw/releases/tag/v4.0"><img src="https://img.shields.io/badge/release-v4.0-2ea043?style=for-the-badge" alt="Release"></a>+ <a href="https://opensource.org/licenses/MIT"><img src="https://img.shields.io/badge/License-MIT-yellow.svg?style=for-the-badge" alt="License"></a>+ <a href="https://github.com/six2dez/reconftw/issues?q=is%3Aissue+is%3Aclosed"><img src="https://img.shields.io/github/issues-closed-raw/six2dez/reconftw.svg?style=for-the-badge" alt="Closed Issues"></a>+ <a href="https://discord.gg/R5DdXVEdTy"><img src="https://img.shields.io/discord/1048623782912340038.svg?style=for-the-badge&logo=discord&label=discord" alt="Discord"></a>+ <a href="https://t.me/joinchat/H5bAaw3YbzzmI5co"><img src="https://img.shields.io/badge/telegram-@ReconFTW-26A5E4?style=for-the-badge&logo=telegram&logoColor=white" alt="Telegram"></a>+ <a href="https://twitter.com/Six2dez1"><img src="https://img.shields.io/badge/twitter-@Six2dez1-1D9BF0?style=for-the-badge&logo=x&logoColor=white" alt="Twitter"></a>+</p>++<p align="center">+ <a href="https://docs.reconftw.com"><img src="https://img.shields.io/badge/GitBook-%23000000.svg?style=for-the-badge&logo=gitbook&logoColor=white" alt="Docs"></a>+ <a href="https://github.com/six2dez/reconftw"><img src="https://img.shields.io/badge/Bash%20Script-%23121011.svg?style=for-the-badge&logo=gnu-bash&logoColor=white" alt="Bash Script"></a>+ <a href="https://github.com/six2dez/reconftw"><img src="https://img.shields.io/badge/Linux-FCC624?style=for-the-badge&logo=linux&logoColor=black" alt="Linux"></a>+ <a href="https://github.com/six2dez/reconftw"><img src="https://img.shields.io/badge/macOS-000000?style=for-the-badge&logo=macos&logoColor=F0F0F0" alt="macOS"></a>+ <a href="https://github.com/six2dez/reconftw"><img src="https://img.shields.io/badge/github-%23121011.svg?style=for-the-badge&logo=github&logoColor=white" alt="GitHub"></a>+</p>++<p align="center">+ <a href="https://github.com/six2dez/reconftw/actions"><img src="https://img.shields.io/badge/github_actions-%232671E5.svg?style=for-the-badge&logo=githubactions&logoColor=white" alt="GitHub Actions"></a>+ <a href="https://hub.docker.com/r/six2dez/reconftw"><img src="https://img.shields.io/badge/docker-%230db7ed.svg?style=for-the-badge&logo=docker&logoColor=white" alt="Docker"></a>+ <a href="https://github.com/six2dez/reconftw/tree/main/Terraform"><img src="https://img.shields.io/badge/terraform-%23844FBA.svg?style=for-the-badge&logo=terraform&logoColor=white" alt="Terraform"></a>+ <a href="https://github.com/six2dez/reconftw/tree/main/Terraform"><img src="https://img.shields.io/badge/ansible-%231A1918.svg?style=for-the-badge&logo=ansible&logoColor=white" alt="Ansible"></a>+ <a href="https://github.com/six2dez/reconftw"><img src="https://img.shields.io/badge/Go-00ADD8.svg?style=for-the-badge&logo=go&logoColor=white" alt="Go"></a>+ <a href="https://github.com/six2dez/reconftw"><img src="https://img.shields.io/badge/Python-3776AB.svg?style=for-the-badge&logo=python&logoColor=white" alt="Python"></a>+</p>++<p align="center">+ <a href="https://www.buymeacoffee.com/six2dez"><img src="https://img.shields.io/badge/Buy%20Me%20a%20Coffee-ffdd00?style=for-the-badge&logo=buy-me-a-coffee&logoColor=black" alt="Buy Me a Coffee"></a>+ <a href="https://github.com/sponsors/six2dez"><img src="https://img.shields.io/badge/sponsor-30363D?style=for-the-badge&logo=GitHub-Sponsors&logoColor=EA4AAA" alt="GitHub Sponsors"></a>+ <a href="https://www.paypal.com/paypalme/six2dez"><img src="https://img.shields.io/badge/PayPal-00457C?style=for-the-badge&logo=paypal&logoColor=white" alt="PayPal"></a></p>**reconFTW** is a powerful automated reconnaissance tool designed for security researchers and penetration testers. It streamlines the process of gathering intelligence on a target by performing subdomain enumeration, vulnerability scanning, OSINT and more. With a modular design, extensive configuration options, and support for distributed scanning via AX Framework, reconFTW is built to deliver comprehensive results efficiently.@@ -102,7 +109,7 @@ reconFTW is packed with features to make reconnaissance thorough and efficient.- **Email and Password Leaks**: Searches for leaked emails and credentials ([emailfinder](https://github.com/Josue87/EmailFinder) and [LeakSearch](https://github.com/JoelGMSec/LeakSearch)).- **Microsoft 365/Azure Mapping**: Identifies Microsoft 365 and Azure tenants ([msftrecon](https://github.com/Arcanum-Sec/msftrecon)).- **Metadata Extraction**: Extracts metadata from indexed office documents ([metagoofil](https://github.com/opsdisk/metagoofil)).-- **API Leaks**: Detects exposed APIs in public sources ([porch-pirate](https://github.com/MandConsultingGroup/porch-pirate) and [SwaggerSpy](https://github.com/UndeadSec/SwaggerSpy)).+- **API Leaks**: Detects exposed APIs in public sources ([porch-pirate](https://github.com/MandConsultingGroup/porch-pirate), [SwaggerSpy](https://github.com/UndeadSec/SwaggerSpy) and [postleaksNg](https://github.com/six2dez/postleaksNG)).- **Google Dorking**: Automated Google dork queries for sensitive information ([dorks_hunter](https://github.com/six2dez/dorks_hunter) and [xnldorker](https://github.com/xnl-h4ck3r/xnldorker)).- **GitHub Analysis**: Scans GitHub organizations for repositories and secrets ([enumerepo](https://github.com/trickest/enumerepo), [trufflehog](https://github.com/trufflesecurity/trufflehog) and [gitleaks](https://github.com/gitleaks/gitleaks)).- **Third-Party Misconfigurations**: Identifies misconfigured third-party services ([misconfig-mapper](https://github.com/intigriti/misconfig-mapper)).@@ -146,7 +153,7 @@ reconFTW is packed with features to make reconnaissance thorough and efficient.- **CMS Detection**: Identifies content management systems ([CMSeeK](https://github.com/Tuhinshubhra/CMSeeK)).- **URL Extraction**: Collects URLs passively and actively ([urlfinder](https://github.com/projectdiscovery/urlfinder), [waymore](https://github.com/xnl-h4ck3r/waymore), [katana](https://github.com/projectdiscovery/katana), [github-endpoints](https://gist.github.com/six2dez/d1d516b606557526e9a78d7dd49cacd3) and [JSA](https://github.com/w9w/JSA)).- **URL Pattern Analysis**: Classifies URLs using patterns ([urless](https://github.com/xnl-h4ck3r/urless), [gf](https://github.com/tomnomnom/gf) and [gf-patterns](https://github.com/1ndianl33t/Gf-Patterns)).-- **Favicon Analysis**: Discovers real IPs behind favicons ([fav-up](https://github.com/pielco11/fav-up)).+- **Favicon Analysis**: Discovers real IPs behind favicons ([fav-up](https://github.com/pielco11/fav-up)) and identifies technologies from favicon hashes ([favirecon](https://github.com/edoardottt/favirecon)).- **JavaScript Analysis**: Extracts secrets and endpoints from JS files ([subjs](https://github.com/lc/subjs), [JSA](https://github.com/w9w/JSA), [xnLinkFinder](https://github.com/xnl-h4ck3r/xnLinkFinder), [getjswords](https://github.com/m4ll0k/BBTz), [mantra](https://github.com/MrEmpy/mantra), [jsluice](https://github.com/BishopFox/jsluice)).- **Source Map Extraction**: Retrieves sensitive data from JavaScript source maps ([sourcemapper](https://github.com/denandz/sourcemapper)).- **GraphQL Detection**: Discovers GraphQL endpoints with nuclei and optionally performs in-depth introspection ([GQLSpection](https://github.com/doyensec/GQLSpection)).@@ -169,13 +176,13 @@ reconFTW is packed with features to make reconnaissance thorough and efficient.- **SSRF**: Tests for server-side request forgery ([interactsh](https://github.com/projectdiscovery/interactsh) and param values with [ffuf](https://github.com/ffuf/ffuf)).- **CRLF**: Checks for CRLF injection vulnerabilities ([crlfuzz](https://github.com/dwisiswant0/crlfuzz)).- **LFI**: Tests for local file inclusion via fuzzing ([ffuf](https://github.com/ffuf/ffuf)).-- **SSTI**: Detects server-side template injection ([ffuf](https://github.com/ffuf/ffuf)).+- **SSTI**: Detects server-side template injection ([TInjA](https://github.com/Hackmanit/TInjA), with legacy ffuf mode available).- **SQLi**: Tests for SQL injection ([SQLMap](https://github.com/sqlmapproject/sqlmap) and [ghauri](https://github.com/r0oth3x49/ghauri)).-- **Broken Links**: Identifies broken links on web pages ([katana](https://github.com/projectdiscovery/katana)).+- **Broken Links**: Identifies broken links and external references likely to be takeover-prone ([second-order](https://github.com/mhmdiaa/second-order), with legacy katana mode available).- **Command Injection**: Tests for command injection vulnerabilities ([commix](https://github.com/commixproject/commix)).- **Prototype Pollution**: Detects JavaScript prototype pollution ([ppmap](https://github.com/kleiton0x00/ppmap)).- **HTTP Request Smuggling**: Checks for request smuggling vulnerabilities ([smugglex](https://github.com/hahwul/smugglex)).-- **Web Cache**: Identifies web cache vulnerabilities ([Web-Cache-Vulnerability-Scanner](https://github.com/Hackmanit/Web-Cache-Vulnerability-Scanner)).+- **Web Cache**: Identifies web cache vulnerabilities ([Web-Cache-Vulnerability-Scanner](https://github.com/Hackmanit/Web-Cache-Vulnerability-Scanner) and [toxicache](https://github.com/xhzeem/toxicache)).- **4XX Bypassing**: Attempts to bypass 4XX responses ([nomore403](https://github.com/devploit/nomore403)).- **Parameter Fuzzing**: Fuzzes URL parameters for vulnerabilities ([nuclei](https://github.com/projectdiscovery/nuclei)).@@ -536,6 +543,7 @@ EMAILS=true # Fetch emails from differents sitesDOMAIN_INFO=true # whois infoIP_INFO=true # Reverse IP search, geolocation and whoisAPI_LEAKS=true # Check for API leaks+API_LEAKS_POSTLEAKS=true # Enhance API leaks with postleaksNgTHIRD_PARTIES=true # Check for 3rd parties misconfigsSPOOF=true # Check spoofable domainsMETAFINDER_LIMIT=20 # Max 250@@ -575,6 +583,7 @@ UNCOMMON_PORTS_WEB="81,300,591,593,832,981,1010,1311,1099,2082,2095,2096,2480,30# HostFAVICON=true # Check Favicon domain discovery+FAVIRECON=true # Favicon-based technology recon for discovered web targetsPORTSCANNER=true # Enable or disable the whole Port scanner moduleGEO_INFO=true # Fetch Geolocalization infoPORTSCAN_PASSIVE=true # Port scanner with Shodan@@ -619,15 +628,18 @@ SSRF_CHECKS=true # SSRF checksCRLF_CHECKS=true # CRLF checksLFI=true # LFI by fuzzingSSTI=true # SSTI by fuzzing+SSTI_ENGINE="tinja" # SSTI engine: tinja|legacySQLI=true # Check SQLISQLMAP=true # Check SQLI with sqlmapGHAURI=false # Check SQLI with ghauriBROKENLINKS=true # Check for brokenlinks+BROKENLINKS_ENGINE="second-order" # Broken links engine: second-order|legacySPRAY=true # Performs password sprayingCOMM_INJ=true # Check for command injections with commixPROTO_POLLUTION=true # Check for prototype pollution flawsSMUGGLING=true # Check for HTTP request smuggling flawsWEBCACHE=true # Check for Web Cache issues+WEBCACHE_TOXICACHE=true # Complement web cache checks with toxicacheBYPASSER4XX=true # Check for 4XX bypassesFUZZPARAMS=true # Fuzz parameters valuesdiff --git a/config/reconftw_full.cfg b/config/reconftw_full.cfgindex d8b865e..2f14c40 100644--- a/config/reconftw_full.cfg+++ b/config/reconftw_full.cfg@@ -14,6 +14,7 @@ EMAILS=trueDOMAIN_INFO=trueIP_INFO=trueAPI_LEAKS=true+API_LEAKS_POSTLEAKS=trueTHIRD_PARTIES=trueSPOOF=trueMAIL_HYGIENE=true@@ -43,6 +44,7 @@ WEBPROBEFULL=trueWEBSCREENSHOT=trueVIRTUALHOSTS=trueFAVICON=true+FAVIRECON=true# HostPORTSCANNER=true@@ -80,15 +82,18 @@ SSRF_CHECKS=trueCRLF_CHECKS=trueLFI=trueSSTI=true+SSTI_ENGINE="tinja"SQLI=trueSQLMAP=trueGHAURI=trueBROKENLINKS=true+BROKENLINKS_ENGINE="second-order"SPRAY=trueCOMM_INJ=truePROTO_POLLUTION=trueSMUGGLING=trueWEBCACHE=true+WEBCACHE_TOXICACHE=trueBYPASSER4XX=trueFUZZPARAMS=truediff --git a/config/reconftw_quick.cfg b/config/reconftw_quick.cfgindex 818507b..a9e4116 100644--- a/config/reconftw_quick.cfg+++ b/config/reconftw_quick.cfg@@ -5,6 +5,7 @@# Base config is already loaded by reconftw.sh before this file.# Disable active/intrusive modules+API_LEAKS_POSTLEAKS=falseSUBBRUTE=falseSUBSCRAPING=falseSUBPERMUTE=false@@ -19,6 +20,7 @@ DEEP_WILDCARD_FILTER=falseWEBPROBEFULL=falseWEBSCREENSHOT=falseVIRTUALHOSTS=false+FAVIRECON=falsePORTSCANNER=falsePORTSCAN_ACTIVE=falseCDN_IP=false@@ -56,6 +58,9 @@ SMUGGLING=falseWEBCACHE=falseBYPASSER4XX=falseFUZZPARAMS=false+WEBCACHE_TOXICACHE=false+BROKENLINKS_ENGINE="legacy"+SSTI_ENGINE="legacy"# Disable heavy extrasGRAPHQL_CHECK=falsediff --git a/config/reconftw_stealth.cfg b/config/reconftw_stealth.cfgindex 0338c23..245fdcf 100644--- a/config/reconftw_stealth.cfg+++ b/config/reconftw_stealth.cfg@@ -14,6 +14,7 @@ EMAILS=trueDOMAIN_INFO=trueIP_INFO=trueAPI_LEAKS=true+API_LEAKS_POSTLEAKS=falseTHIRD_PARTIES=trueSPOOF=trueMAIL_HYGIENE=true@@ -46,6 +47,7 @@ VIRTUALHOSTS=false# Host: passive onlyFAVICON=false+FAVIRECON=falsePORTSCANNER=truePORTSCAN_PASSIVE=truePORTSCAN_ACTIVE=false@@ -92,6 +94,9 @@ SMUGGLING=falseWEBCACHE=falseBYPASSER4XX=falseFUZZPARAMS=false+WEBCACHE_TOXICACHE=false+BROKENLINKS_ENGINE="legacy"+SSTI_ENGINE="legacy"# Nuclei: only safe templatesNUCLEICHECK=truediff --git a/install.sh b/install.shindex c94ec5c..eff8dc2 100755--- a/install.sh+++ b/install.sh@@ -242,6 +242,10 @@ declare -A gotools=(["VhostFinder"]="go install -v github.com/wdahlenburg/VhostFinder@latest"["misconfig-mapper"]="go install github.com/intigriti/misconfig-mapper/cmd/misconfig-mapper@latest"["grpcurl"]="go install -v github.com/fullstorydev/grpcurl/cmd/grpcurl@latest"+ ["toxicache"]="go install -v github.com/xhzeem/toxicache@latest"+ ["favirecon"]="go install -v github.com/edoardottt/favirecon/cmd/favirecon@latest"+ ["second-order"]="go install -v github.com/mhmdiaa/second-order@latest"+ ["tinja"]="go install -v github.com/Hackmanit/TInjA@latest")# Declare pipx tools and their paths@@ -295,6 +299,7 @@ declare -A repos=(["metagoofil"]="opsdisk/metagoofil"["EmailHarvester"]="maldevel/EmailHarvester"["reconftw_ai"]="six2dez/reconftw_ai"+ ["postleaksNg"]="six2dez/postleaksNG")# Function to display the banner@@ -515,6 +520,18 @@ function install_tools() {"trufflehog")go install &>/dev/null;;+ "postleaksNg")+ if [[ ! -d "venv" ]]; then+ python3 -m venv venv &>/dev/null || true+ fi+ if [[ -f "venv/bin/activate" ]]; then+ # shellcheck disable=SC1091+ source venv/bin/activate+ pip3 install --upgrade pip &>/dev/null || true+ pip3 install -e . &>/dev/null || true+ deactivate || true+ fi+ ;;esac# Copy gf patterns if applicablediff --git a/modules/core.sh b/modules/core.shindex 43e452c..988bb80 100644--- a/modules/core.sh+++ b/modules/core.sh@@ -211,6 +211,7 @@ function tools_installed() {["spoofy_python"]="${tools}/Spoofy/venv/bin/python3"["swaggerspy"]="${tools}/SwaggerSpy/swaggerspy.py"["swaggerspy_python"]="${tools}/SwaggerSpy/venv/bin/python3"+ ["postleaksNg"]="${tools}/postleaksNg/.venv/bin/postleaksNg"["LeakSearch"]="${tools}/LeakSearch/LeakSearch.py"["LeakSearch_python"]="${tools}/LeakSearch/venv/bin/python3"["Oralyzer"]="${tools}/Oralyzer/oralyzer.py"@@ -307,6 +308,10 @@ function tools_installed() {["arjun"]="arjun"["gqlspection"]="gqlspection"["cloud_enum"]="cloud_enum"+ ["toxicache"]="toxicache"+ ["favirecon"]="favirecon"+ ["tinja"]="tinja"+ ["second-order"]="second-order")# Check for tool filesdiff --git a/modules/modes.sh b/modules/modes.shindex 8277d8f..3566978 100644--- a/modules/modes.sh+++ b/modules/modes.sh@@ -690,7 +690,7 @@ function recon() {webprobe_fullif [[ "${PARALLEL_MODE:-true}" == "true" ]] && declare -f parallel_funcs &>/dev/null; then- parallel_funcs "${PAR_WEB_DETECT_GROUP_SIZE:-3}" screenshot cdnprovider portscan+ parallel_funcs "${PAR_WEB_DETECT_GROUP_SIZE:-3}" screenshot cdnprovider portscan favirecon_techlocal webhost_rc=$?if ((webhost_rc > 0)); thenif [[ "${CONTINUE_ON_TOOL_ERROR:-true}" == "true" ]]; then@@ -706,6 +706,7 @@ function recon() {# virtualhostscdnproviderportscan+ favirecon_techgeo_infofi@@ -1069,6 +1070,7 @@ function subs_menu() {_print_section "Web Detection"webprobe_simplewebprobe_full+ favirecon_techscreenshot# virtualhosts@@ -1084,6 +1086,7 @@ function webs_menu() {webprobe_simplewebprobe_full+ favirecon_techsubtakeoverremove_big_filesscreenshot@@ -1129,6 +1132,7 @@ function zen_menu() {_print_section "Web Detection"webprobe_simplewebprobe_full+ favirecon_techscreenshot# virtualhostscdnproviderdiff --git a/modules/osint.sh b/modules/osint.shindex e966b70..fdaebc4 100644--- a/modules/osint.sh+++ b/modules/osint.sh@@ -245,6 +245,36 @@ function apileaks() {return 1fi+ # Optional postleaksNg integration (Postman public library leaks)+ if [[ ${API_LEAKS_POSTLEAKS:-true} == true ]]; then+ local postleaks_bin="${tools}/postleaksNg/.venv/bin/postleaksNg"+ local postleaks_out="${dir}/osint/postman_leaks_postleaksng"+ mkdir -p "$postleaks_out"+ if [[ -x "$postleaks_bin" ]]; then+ local -a postleaks_cmd=(+ "$postleaks_bin"+ -k "$domain"+ --output "$postleaks_out"+ -t "${POSTLEAKS_THREADS:-10}"+ )+ [[ -n "${POSTLEAKS_INCLUDE:-}" ]] && postleaks_cmd+=(--include "${POSTLEAKS_INCLUDE}")+ [[ -n "${POSTLEAKS_EXCLUDE:-}" ]] && postleaks_cmd+=(--exclude "${POSTLEAKS_EXCLUDE}")++ if ! run_command "${postleaks_cmd[@]}" 2>>"$LOGFILE" >/dev/null; then+ log_note "apileaks: postleaksNg failed" "${FUNCNAME[0]}" "${LINENO}"+ fi++ # Aggregate discovered URLs into the existing postman leaks artifact.+ if compgen -G "${postleaks_out}/*.json" >/dev/null 2>&1; then+ jq -r '.url // empty' "${postleaks_out}"/*.json 2>/dev/null \+ | grep -aE '^https?://' \+ | anew -q "${dir}/osint/postman_leaks.txt"+ fi+ else+ log_note "apileaks: postleaksNg binary not found at ${postleaks_bin}" "${FUNCNAME[0]}" "${LINENO}"+ fi+ fi+if [[ "${DRY_RUN:-false}" == "true" ]]; thenend_func "Dry-run: apileaks commands recorded" "${FUNCNAME[0]}" "SKIP"return@@ -254,6 +284,9 @@ function apileaks() {if [[ -s "${dir}/osint/postman_leaks.txt" ]]; thenrun_command trufflehog filesystem "${dir}/osint/postman_leaks.txt" -j 2>/dev/null | jq -c | anew -q "${dir}/osint/postman_leaks_trufflehog.json"fi+ if [[ -d "${dir}/osint/postman_leaks_postleaksng" ]]; then+ run_command trufflehog filesystem "${dir}/osint/postman_leaks_postleaksng" -j 2>/dev/null | jq -c | anew -q "${dir}/osint/postman_leaks_trufflehog.json"+ fiif [[ -s "${dir}/osint/swagger_leaks.txt" ]]; thenrun_command trufflehog filesystem "${dir}/osint/swagger_leaks.txt" -j 2>/dev/null | jq -c | anew -q "${dir}/osint/swagger_leaks_trufflehog.json"diff --git a/modules/vulns.sh b/modules/vulns.shindex 06b8eb9..da46e27 100644--- a/modules/vulns.sh+++ b/modules/vulns.sh@@ -366,6 +366,8 @@ function ssti() {# Ensure gf/ssti.txt is not emptyif [[ -s "gf/ssti.txt" ]]; then+ local ssti_engine="${SSTI_ENGINE:-tinja}"+_print_msg INFO "Running: SSTI Payload Generation"# Process ssti.txt with qsreplace and filter lines containing 'FUZZ'@@ -374,12 +376,44 @@ function ssti() {# Determine whether to proceed based on DEEP flag or number of URLsURL_COUNT=$(wc -l <".tmp/tmp_ssti.txt")if [[ $DEEP == true ]] || [[ $URL_COUNT -le $DEEP_LIMIT ]]; then+ : >".tmp/ssti_candidates.txt"++ if [[ "$ssti_engine" == "tinja" ]] && command -v tinja >/dev/null 2>&1; then+ _print_msg INFO "Running: SSTI Checks with TInjA"+ local tinja_report_dir="$dir/.tmp/tinja"+ mkdir -p "$tinja_report_dir"+ local -a tinja_cmd=(tinja url --reportpath "${tinja_report_dir}/" --ratelimit "${TINJA_RATELIMIT:-0}" --timeout "${TINJA_TIMEOUT:-15}" --verbosity 0)+ if [[ -n "${HEADER:-}" ]]; then+ tinja_cmd+=(-H "${HEADER}")+ fi+ while IFS= read -r u; do+ [[ -n "$u" ]] && tinja_cmd+=(--url "$u")+ done <".tmp/tmp_ssti.txt"- _print_msg INFO "Running: SSTI Fuzzing with FFUF"+ if ! run_command "${tinja_cmd[@]}" 2>>"$LOGFILE" >/dev/null; then+ log_note "ssti: tinja execution failed, no findings collected" "${FUNCNAME[0]}" "${LINENO}"+ fi- # Use Interlace to parallelize FFUF scanning- run_command interlace -tL ".tmp/tmp_ssti.txt" -threads "$INTERLACE_THREADS" -c "ffuf -v -r -t ${FFUF_THREADS} -rate ${FFUF_RATELIMIT} -H \"${HEADER}\" -w \"${ssti_wordlist}\" -u \"_target_\" -mr \"ssti49\"" 2>>"$LOGFILE" \- | grep "URL" | sed 's/| URL | //' | anew -q "vulns/ssti.txt"+ local report_file=""+ report_file=$(ls -1t "${tinja_report_dir}"/*.jsonl 2>/dev/null | head -n 1 || true)+ if [[ -n "$report_file" && -s "$report_file" ]]; then+ jq -r 'select((.isWebpageVulnerable == true) or any(.parameters[]?; .isParameterVulnerable == true)) | (.url // empty) + " [certainty:" + (.certainty // "unknown") + "]"' "$report_file" 2>/dev/null \+ | sed '/^\s*$/d' \+ | anew -q ".tmp/ssti_candidates.txt"+ fi+ else+ [[ "$ssti_engine" == "tinja" ]] && _print_msg WARN "TInjA not found. Falling back to legacy SSTI check."+ _print_msg INFO "Running: SSTI Fuzzing with FFUF"++ # Use Interlace to parallelize FFUF scanning+ run_command interlace -tL ".tmp/tmp_ssti.txt" -threads "$INTERLACE_THREADS" -c "ffuf -v -r -t ${FFUF_THREADS} -rate ${FFUF_RATELIMIT} -H \"${HEADER}\" -w \"${ssti_wordlist}\" -u \"_target_\" -mr \"ssti49\"" 2>>"$LOGFILE" \+ | grep "URL" | sed 's/| URL | //' | anew -q ".tmp/ssti_candidates.txt"+ fi++ if [[ -s ".tmp/ssti_candidates.txt" ]]; then+ cat ".tmp/ssti_candidates.txt" | anew -q "vulns/ssti_tinja.txt"+ cat ".tmp/ssti_candidates.txt" | anew -q "vulns/ssti.txt"+ fiend_func "Results are saved in vulns/ssti.txt" "${FUNCNAME[0]}"else@@ -792,6 +826,15 @@ function webcache() {cat "$dir/.tmp/webcache.txt" | anew -q "vulns/webcache.txt"fi+ # Optional second engine (toxicache) to complement findings+ if [[ ${WEBCACHE_TOXICACHE:-true} == true ]] && command -v toxicache >/dev/null 2>&1; then+ local toxicache_out="$dir/.tmp/webcache_toxicache.txt"+ run_command toxicache -i "$dir/webs/webs_all.txt" -o "$toxicache_out" -t "${TOXICACHE_THREADS:-70}" -ua "${TOXICACHE_USER_AGENT:-Mozilla/5.0 (X11; Linux x86_64)}" 2>>"$LOGFILE" >/dev/null || true+ if [[ -s "$toxicache_out" ]]; then+ cat "$toxicache_out" | anew -q "vulns/webcache_toxicache.txt"+ fi+ fi+end_func "Results are saved in vulns/webcache.txt" "${FUNCNAME[0]}"elsediff --git a/modules/web.sh b/modules/web.shindex 582d629..d71f06f 100644--- a/modules/web.sh+++ b/modules/web.sh@@ -2,6 +2,7 @@# shellcheck disable=SC2154 # Variables defined in reconftw.cfg# reconFTW - Web analysis module# Contains: webprobe_simple, webprobe_full, screenshot, virtualhosts, favicon,+# favirecon_tech,# portscan, cdnprovider, waf_checks, nuclei_check, graphql_scan,# param_discovery, grpc_reflection, fuzz, iishortname, cms_scanner,# urlchecks, url_gf, url_ext, jschecks, websocket_checks,@@ -415,6 +416,67 @@ function favicon() {}+function favirecon_tech() {++ # Create necessary directories+ if ! ensure_dirs .tmp webs; then return 1; fi++ # Check if the function should run+ if { [[ ! -f "$called_fn_dir/.${FUNCNAME[0]}" ]] || [[ $DIFF == true ]]; } \+ && [[ ${FAVIRECON:-true} == true ]] \+ && ! [[ $domain =~ ^[0-9]+\.[0-9]+\.[0-9]+\.[0-9]+$ ]]; then++ start_func "${FUNCNAME[0]}" "Favicon Technology Recon"++ # Combine webs.txt and webs_uncommon_ports.txt into webs_all.txt if it doesn't exist+ if [[ ! -s "webs/webs_all.txt" ]]; then+ cat webs/webs.txt webs/webs_uncommon_ports.txt 2>/dev/null | anew -q "webs/webs_all.txt"+ fi++ if [[ -s "webs/webs_all.txt" ]]; then+ local fav_cmd=(+ favirecon+ -l "webs/webs_all.txt"+ -c "${FAVIRECON_CONCURRENCY:-50}"+ -t "${FAVIRECON_TIMEOUT:-10}"+ -s+ -j+ -o "webs/favirecon.json"+ )++ if [[ -n "${FAVIRECON_PROXY:-}" ]]; then+ fav_cmd+=(-px "${FAVIRECON_PROXY}")+ fi+ if [[ "${FAVIRECON_RATE_LIMIT:-0}" -gt 0 ]]; then+ fav_cmd+=(-rl "${FAVIRECON_RATE_LIMIT}")+ fi++ if ! run_command "${fav_cmd[@]}" 2>>"$LOGFILE" >/dev/null; then+ log_note "favirecon_tech: favirecon command failed" "${FUNCNAME[0]}" "${LINENO}"+ fi++ if [[ -s "webs/favirecon.json" ]]; then+ jq -r '[(.URL // .url // ""), (.Name // .name // "unknown"), (.Hash // .hash // "unknown")] | @tsv' "webs/favirecon.json" 2>/dev/null \+ | awk -F'\t' 'NF>=1 && $1 ~ /^https?:\/\// {printf "%s [%s] [%s]\n", $1, $2, $3}' \+ | anew -q "webs/favirecon.txt"+ fi+ else+ log_note "favirecon_tech: no webs/webs_all.txt found" "${FUNCNAME[0]}" "${LINENO}"+ fi++ end_func "Results are saved in webs/favirecon.[json|txt]" "${FUNCNAME[0]}"++ else+ if [[ ${FAVIRECON:-true} == false ]]; then+ _print_msg WARN "${FUNCNAME[0]} skipped due to configuration settings."+ elif [[ $domain =~ ^[0-9]+\.[0-9]+\.[0-9]+\.[0-9]+$ ]]; then+ return+ else+ _print_msg WARN "${FUNCNAME[0]} already processed. To force execution, delete ${called_fn_dir}/.${FUNCNAME[0]}"+ fi+ fi+}+function portscan() {# Create necessary directories@@ -1860,46 +1922,86 @@ function brokenLinks() {# Check if webs_all.txt exists and is not emptyif [[ -s "webs/webs_all.txt" ]]; then- if [[ $AXIOM != true ]]; then- # Use katana for scanning- if [[ ! -s ".tmp/katana.txt" ]]; then- if [[ $DEEP == true ]]; then- timeout 4h katana -silent -list "webs/webs_all.txt" -jc -kf all -c "$KATANA_THREADS" -d 3 -o ".tmp/katana.txt" 2>>"$LOGFILE" >/dev/null- else- timeout 3h katana -silent -list "webs/webs_all.txt" -jc -kf all -c "$KATANA_THREADS" -d 2 -o ".tmp/katana.txt" 2>>"$LOGFILE" >/dev/null+ local bl_engine="${BROKENLINKS_ENGINE:-second-order}"+ if [[ "$bl_engine" == "second-order" ]]; then+ local so_depth="${SECOND_ORDER_DEPTH:-1}"+ [[ $DEEP == true ]] && so_depth=$((so_depth + 1))++ rm -rf ".tmp/second_order" >/dev/null 2>&1 || true+ mkdir -p ".tmp/second_order"+ : >".tmp/brokenLinks_total.txt"++ while IFS= read -r target; do+ [[ -z "$target" ]] && continue+ local safe_target+ safe_target=$(echo "$target" | sed 's|https\?://||; s|[^A-Za-z0-9._-]|_|g')+ local out_dir=".tmp/second_order/${safe_target}"+ mkdir -p "$out_dir"++ local so_cmd=(+ second-order+ -target "$target"+ -config "${SECOND_ORDER_CONFIG:-${tools}/second-order/config/takeover.json}"+ -depth "$so_depth"+ -threads "${SECOND_ORDER_THREADS:-10}"+ -output "$out_dir"+ )+ if [[ ${SECOND_ORDER_INSECURE:-false} == true ]]; then+ so_cmd+=(-insecure)fi- fi- # Remove lines longer than 2048 characters- if [[ -s ".tmp/katana.txt" ]]; then- sed_i '/^.\{2048\}./d' ".tmp/katana.txt"- fi+ if [[ -n "${HEADER:-}" ]]; then+ so_cmd+=(-header "${HEADER}")+ fi++ run_command "${so_cmd[@]}" 2>>"$LOGFILE" >/dev/null || true++ if [[ -s "${out_dir}/non-200-url-attributes.json" ]]; then+ jq -r 'to_entries[]?.value | to_entries[]?.value[]? // empty' "${out_dir}/non-200-url-attributes.json" 2>/dev/null \+ | grep -aE '^https?://' \+ | anew -q ".tmp/brokenLinks_total.txt"+ fi+ done <"webs/webs_all.txt"else- # Use axiom-scan for scanning- if [[ ! -s ".tmp/katana.txt" ]]; then- if [[ $DEEP == true ]]; then- run_command axiom-scan "webs/webs_all.txt" -m katana -jc -kf all -d 3 --max-runtime 4h -o ".tmp/katana.txt" $AXIOM_EXTRA_ARGS 2>>"$LOGFILE" >/dev/null- else- run_command axiom-scan "webs/webs_all.txt" -m katana -jc -kf all -d 2 --max-runtime 3h -o ".tmp/katana.txt" $AXIOM_EXTRA_ARGS 2>>"$LOGFILE" >/dev/null+ if [[ $AXIOM != true ]]; then+ # Use katana for scanning+ if [[ ! -s ".tmp/katana.txt" ]]; then+ if [[ $DEEP == true ]]; then+ timeout 4h katana -silent -list "webs/webs_all.txt" -jc -kf all -c "$KATANA_THREADS" -d 3 -o ".tmp/katana.txt" 2>>"$LOGFILE" >/dev/null+ else+ timeout 3h katana -silent -list "webs/webs_all.txt" -jc -kf all -c "$KATANA_THREADS" -d 2 -o ".tmp/katana.txt" 2>>"$LOGFILE" >/dev/null+ fifi# Remove lines longer than 2048 charactersif [[ -s ".tmp/katana.txt" ]]; thensed_i '/^.\{2048\}./d' ".tmp/katana.txt"fi+ else+ # Use axiom-scan for scanning+ if [[ ! -s ".tmp/katana.txt" ]]; then+ if [[ $DEEP == true ]]; then+ run_command axiom-scan "webs/webs_all.txt" -m katana -jc -kf all -d 3 --max-runtime 4h -o ".tmp/katana.txt" $AXIOM_EXTRA_ARGS 2>>"$LOGFILE" >/dev/null+ else+ run_command axiom-scan "webs/webs_all.txt" -m katana -jc -kf all -d 2 --max-runtime 3h -o ".tmp/katana.txt" $AXIOM_EXTRA_ARGS 2>>"$LOGFILE" >/dev/null+ fi+ # Remove lines longer than 2048 characters+ if [[ -s ".tmp/katana.txt" ]]; then+ sed_i '/^.\{2048\}./d' ".tmp/katana.txt"+ fi+ fifi- fi- # Process katana.txt to find broken links- if [[ -s ".tmp/katana.txt" ]]; then- run_command httpx -follow-redirects -random-agent -status-code -threads "$HTTPX_THREADS" -rl "$HTTPX_RATELIMIT" -timeout "$HTTPX_TIMEOUT" -silent -retries 2 -no-color <".tmp/katana.txt" 2>>"$LOGFILE" \- | grep "\[4" | cut -d ' ' -f1 | anew -q ".tmp/brokenLinks_total.txt"+ # Process katana.txt to find broken links+ if [[ -s ".tmp/katana.txt" ]]; then+ run_command httpx -follow-redirects -random-agent -status-code -threads "$HTTPX_THREADS" -rl "$HTTPX_RATELIMIT" -timeout "$HTTPX_TIMEOUT" -silent -retries 2 -no-color <".tmp/katana.txt" 2>>"$LOGFILE" \+ | grep "\[4" | cut -d ' ' -f1 | anew -q ".tmp/brokenLinks_total.txt"+ fifi# Update brokenLinks.txt with unique entriesif [[ -s ".tmp/brokenLinks_total.txt" ]]; then- NUMOFLINES=$(wc -l <".tmp/brokenLinks_total.txt" 2>>"$LOGFILE" | awk '{print $1}')- cat .tmp/brokenLinks_total.txt | anew -q "vulns/brokenLinks.txt"+ cat ".tmp/brokenLinks_total.txt" | anew -q "vulns/brokenLinks.txt"NUMOFLINES=$(sed '/^$/d' "vulns/brokenLinks.txt" | wc -l)- notification "${NUMOFLINES} new broken links found" info+ notification "${NUMOFLINES} broken links found" infofiend_func "Results are saved in vulns/brokenLinks.txt" "${FUNCNAME[0]}"diff --git a/reconftw.cfg b/reconftw.cfgindex f636a1d..3503648 100644--- a/reconftw.cfg+++ b/reconftw.cfg@@ -105,6 +105,10 @@ EMAILS=true # Fetch emails from differents sitesDOMAIN_INFO=true # whois infoIP_INFO=true # Reverse IP search, geolocation and whoisAPI_LEAKS=true # Check for API leaks+API_LEAKS_POSTLEAKS=true # Enhance API leaks with postleaksNg+POSTLEAKS_THREADS=10 # Threads for postleaksNg+POSTLEAKS_INCLUDE="" # Optional include filter for postleaksNg URL results+POSTLEAKS_EXCLUDE="" # Optional exclude filter for postleaksNg URL resultsTHIRD_PARTIES=true # Check for 3rd parties misconfigsSPOOF=true # Check spoofable domainsMETAFINDER_LIMIT=20 # Max 250@@ -148,6 +152,11 @@ UNCOMMON_PORTS_WEB=$(cat "${SCRIPTPATH}/config/uncommon_ports_web.txt" 2>/dev/nu# HostFAVICON=true # Check Favicon domain discovery+FAVIRECON=true # Favicon-based technology recon over discovered web targets+FAVIRECON_CONCURRENCY=50 # favirecon concurrency+FAVIRECON_TIMEOUT=10 # favirecon timeout seconds+FAVIRECON_RATE_LIMIT=0 # favirecon rate limit per second (0 = unlimited)+FAVIRECON_PROXY="" # Optional proxy URL for favireconPORTSCANNER=true # Enable or disable the whole Port scanner moduleGEO_INFO=true # Fetch Geolocalization infoPORTSCAN_PASSIVE=true # Port scanner with Shodan@@ -198,15 +207,26 @@ SSRF_CHECKS=true # SSRF checksCRLF_CHECKS=true # CRLF checksLFI=true # LFI by fuzzingSSTI=true # SSTI by fuzzing+SSTI_ENGINE="tinja" # SSTI engine: tinja|legacy+TINJA_RATELIMIT=0 # TInjA requests per second (0 = unlimited)+TINJA_TIMEOUT=15 # TInjA request timeout secondsSQLI=true # Check SQLISQLMAP=true # Check SQLI with sqlmapGHAURI=false # Check SQLI with ghauriBROKENLINKS=true # Check for brokenlinks+BROKENLINKS_ENGINE="second-order" # Broken links engine: second-order|legacy+SECOND_ORDER_CONFIG="${tools}/second-order/config/takeover.json" # second-order config file path+SECOND_ORDER_DEPTH=1 # second-order crawl depth+SECOND_ORDER_THREADS=10 # second-order thread count+SECOND_ORDER_INSECURE=false # second-order accept invalid TLSSPRAY=true # Performs password sprayingCOMM_INJ=true # Check for command injections with commixPROTO_POLLUTION=true # Check for prototype pollution flawsSMUGGLING=true # Check for HTTP request smuggling flawsWEBCACHE=true # Check for Web Cache issues+WEBCACHE_TOXICACHE=true # Complement webcache module with toxicache engine+TOXICACHE_THREADS=70 # toxicache worker threads+TOXICACHE_USER_AGENT="Mozilla/5.0 (X11; Linux x86_64; rv:128.0) Gecko/20100101 Firefox/128.0" # toxicache user-agentBYPASSER4XX=true # Check for 4XX bypassesFUZZPARAMS=true # Fuzz parameters values@@ -217,8 +237,8 @@ CONTINUE_ON_TOOL_ERROR=true # Continue recon when a tool/module fails in parallePARALLEL_LOG_MODE="summary" # Parallel output mode: summary (compact) | tail (last N lines) | full (cat all)PARALLEL_TAIL_LINES=20 # Number of tail lines shown per job in 'tail' mode (doubled on failure)PARALLEL_UI_MODE="clean" # Parallel terminal UX: clean | balanced | trace-PARALLEL_PROGRESS_SHOW_ETA=true # Show ETA estimate in parallel snapshots-PARALLEL_PROGRESS_SHOW_ACTIVE=true # Show active tasks list in parallel snapshots+PARALLEL_PROGRESS_SHOW_ETA=true # Show ETA in live progress once estimate is stable+PARALLEL_PROGRESS_SHOW_ACTIVE=true # Show active tasks list in live parallel progressPARALLEL_PROGRESS_COMPACT_ACTIVE_MAX=4 # Max active/done items shown before compacting with "+N more"PARALLEL_TRACE_SLOW_SECONDS=30 # In balanced mode, show finished-line for jobs slower than this thresholddiff --git a/tests/unit/test_new_tool_integrations.bats b/tests/unit/test_new_tool_integrations.batsnew file mode 100644index 0000000..14ee17f--- /dev/null+++ b/tests/unit/test_new_tool_integrations.bats@@ -0,0 +1,190 @@+#!/usr/bin/env bats++setup() {+ local project_root+ project_root="$(cd "$(dirname "$BATS_TEST_FILENAME")/../.." && pwd)"+ export SCRIPTPATH="$project_root"+ export LOGFILE="/dev/null"+ export bred='' bblue='' bgreen='' byellow='' yellow='' reset=''++ export TEST_DIR="$BATS_TEST_TMPDIR/reconftw_new_tools"+ mkdir -p "$TEST_DIR"+ export dir="$TEST_DIR/target.example.com"+ export called_fn_dir="$dir/.called_fn"+ mkdir -p "$called_fn_dir" "$dir"+ cd "$dir"++ export MOCK_BIN="$TEST_DIR/mockbin"+ mkdir -p "$MOCK_BIN"+ export PATH="$MOCK_BIN:$PATH"++ source "$project_root/reconftw.sh" --source-only++ export domain="target.example.com"+ export DIFF=false+ export AXIOM=false+}++teardown() {+ [[ -d "$TEST_DIR" ]] && rm -rf "$TEST_DIR"+}++@test "ssti uses tinja engine and writes compatible output" {+ mkdir -p gf .tmp vulns+ printf 'https://target.example.com/?q=test\n' > gf/ssti.txt++ cat > "$MOCK_BIN/tinja" <<'SH'+#!/usr/bin/env bash+report_dir=""+while [[ $# -gt 0 ]]; do+ case "$1" in+ --reportpath)+ report_dir="$2"+ shift 2+ ;;+ *)+ shift+ ;;+ esac+done+mkdir -p "$report_dir"+printf '%s\n' '{"url":"https://target.example.com/?q=FUZZ","isWebpageVulnerable":true,"certainty":"high","parameters":[]}' > "${report_dir}/mock_Report.jsonl"+SH+ chmod +x "$MOCK_BIN/tinja"++ export SSTI=true+ export SSTI_ENGINE="tinja"+ export TINJA_RATELIMIT=0+ export TINJA_TIMEOUT=15+ export DEEP=false+ export DEEP_LIMIT=500++ run ssti+ [ "$status" -eq 0 ]+ [ -s "vulns/ssti.txt" ]+ grep -q "target.example.com" "vulns/ssti.txt"+}++@test "brokenLinks supports second-order engine" {+ mkdir -p webs .tmp vulns+ printf 'https://target.example.com\n' > webs/webs_all.txt+ printf '{"LogNon200Queries":{"script":"src"}}\n' > "$TEST_DIR/takeover.json"++ cat > "$MOCK_BIN/second-order" <<'SH'+#!/usr/bin/env bash+out_dir=""+while [[ $# -gt 0 ]]; do+ case "$1" in+ -output)+ out_dir="$2"+ shift 2+ ;;+ *)+ shift+ ;;+ esac+done+mkdir -p "$out_dir"+printf '%s\n' '{"https://target.example.com":{"script[src]":["https://cdn.dead.example.org/app.js"]}}' > "${out_dir}/non-200-url-attributes.json"+SH+ chmod +x "$MOCK_BIN/second-order"++ export BROKENLINKS=true+ export BROKENLINKS_ENGINE="second-order"+ export SECOND_ORDER_CONFIG="$TEST_DIR/takeover.json"+ export SECOND_ORDER_DEPTH=1+ export SECOND_ORDER_THREADS=4+ export SECOND_ORDER_INSECURE=false++ run brokenLinks+ [ "$status" -eq 0 ]+ [ -s "vulns/brokenLinks.txt" ]+ grep -q "cdn.dead.example.org" "vulns/brokenLinks.txt"+}++@test "favirecon_tech stores normalized technology findings" {+ mkdir -p webs .tmp+ printf 'https://target.example.com\n' > webs/webs_all.txt++ cat > "$MOCK_BIN/favirecon" <<'SH'+#!/usr/bin/env bash+outfile=""+while [[ $# -gt 0 ]]; do+ case "$1" in+ -o)+ outfile="$2"+ shift 2+ ;;+ *)+ shift+ ;;+ esac+done+printf '%s\n' '{"URL":"https://target.example.com","Name":"GitLab","Hash":"12345"}' > "$outfile"+SH+ chmod +x "$MOCK_BIN/favirecon"++ export FAVIRECON=true+ export FAVIRECON_CONCURRENCY=10+ export FAVIRECON_TIMEOUT=10+ export FAVIRECON_RATE_LIMIT=0++ run favirecon_tech+ [ "$status" -eq 0 ]+ [ -s "webs/favirecon.txt" ]+ grep -q "GitLab" "webs/favirecon.txt"+}++@test "apileaks integrates postleaksNg output" {+ mkdir -p osint+ export tools="$TEST_DIR/tools"+ mkdir -p "$tools/SwaggerSpy/venv/bin" "$tools/SwaggerSpy" "$tools/postleaksNg/.venv/bin"++ cat > "$MOCK_BIN/porch-pirate" <<'SH'+#!/usr/bin/env bash+printf '%s\n' 'https://postman.initial.example.com/api'+SH+ chmod +x "$MOCK_BIN/porch-pirate"++ cat > "$tools/SwaggerSpy/venv/bin/python3" <<'SH'+#!/usr/bin/env bash+printf '%s\n' 'URL https://swagger.example.com/openapi.json'+SH+ chmod +x "$tools/SwaggerSpy/venv/bin/python3"+ printf '%s\n' 'print("mock")' > "$tools/SwaggerSpy/swaggerspy.py"++ cat > "$tools/postleaksNg/.venv/bin/postleaksNg" <<'SH'+#!/usr/bin/env bash+out=""+while [[ $# -gt 0 ]]; do+ case "$1" in+ --output)+ out="$2"+ shift 2+ ;;+ *)+ shift+ ;;+ esac+done+mkdir -p "$out"+printf '%s\n' '{"url":"https://postman.new.example.com/path"}' > "$out/postleaks.json"+SH+ chmod +x "$tools/postleaksNg/.venv/bin/postleaksNg"++ cat > "$MOCK_BIN/trufflehog" <<'SH'+#!/usr/bin/env bash+printf '%s\n' '{"DetectorName":"mock"}'+SH+ chmod +x "$MOCK_BIN/trufflehog"++ export API_LEAKS=true+ export OSINT=true+ export API_LEAKS_POSTLEAKS=true+ export POSTLEAKS_THREADS=2++ run apileaks+ [ "$status" -eq 0 ]+ [ -s "osint/postman_leaks.txt" ]+ grep -q "postman.new.example.com" "osint/postman_leaks.txt"+}