Skip to content

reconFTW is a tool designed to perform automated recon on a target domain by running the best set of tools to perform scanning and finding out vulnerabilities

New tools

six2dez31051edafb1e
diff --git a/CHANGELOG.md b/CHANGELOG.md
index ceeefd1..efdb4cf 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -86,6 +86,12 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
- Deep wildcard detection (`DEEP_WILDCARD_FILTER`) based on iterative wildcard checks.
- Time-based certificate filtering (`DNS_TIME_FENCE_DAYS`).
- Sensitive domain exclusion (`EXCLUDE_SENSITIVE`, `config/sensitive_domains.txt`).
+- New integrated engines/tools:
+ - `toxicache` for additional web cache poisoning coverage.
+ - `postleaksNg` in `apileaks` for Postman leak discovery.
+ - `favirecon` as `favirecon_tech` for favicon-based technology reconnaissance.
+ - `TInjA` as the default `ssti` engine (`SSTI_ENGINE=tinja`, with legacy fallback).
+ - `second-order` as default `brokenLinks` engine (`BROKENLINKS_ENGINE=second-order`, with legacy fallback).
**Progress and UX**
- Progress/ETA functions (`progress_init()`, `progress_step()`) integrated in recon flows.
@@ -130,10 +136,10 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
**Dry-Run Mode**
- Wrapped 83 unwrapped command executions across all modules to respect `DRY_RUN` flag:
- - `osint.sh`: 24 commands (whois, dig, curl APIs, gitdorks_go, enumerepo, porch-pirate, misconfig-mapper, exiftool, interlace git clone, Python tools: dorks_hunter, metagoofil, SwaggerSpy, EmailHarvester, LeakSearch, msftrecon, Scopify, Spoofy)
+ - `osint.sh`: 24 commands (whois, dig, curl APIs, gitdorks_go, enumerepo, porch-pirate, postleaksNg, misconfig-mapper, exiftool, interlace git clone, Python tools: dorks_hunter, metagoofil, SwaggerSpy, EmailHarvester, LeakSearch, msftrecon, Scopify, Spoofy)
- `subdomains.sh`: 15 commands (asnmap, dig zone transfer, curl APIs, hakip2host, csprecon, regulator, cloud enumeration)
- - `web.sh`: 20 commands (fav-up, grpcurl, CMSeeK, JSA, getjswords, jsluice, wget, interlace/ffuf, curl WebSocket, pydictor)
- - `vulns.sh`: 5 commands (Corsy, Oralyzer, interlace/ffuf LFI, interlace/ffuf SSTI, interlace/ghauri SQLi)
+ - `web.sh`: 20 commands (fav-up, favirecon, grpcurl, CMSeeK, JSA, getjswords, jsluice, wget, interlace/ffuf, curl WebSocket, pydictor, second-order)
+ - `vulns.sh`: 6 commands (Corsy, Oralyzer, interlace/ffuf LFI, TInjA/legacy SSTI, interlace/ghauri SQLi, toxicache)
- `core.sh`: 8 commands (tar/curl uploads, Telegram/Discord/Slack notifications, connectivity checks)
- `modes.sh`: 8 commands (faraday-cli reporting)
- `axiom.sh`: 3 commands (hakip2host, mapcidr)
@@ -149,7 +155,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
- Command normalization removes newlines/extra whitespace from multi-line command strings for cleaner display
- Dry-run command previews now redact sensitive CLI values (for example `-token-string`, API keys, and bearer tokens).
- Dry-run in parallel mode now aggregates commands emitted from child subshells, so module summaries reflect full command volume.
-- Dry-run no longer produces noisy parser/file errors in guarded paths (`apileaks`, `sub_crt`, `prototype_pollution`, `fuzzparams`, `sub_tls`, `sub_permut`, `urlchecks`).
+- Dry-run no longer produces noisy parser/file errors in guarded paths (`apileaks`, `sub_crt`, `prototype_pollution`, `fuzzparams`, `sub_tls`, `sub_permut`, `urlchecks`, `favirecon_tech`, `webcache`, `brokenLinks`, `ssti`).
- `test_ssl` now respects `run_command`, preventing real execution during dry-run.
- `sub_asn` now applies timeout fencing with kill semantics (`-k`) when timeout tooling is available and reports non-OK outcomes correctly.
- `subdomains` finalization now safely creates missing incremental files before counting to avoid stderr noise.
diff --git a/Docker/amass_config.ini b/Docker/amass_config.ini
deleted file mode 100644
index 56063d9..0000000
--- a/Docker/amass_config.ini
+++ /dev/null
@@ -1,367 +0,0 @@
-# Copyright © by Jeff Foley 2017-2022. All rights reserved.
-# Use of this source code is governed by Apache 2 LICENSE that can be found in the LICENSE file.
-# SPDX-License-Identifier: Apache-2.0
-
-# Should results only be collected passively and without DNS resolution? Not recommended.
-#mode = passive
-# Would you like to use active techniques that communicate directly with the discovered assets,
-# such as pulling TLS certificates from discovered IP addresses and attempting DNS zone transfers?
-#mode = active
-
-# The directory that stores the Cayley graph database and other output files
-# The default for Linux systems is: $HOME/.config/amass
-#output_directory = amass
-
-# Another location (directory) where the user can provide ADS scripts to the engine.
-#scripts_directory =
-
-# The maximum number of DNS queries that can be performed concurrently during the enumeration.
-#maximum_dns_queries = 20000
-
-# DNS resolvers used globally by the amass package.
-#[resolvers]
-#resolver = 1.1.1.1 ; Cloudflare
-#resolver = 8.8.8.8 ; Google
-#resolver = 64.6.64.6 ; Verisign
-#resolver = 74.82.42.42 ; Hurricane Electric
-#resolver = 1.0.0.1 ; Cloudflare Secondary
-#resolver = 8.8.4.4 ; Google Secondary
-#resolver = 64.6.65.6 ; Verisign Secondary
-#resolver = 77.88.8.8 ; Yandex.DNS Secondary
-
-[scope]
-# The network infrastructure settings expand scope, not restrict the scope.
-# Single IP address or range (e.g. a.b.c.10-245)
-#address = 192.168.1.1
-#cidr = 192.168.1.0/24
-#asn = 26808
-port = 80
-port = 443
-#port = 8080
-#port = 8443
-
-# Root domain names used in the enumeration. The findings are limited by the root domain names provided.
-#[scope.domains]
-#domain = owasp.org
-#domain = appsecusa.org
-#domain = appsec.eu
-#domain = appsec-labs.com
-
-# Are there any subdomains that are out of scope?
-#[scope.blacklisted]
-#subdomain = education.appsec-labs.com
-#subdomain = 2012.appsecusa.org
-
-# The graph database discovered DNS names, associated network infrastructure, results from data sources, etc.
-# This information is then used in future enumerations and analysis of the discoveries.
-#[graphdbs]
-# postgres://[username:password@]host[:port]/database-name?sslmode=disable of the PostgreSQL
-# database and credentials. Sslmode is optional, and can be disable, require, verify-ca, or verify-full.
-#[graphdbs.postgres]
-#primary = false ; Specify which graph database is the primary db, or the local database will be selected.
-#url = "postgres://[username:password@]host[:port]/database-name?sslmode=disable"
-#options="connect_timeout=10"
-
-# MqSQL database and credentials URL format:
-# [username:password@]tcp(host[:3306])/database-name?timeout=10s
-#[graphdbs.mysql]
-#url = [username:password@]tcp(host[:3306])/database-name?timeout=10s
-
-# Settings related to DNS name brute forcing.
-#[bruteforce]
-#enabled = true
-#recursive = true
-# Number of discoveries made in a subdomain before performing recursive brute forcing: Default is 1.
-#minimum_for_recursive = 1
-#wordlist_file = /usr/share/wordlists/all.txt
-#wordlist_file = /usr/share/wordlists/all.txt # multiple lists can be used
-
-# Would you like to permute resolved names?
-#[alterations]
-#enabled = true
-# edit_distance specifies the number of times a primitive edit operation will be
-# performed on a name sample during fuzzy label searching.
-#edit_distance = 1 ; Setting this to zero will disable this expensive feature.
-#flip_words = true # test-dev.owasp.org -> test-prod.owasp.org
-#flip_numbers = true # test1.owasp.org -> test2.owasp.org
-#add_words = true # test.owasp.org -> test-dev.owasp.org
-#add_numbers = true # test.owasp.org -> test1.owasp.org
-# Multiple lists can be used.
-#wordlist_file = /usr/share/wordlists/all.txt
-#wordlist_file = /usr/share/wordlists/all.txt
-
-[data_sources]
-# When set, this time-to-live is the minimum value applied to all data source caching.
-minimum_ttl = 1440 ; One day
-
-# Are there any data sources that should be disabled?
-#[data_sources.disabled]
-#data_source = Ask
-#data_source = Bing
-
-# Provide data source configuration information.
-# See the following format:
-#[data_sources.SOURCENAME] ; The SOURCENAME must match the name in the data source implementation.
-#ttl = 4320 ; Time-to-live value sets the number of minutes that the responses are cached.
-# Unique identifier for this set of SOURCENAME credentials.
-# Multiple sets of credentials can be provided and will be randomly selected.
-#[data_sources.SOURCENAME.CredentialSetID]
-#apikey = ; Each data source uses potentially different keys for authentication.
-#secret = ; See the examples below for each data source.
-#username =
-#password =
-
-# https://passivedns.cn (Contact)
-#[data_sources.360PassiveDNS]
-#[data_sources.360PassiveDNS.Credentials]
-#apikey =
-
-# https://ahrefs.com (Paid)
-#[data_sources.Ahrefs]
-#ttl = 4320
-#[data_sources.Ahrefs.Credentials]
-#apikey =
-
-# https://otx.alienvault.com (Free)
-#[data_sources.AlienVault]
-#[data_sources.AlienVault.Credentials]
-#apikey =
-
-# https://app.binaryedge.com (Paid/Free-trial)
-#[data_sources.BinaryEdge]
-#ttl = 10080
-#[data_sources.BinaryEdge.Credentials]
-#apikey =
-
-# https://tls.bufferover.run/dns?q=.example.com (Paid/Free)
-#[data_sources.BufferOver]
-#[data_sources.BufferOver.Credentials]
-#apikey =
-
-# https://builtwith.com (Paid/Free-trial)
-#[data_sources.BuiltWith]
-#ttl = 10080
-#[data_sources.BuiltWith.Credentials]
-#apikey =
-
-# https://c99.nl (Paid)
-#[data_sources.C99]
-#ttl = 4320
-#[data_sources.C99.account1]
-#apikey =
-#[data_sources.C99.account2]
-#apikey =
-
-# https://censys.io (Paid/Free-trial)
-#[data_sources.Censys]
-#ttl = 10080
-#[data_sources.Censys.Credentials]
-#apikey =
-#secret =
-
-# https://chaos.projectdiscovery.io (Invite-Only)
-#[data_sources.Chaos]
-#ttl = 4320
-#[data_sources.Chaos.Credentials]
-#apikey =
-
-# https://cloudflare.com (Free)
-# Cloudflare apikey is the API token with dns_records and zone read permission
-#[data_sources.Cloudflare]
-#[data_sources.Cloudflare.Credentials]
-#apikey =
-
-# https://circl.lu (Contact)
-#[data_sources.CIRCL]
-#[data_sources.CIRCL.Credentials]
-#username =
-#password =
-
-# https://dnsdb.info (Paid)
-#[data_sources.DNSDB]
-#ttl = 4320
-#[data_sources.DNSDB.Credentials]
-#apikey =
-
-# https://dnslytics.com (Paid)
-#[data_sources.DNSlytics]
-#[data_sources.DNSlytics.Credentials]
-#apikey =
-
-# https://dnsrepo.noc.org (Paid)
-#[data_sources.DNSRepo]
-#[data_sources.DNSRepo.Credentials]
-#apikey =
-
-# https://detectify.com (Paid)
-#[data_sources.Detectify]
-#[data_sources.Detectify.Credentials]
-#apikey =
-
-# https://developer.facebook.com (Free)
-# Look here for how to obtain the Facebook credentials:
-# https://goldplugins.com/documentation/wp-social-pro-documentation/how-to-get-an-app-id-and-secret-key-from-facebook/
-#[data_sources.FacebookCT]
-#ttl = 4320
-#[data_sources.FacebookCT.app1]
-#apikey =
-#secret =
-#[data_sources.FacebookCT.app2]
-#apikey =
-#secret =
-
-# https://fofa.so (Paid)
-#[data_sources.FOFA]
-#ttl = 10080
-#[data_sources.FOFA.Credentials]
-#username =
-#apikey =
-
-# https://github.com (Free)
-#[data_sources.GitHub]
-#ttl = 4320
-#[data_sources.GitHub.accountname]
-#apikey =
-
-# https://gitlab.com (Freemium)
-#[data_sources.GitLab]
-#[data_sources.GitLab.free]
-#apikey =
-#[data_sources.GitLab.premium]
-#apikey =
-
-# https://hackertarget.com (Paid/Free)
-# HackerTarget can be used without an API key, but the key allows better results
-#[data_sources.HackerTarget]
-#ttl = 1440
-#[data_sources.HackerTarget.Credentials]
-#apikey =
-
-# https://hunter.io (Paid/Free-trial)
-#[data_sources.Hunter]
-#[data_sources.Hunter.Credentials]
-#apikey =
-
-#[data_sources.IntelX]
-#[data_sources.IntelX.Credentials]
-#apikey =
-
-# https://ipdata.co (Free)
-#[data_sources.IPdata]
-#[data_sources.IPdata.Credentials]
-#apikey =
-
-# https://ipinfo.io (Paid/Free-trial)
-#[data_sources.IPinfo]
-#[data_sources.IPinfo.Credentials]
-#apikey =
-
-# https://leakix.net/ (Free)
-#[data_sources.LeakIX]
-#[data_sources.LeakIX.Credentials]
-#apikey =
-
-# https://networksdb.io (Paid/Free-trial)
-#[data_sources.NetworksDB]
-#[data_sources.NetworksDB.Credentials]
-#apikey =
-
-# https://onyphe.io (Free)
-#[data_sources.ONYPHE]
-#ttl = 10080
-#[data_sources.ONYPHE.Credentials]
-#apikey =
-
-# https://passivetotal.com (Paid/Free-trial)
-#[data_sources.PassiveTotal]
-#ttl = 10080
-#[data_sources.PassiveTotal.Credentials]
-#username =
-#apikey =
-
-# https://pentest-tools.com (Paid)
-#[data_sources.PentestTools]
-#ttl = 10080
-#[data_sources.PentestTools.Credentials]
-#apikey =
-
-# https://quake.360.cn (Paid)
-#[data_sources.Quake]
-#ttl = 4320
-#[data_sources.Quake.Credentials]
-#apikey =
-
-# https://securitytrails.com (Paid/Free-trial)
-#[data_sources.SecurityTrails]
-#ttl = 1440
-#[data_sources.SecurityTrails.Credentials]
-#apikey =
-
-# https://shodan.io (Paid/Free-trial)
-#[data_sources.Shodan]
-#ttl = 10080
-#[data_sources.Shodan.Credentials]
-#apikey =
-
-# https://spamhaus.com (Free)
-#[data_sources.Spamhaus]
-#ttl = 1440
-#[data_sources.Spamhaus.Credentials]
-#username =
-#password =
-
-# https://spyse.com (Paid/Free-trial)
-#[data_sources.Spyse]
-#ttl = 4320
-#[data_sources.Spyse.Credentials]
-#apikey =
-
-# https://threatbook.cn (Paid)
-#[data_sources.ThreatBook]
-#[data_sources.ThreatBook.account1]
-#apikey=
-
-# https://developer.twitter.com (Free)
-# Provide your Twitter App Consumer API key and Consumer API secret key
-#[data_sources.Twitter]
-#[data_sources.Twitter.account1]
-#apikey =
-#secret =
-#[data_sources.Twitter.account2]
-#apikey =
-#secret =
-
-# https://umbrella.cisco.com (Paid-Enterprise)
-# The apikey must be an API access token created through the Investigate management UI
-#[data_sources.Umbrella]
-#[data_sources.Umbrella.Credentials]
-#apikey =
-
-# https://urlscan.io (Paid/Free-trial)
-# URLScan can be used without an API key, but the key allows new submissions to be made
-#[data_sources.URLScan]
-#[data_sources.URLScan.Credentials]
-#apikey =
-
-# https://virustotal.com (Paid/Free-trial)
-#[data_sources.VirusTotal]
-#ttl = 10080
-#[data_sources.VirusTotal.Credentials]
-#apikey =
-
-# https://whoisxmlapi.com (Paid/Free-trial)
-#[data_sources.WhoisXMLAPI]
-#[data_sources.WhoisXMLAPI.Credentials]
-#apikey =
-
-# https://zetalytics.com (Paid/Invite-Only)
-#[data_sources.ZETAlytics]
-#ttl = 1440
-#[data_sources.ZETAlytics.Credentials]
-#apikey =
-
-#[data_sources.ZoomEye]
-#ttl = 1440
-#[data_sources.ZoomEye.Credentials]
-#username =
-#password =
diff --git a/README.md b/README.md
index ef09c7a..3281cea 100644
--- a/README.md
+++ b/README.md
@@ -8,28 +8,35 @@
</h1>
<p align="center">
- <a href="https://github.com/six2dez/reconftw/releases/tag/v4.0">
- <img src="https://img.shields.io/badge/release-v4.0-green">
- </a>
- </a>
- <a href="https://opensource.org/licenses/MIT">
- <img src="https://img.shields.io/badge/License-MIT-yellow.svg">
- </a>
- <a href="https://twitter.com/Six2dez1">
- <img src="https://img.shields.io/badge/twitter-%40Six2dez1-blue">
- </a>
- <a href="https://github.com/six2dez/reconftw/issues?q=is%3Aissue+is%3Aclosed">
- <img src="https://img.shields.io/github/issues-closed-raw/six2dez/reconftw.svg">
- </a>
- <a href="https://github.com/six2dez/reconftw/wiki">
- <img src="https://img.shields.io/badge/doc-wiki-blue.svg">
- </a>
- <a href="https://t.me/joinchat/H5bAaw3YbzzmI5co">
- <img src="https://img.shields.io/badge/[email protected]">
- </a>
- <a href="https://discord.gg/R5DdXVEdTy">
- <img src="https://img.shields.io/discord/1048623782912340038.svg?logo=discord">
- </a>
+ <a href="https://github.com/six2dez/reconftw/releases/tag/v4.0"><img src="https://img.shields.io/badge/release-v4.0-2ea043?style=for-the-badge" alt="Release"></a>
+ <a href="https://opensource.org/licenses/MIT"><img src="https://img.shields.io/badge/License-MIT-yellow.svg?style=for-the-badge" alt="License"></a>
+ <a href="https://github.com/six2dez/reconftw/issues?q=is%3Aissue+is%3Aclosed"><img src="https://img.shields.io/github/issues-closed-raw/six2dez/reconftw.svg?style=for-the-badge" alt="Closed Issues"></a>
+ <a href="https://discord.gg/R5DdXVEdTy"><img src="https://img.shields.io/discord/1048623782912340038.svg?style=for-the-badge&logo=discord&label=discord" alt="Discord"></a>
+ <a href="https://t.me/joinchat/H5bAaw3YbzzmI5co"><img src="https://img.shields.io/badge/telegram-@ReconFTW-26A5E4?style=for-the-badge&logo=telegram&logoColor=white" alt="Telegram"></a>
+ <a href="https://twitter.com/Six2dez1"><img src="https://img.shields.io/badge/twitter-@Six2dez1-1D9BF0?style=for-the-badge&logo=x&logoColor=white" alt="Twitter"></a>
+</p>
+
+<p align="center">
+ <a href="https://docs.reconftw.com"><img src="https://img.shields.io/badge/GitBook-%23000000.svg?style=for-the-badge&logo=gitbook&logoColor=white" alt="Docs"></a>
+ <a href="https://github.com/six2dez/reconftw"><img src="https://img.shields.io/badge/Bash%20Script-%23121011.svg?style=for-the-badge&logo=gnu-bash&logoColor=white" alt="Bash Script"></a>
+ <a href="https://github.com/six2dez/reconftw"><img src="https://img.shields.io/badge/Linux-FCC624?style=for-the-badge&logo=linux&logoColor=black" alt="Linux"></a>
+ <a href="https://github.com/six2dez/reconftw"><img src="https://img.shields.io/badge/macOS-000000?style=for-the-badge&logo=macos&logoColor=F0F0F0" alt="macOS"></a>
+ <a href="https://github.com/six2dez/reconftw"><img src="https://img.shields.io/badge/github-%23121011.svg?style=for-the-badge&logo=github&logoColor=white" alt="GitHub"></a>
+</p>
+
+<p align="center">
+ <a href="https://github.com/six2dez/reconftw/actions"><img src="https://img.shields.io/badge/github_actions-%232671E5.svg?style=for-the-badge&logo=githubactions&logoColor=white" alt="GitHub Actions"></a>
+ <a href="https://hub.docker.com/r/six2dez/reconftw"><img src="https://img.shields.io/badge/docker-%230db7ed.svg?style=for-the-badge&logo=docker&logoColor=white" alt="Docker"></a>
+ <a href="https://github.com/six2dez/reconftw/tree/main/Terraform"><img src="https://img.shields.io/badge/terraform-%23844FBA.svg?style=for-the-badge&logo=terraform&logoColor=white" alt="Terraform"></a>
+ <a href="https://github.com/six2dez/reconftw/tree/main/Terraform"><img src="https://img.shields.io/badge/ansible-%231A1918.svg?style=for-the-badge&logo=ansible&logoColor=white" alt="Ansible"></a>
+ <a href="https://github.com/six2dez/reconftw"><img src="https://img.shields.io/badge/Go-00ADD8.svg?style=for-the-badge&logo=go&logoColor=white" alt="Go"></a>
+ <a href="https://github.com/six2dez/reconftw"><img src="https://img.shields.io/badge/Python-3776AB.svg?style=for-the-badge&logo=python&logoColor=white" alt="Python"></a>
+</p>
+
+<p align="center">
+ <a href="https://www.buymeacoffee.com/six2dez"><img src="https://img.shields.io/badge/Buy%20Me%20a%20Coffee-ffdd00?style=for-the-badge&logo=buy-me-a-coffee&logoColor=black" alt="Buy Me a Coffee"></a>
+ <a href="https://github.com/sponsors/six2dez"><img src="https://img.shields.io/badge/sponsor-30363D?style=for-the-badge&logo=GitHub-Sponsors&logoColor=EA4AAA" alt="GitHub Sponsors"></a>
+ <a href="https://www.paypal.com/paypalme/six2dez"><img src="https://img.shields.io/badge/PayPal-00457C?style=for-the-badge&logo=paypal&logoColor=white" alt="PayPal"></a>
</p>
**reconFTW** is a powerful automated reconnaissance tool designed for security researchers and penetration testers. It streamlines the process of gathering intelligence on a target by performing subdomain enumeration, vulnerability scanning, OSINT and more. With a modular design, extensive configuration options, and support for distributed scanning via AX Framework, reconFTW is built to deliver comprehensive results efficiently.
@@ -102,7 +109,7 @@ reconFTW is packed with features to make reconnaissance thorough and efficient.
- **Email and Password Leaks**: Searches for leaked emails and credentials ([emailfinder](https://github.com/Josue87/EmailFinder) and [LeakSearch](https://github.com/JoelGMSec/LeakSearch)).
- **Microsoft 365/Azure Mapping**: Identifies Microsoft 365 and Azure tenants ([msftrecon](https://github.com/Arcanum-Sec/msftrecon)).
- **Metadata Extraction**: Extracts metadata from indexed office documents ([metagoofil](https://github.com/opsdisk/metagoofil)).
-- **API Leaks**: Detects exposed APIs in public sources ([porch-pirate](https://github.com/MandConsultingGroup/porch-pirate) and [SwaggerSpy](https://github.com/UndeadSec/SwaggerSpy)).
+- **API Leaks**: Detects exposed APIs in public sources ([porch-pirate](https://github.com/MandConsultingGroup/porch-pirate), [SwaggerSpy](https://github.com/UndeadSec/SwaggerSpy) and [postleaksNg](https://github.com/six2dez/postleaksNG)).
- **Google Dorking**: Automated Google dork queries for sensitive information ([dorks_hunter](https://github.com/six2dez/dorks_hunter) and [xnldorker](https://github.com/xnl-h4ck3r/xnldorker)).
- **GitHub Analysis**: Scans GitHub organizations for repositories and secrets ([enumerepo](https://github.com/trickest/enumerepo), [trufflehog](https://github.com/trufflesecurity/trufflehog) and [gitleaks](https://github.com/gitleaks/gitleaks)).
- **Third-Party Misconfigurations**: Identifies misconfigured third-party services ([misconfig-mapper](https://github.com/intigriti/misconfig-mapper)).
@@ -146,7 +153,7 @@ reconFTW is packed with features to make reconnaissance thorough and efficient.
- **CMS Detection**: Identifies content management systems ([CMSeeK](https://github.com/Tuhinshubhra/CMSeeK)).
- **URL Extraction**: Collects URLs passively and actively ([urlfinder](https://github.com/projectdiscovery/urlfinder), [waymore](https://github.com/xnl-h4ck3r/waymore), [katana](https://github.com/projectdiscovery/katana), [github-endpoints](https://gist.github.com/six2dez/d1d516b606557526e9a78d7dd49cacd3) and [JSA](https://github.com/w9w/JSA)).
- **URL Pattern Analysis**: Classifies URLs using patterns ([urless](https://github.com/xnl-h4ck3r/urless), [gf](https://github.com/tomnomnom/gf) and [gf-patterns](https://github.com/1ndianl33t/Gf-Patterns)).
-- **Favicon Analysis**: Discovers real IPs behind favicons ([fav-up](https://github.com/pielco11/fav-up)).
+- **Favicon Analysis**: Discovers real IPs behind favicons ([fav-up](https://github.com/pielco11/fav-up)) and identifies technologies from favicon hashes ([favirecon](https://github.com/edoardottt/favirecon)).
- **JavaScript Analysis**: Extracts secrets and endpoints from JS files ([subjs](https://github.com/lc/subjs), [JSA](https://github.com/w9w/JSA), [xnLinkFinder](https://github.com/xnl-h4ck3r/xnLinkFinder), [getjswords](https://github.com/m4ll0k/BBTz), [mantra](https://github.com/MrEmpy/mantra), [jsluice](https://github.com/BishopFox/jsluice)).
- **Source Map Extraction**: Retrieves sensitive data from JavaScript source maps ([sourcemapper](https://github.com/denandz/sourcemapper)).
- **GraphQL Detection**: Discovers GraphQL endpoints with nuclei and optionally performs in-depth introspection ([GQLSpection](https://github.com/doyensec/GQLSpection)).
@@ -169,13 +176,13 @@ reconFTW is packed with features to make reconnaissance thorough and efficient.
- **SSRF**: Tests for server-side request forgery ([interactsh](https://github.com/projectdiscovery/interactsh) and param values with [ffuf](https://github.com/ffuf/ffuf)).
- **CRLF**: Checks for CRLF injection vulnerabilities ([crlfuzz](https://github.com/dwisiswant0/crlfuzz)).
- **LFI**: Tests for local file inclusion via fuzzing ([ffuf](https://github.com/ffuf/ffuf)).
-- **SSTI**: Detects server-side template injection ([ffuf](https://github.com/ffuf/ffuf)).
+- **SSTI**: Detects server-side template injection ([TInjA](https://github.com/Hackmanit/TInjA), with legacy ffuf mode available).
- **SQLi**: Tests for SQL injection ([SQLMap](https://github.com/sqlmapproject/sqlmap) and [ghauri](https://github.com/r0oth3x49/ghauri)).
-- **Broken Links**: Identifies broken links on web pages ([katana](https://github.com/projectdiscovery/katana)).
+- **Broken Links**: Identifies broken links and external references likely to be takeover-prone ([second-order](https://github.com/mhmdiaa/second-order), with legacy katana mode available).
- **Command Injection**: Tests for command injection vulnerabilities ([commix](https://github.com/commixproject/commix)).
- **Prototype Pollution**: Detects JavaScript prototype pollution ([ppmap](https://github.com/kleiton0x00/ppmap)).
- **HTTP Request Smuggling**: Checks for request smuggling vulnerabilities ([smugglex](https://github.com/hahwul/smugglex)).
-- **Web Cache**: Identifies web cache vulnerabilities ([Web-Cache-Vulnerability-Scanner](https://github.com/Hackmanit/Web-Cache-Vulnerability-Scanner)).
+- **Web Cache**: Identifies web cache vulnerabilities ([Web-Cache-Vulnerability-Scanner](https://github.com/Hackmanit/Web-Cache-Vulnerability-Scanner) and [toxicache](https://github.com/xhzeem/toxicache)).
- **4XX Bypassing**: Attempts to bypass 4XX responses ([nomore403](https://github.com/devploit/nomore403)).
- **Parameter Fuzzing**: Fuzzes URL parameters for vulnerabilities ([nuclei](https://github.com/projectdiscovery/nuclei)).
@@ -536,6 +543,7 @@ EMAILS=true # Fetch emails from differents sites
DOMAIN_INFO=true # whois info
IP_INFO=true # Reverse IP search, geolocation and whois
API_LEAKS=true # Check for API leaks
+API_LEAKS_POSTLEAKS=true # Enhance API leaks with postleaksNg
THIRD_PARTIES=true # Check for 3rd parties misconfigs
SPOOF=true # Check spoofable domains
METAFINDER_LIMIT=20 # Max 250
@@ -575,6 +583,7 @@ UNCOMMON_PORTS_WEB="81,300,591,593,832,981,1010,1311,1099,2082,2095,2096,2480,30
# Host
FAVICON=true # Check Favicon domain discovery
+FAVIRECON=true # Favicon-based technology recon for discovered web targets
PORTSCANNER=true # Enable or disable the whole Port scanner module
GEO_INFO=true # Fetch Geolocalization info
PORTSCAN_PASSIVE=true # Port scanner with Shodan
@@ -619,15 +628,18 @@ SSRF_CHECKS=true # SSRF checks
CRLF_CHECKS=true # CRLF checks
LFI=true # LFI by fuzzing
SSTI=true # SSTI by fuzzing
+SSTI_ENGINE="tinja" # SSTI engine: tinja|legacy
SQLI=true # Check SQLI
SQLMAP=true # Check SQLI with sqlmap
GHAURI=false # Check SQLI with ghauri
BROKENLINKS=true # Check for brokenlinks
+BROKENLINKS_ENGINE="second-order" # Broken links engine: second-order|legacy
SPRAY=true # Performs password spraying
COMM_INJ=true # Check for command injections with commix
PROTO_POLLUTION=true # Check for prototype pollution flaws
SMUGGLING=true # Check for HTTP request smuggling flaws
WEBCACHE=true # Check for Web Cache issues
+WEBCACHE_TOXICACHE=true # Complement web cache checks with toxicache
BYPASSER4XX=true # Check for 4XX bypasses
FUZZPARAMS=true # Fuzz parameters values
diff --git a/config/reconftw_full.cfg b/config/reconftw_full.cfg
index d8b865e..2f14c40 100644
--- a/config/reconftw_full.cfg
+++ b/config/reconftw_full.cfg
@@ -14,6 +14,7 @@ EMAILS=true
DOMAIN_INFO=true
IP_INFO=true
API_LEAKS=true
+API_LEAKS_POSTLEAKS=true
THIRD_PARTIES=true
SPOOF=true
MAIL_HYGIENE=true
@@ -43,6 +44,7 @@ WEBPROBEFULL=true
WEBSCREENSHOT=true
VIRTUALHOSTS=true
FAVICON=true
+FAVIRECON=true
# Host
PORTSCANNER=true
@@ -80,15 +82,18 @@ SSRF_CHECKS=true
CRLF_CHECKS=true
LFI=true
SSTI=true
+SSTI_ENGINE="tinja"
SQLI=true
SQLMAP=true
GHAURI=true
BROKENLINKS=true
+BROKENLINKS_ENGINE="second-order"
SPRAY=true
COMM_INJ=true
PROTO_POLLUTION=true
SMUGGLING=true
WEBCACHE=true
+WEBCACHE_TOXICACHE=true
BYPASSER4XX=true
FUZZPARAMS=true
diff --git a/config/reconftw_quick.cfg b/config/reconftw_quick.cfg
index 818507b..a9e4116 100644
--- a/config/reconftw_quick.cfg
+++ b/config/reconftw_quick.cfg
@@ -5,6 +5,7 @@
# Base config is already loaded by reconftw.sh before this file.
# Disable active/intrusive modules
+API_LEAKS_POSTLEAKS=false
SUBBRUTE=false
SUBSCRAPING=false
SUBPERMUTE=false
@@ -19,6 +20,7 @@ DEEP_WILDCARD_FILTER=false
WEBPROBEFULL=false
WEBSCREENSHOT=false
VIRTUALHOSTS=false
+FAVIRECON=false
PORTSCANNER=false
PORTSCAN_ACTIVE=false
CDN_IP=false
@@ -56,6 +58,9 @@ SMUGGLING=false
WEBCACHE=false
BYPASSER4XX=false
FUZZPARAMS=false
+WEBCACHE_TOXICACHE=false
+BROKENLINKS_ENGINE="legacy"
+SSTI_ENGINE="legacy"
# Disable heavy extras
GRAPHQL_CHECK=false
diff --git a/config/reconftw_stealth.cfg b/config/reconftw_stealth.cfg
index 0338c23..245fdcf 100644
--- a/config/reconftw_stealth.cfg
+++ b/config/reconftw_stealth.cfg
@@ -14,6 +14,7 @@ EMAILS=true
DOMAIN_INFO=true
IP_INFO=true
API_LEAKS=true
+API_LEAKS_POSTLEAKS=false
THIRD_PARTIES=true
SPOOF=true
MAIL_HYGIENE=true
@@ -46,6 +47,7 @@ VIRTUALHOSTS=false
# Host: passive only
FAVICON=false
+FAVIRECON=false
PORTSCANNER=true
PORTSCAN_PASSIVE=true
PORTSCAN_ACTIVE=false
@@ -92,6 +94,9 @@ SMUGGLING=false
WEBCACHE=false
BYPASSER4XX=false
FUZZPARAMS=false
+WEBCACHE_TOXICACHE=false
+BROKENLINKS_ENGINE="legacy"
+SSTI_ENGINE="legacy"
# Nuclei: only safe templates
NUCLEICHECK=true
diff --git a/install.sh b/install.sh
index c94ec5c..eff8dc2 100755
--- a/install.sh
+++ b/install.sh
@@ -242,6 +242,10 @@ declare -A gotools=(
["VhostFinder"]="go install -v github.com/wdahlenburg/VhostFinder@latest"
["misconfig-mapper"]="go install github.com/intigriti/misconfig-mapper/cmd/misconfig-mapper@latest"
["grpcurl"]="go install -v github.com/fullstorydev/grpcurl/cmd/grpcurl@latest"
+ ["toxicache"]="go install -v github.com/xhzeem/toxicache@latest"
+ ["favirecon"]="go install -v github.com/edoardottt/favirecon/cmd/favirecon@latest"
+ ["second-order"]="go install -v github.com/mhmdiaa/second-order@latest"
+ ["tinja"]="go install -v github.com/Hackmanit/TInjA@latest"
)
# Declare pipx tools and their paths
@@ -295,6 +299,7 @@ declare -A repos=(
["metagoofil"]="opsdisk/metagoofil"
["EmailHarvester"]="maldevel/EmailHarvester"
["reconftw_ai"]="six2dez/reconftw_ai"
+ ["postleaksNg"]="six2dez/postleaksNG"
)
# Function to display the banner
@@ -515,6 +520,18 @@ function install_tools() {
"trufflehog")
go install &>/dev/null
;;
+ "postleaksNg")
+ if [[ ! -d "venv" ]]; then
+ python3 -m venv venv &>/dev/null || true
+ fi
+ if [[ -f "venv/bin/activate" ]]; then
+ # shellcheck disable=SC1091
+ source venv/bin/activate
+ pip3 install --upgrade pip &>/dev/null || true
+ pip3 install -e . &>/dev/null || true
+ deactivate || true
+ fi
+ ;;
esac
# Copy gf patterns if applicable
diff --git a/modules/core.sh b/modules/core.sh
index 43e452c..988bb80 100644
--- a/modules/core.sh
+++ b/modules/core.sh
@@ -211,6 +211,7 @@ function tools_installed() {
["spoofy_python"]="${tools}/Spoofy/venv/bin/python3"
["swaggerspy"]="${tools}/SwaggerSpy/swaggerspy.py"
["swaggerspy_python"]="${tools}/SwaggerSpy/venv/bin/python3"
+ ["postleaksNg"]="${tools}/postleaksNg/.venv/bin/postleaksNg"
["LeakSearch"]="${tools}/LeakSearch/LeakSearch.py"
["LeakSearch_python"]="${tools}/LeakSearch/venv/bin/python3"
["Oralyzer"]="${tools}/Oralyzer/oralyzer.py"
@@ -307,6 +308,10 @@ function tools_installed() {
["arjun"]="arjun"
["gqlspection"]="gqlspection"
["cloud_enum"]="cloud_enum"
+ ["toxicache"]="toxicache"
+ ["favirecon"]="favirecon"
+ ["tinja"]="tinja"
+ ["second-order"]="second-order"
)
# Check for tool files
diff --git a/modules/modes.sh b/modules/modes.sh
index 8277d8f..3566978 100644
--- a/modules/modes.sh
+++ b/modules/modes.sh
@@ -690,7 +690,7 @@ function recon() {
webprobe_full
if [[ "${PARALLEL_MODE:-true}" == "true" ]] && declare -f parallel_funcs &>/dev/null; then
- parallel_funcs "${PAR_WEB_DETECT_GROUP_SIZE:-3}" screenshot cdnprovider portscan
+ parallel_funcs "${PAR_WEB_DETECT_GROUP_SIZE:-3}" screenshot cdnprovider portscan favirecon_tech
local webhost_rc=$?
if ((webhost_rc > 0)); then
if [[ "${CONTINUE_ON_TOOL_ERROR:-true}" == "true" ]]; then
@@ -706,6 +706,7 @@ function recon() {
# virtualhosts
cdnprovider
portscan
+ favirecon_tech
geo_info
fi
@@ -1069,6 +1070,7 @@ function subs_menu() {
_print_section "Web Detection"
webprobe_simple
webprobe_full
+ favirecon_tech
screenshot
# virtualhosts
@@ -1084,6 +1086,7 @@ function webs_menu() {
webprobe_simple
webprobe_full
+ favirecon_tech
subtakeover
remove_big_files
screenshot
@@ -1129,6 +1132,7 @@ function zen_menu() {
_print_section "Web Detection"
webprobe_simple
webprobe_full
+ favirecon_tech
screenshot
# virtualhosts
cdnprovider
diff --git a/modules/osint.sh b/modules/osint.sh
index e966b70..fdaebc4 100644
--- a/modules/osint.sh
+++ b/modules/osint.sh
@@ -245,6 +245,36 @@ function apileaks() {
return 1
fi
+ # Optional postleaksNg integration (Postman public library leaks)
+ if [[ ${API_LEAKS_POSTLEAKS:-true} == true ]]; then
+ local postleaks_bin="${tools}/postleaksNg/.venv/bin/postleaksNg"
+ local postleaks_out="${dir}/osint/postman_leaks_postleaksng"
+ mkdir -p "$postleaks_out"
+ if [[ -x "$postleaks_bin" ]]; then
+ local -a postleaks_cmd=(
+ "$postleaks_bin"
+ -k "$domain"
+ --output "$postleaks_out"
+ -t "${POSTLEAKS_THREADS:-10}"
+ )
+ [[ -n "${POSTLEAKS_INCLUDE:-}" ]] && postleaks_cmd+=(--include "${POSTLEAKS_INCLUDE}")
+ [[ -n "${POSTLEAKS_EXCLUDE:-}" ]] && postleaks_cmd+=(--exclude "${POSTLEAKS_EXCLUDE}")
+
+ if ! run_command "${postleaks_cmd[@]}" 2>>"$LOGFILE" >/dev/null; then
+ log_note "apileaks: postleaksNg failed" "${FUNCNAME[0]}" "${LINENO}"
+ fi
+
+ # Aggregate discovered URLs into the existing postman leaks artifact.
+ if compgen -G "${postleaks_out}/*.json" >/dev/null 2>&1; then
+ jq -r '.url // empty' "${postleaks_out}"/*.json 2>/dev/null \
+ | grep -aE '^https?://' \
+ | anew -q "${dir}/osint/postman_leaks.txt"
+ fi
+ else
+ log_note "apileaks: postleaksNg binary not found at ${postleaks_bin}" "${FUNCNAME[0]}" "${LINENO}"
+ fi
+ fi
+
if [[ "${DRY_RUN:-false}" == "true" ]]; then
end_func "Dry-run: apileaks commands recorded" "${FUNCNAME[0]}" "SKIP"
return
@@ -254,6 +284,9 @@ function apileaks() {
if [[ -s "${dir}/osint/postman_leaks.txt" ]]; then
run_command trufflehog filesystem "${dir}/osint/postman_leaks.txt" -j 2>/dev/null | jq -c | anew -q "${dir}/osint/postman_leaks_trufflehog.json"
fi
+ if [[ -d "${dir}/osint/postman_leaks_postleaksng" ]]; then
+ run_command trufflehog filesystem "${dir}/osint/postman_leaks_postleaksng" -j 2>/dev/null | jq -c | anew -q "${dir}/osint/postman_leaks_trufflehog.json"
+ fi
if [[ -s "${dir}/osint/swagger_leaks.txt" ]]; then
run_command trufflehog filesystem "${dir}/osint/swagger_leaks.txt" -j 2>/dev/null | jq -c | anew -q "${dir}/osint/swagger_leaks_trufflehog.json"
diff --git a/modules/vulns.sh b/modules/vulns.sh
index 06b8eb9..da46e27 100644
--- a/modules/vulns.sh
+++ b/modules/vulns.sh
@@ -366,6 +366,8 @@ function ssti() {
# Ensure gf/ssti.txt is not empty
if [[ -s "gf/ssti.txt" ]]; then
+ local ssti_engine="${SSTI_ENGINE:-tinja}"
+
_print_msg INFO "Running: SSTI Payload Generation"
# Process ssti.txt with qsreplace and filter lines containing 'FUZZ'
@@ -374,12 +376,44 @@ function ssti() {
# Determine whether to proceed based on DEEP flag or number of URLs
URL_COUNT=$(wc -l <".tmp/tmp_ssti.txt")
if [[ $DEEP == true ]] || [[ $URL_COUNT -le $DEEP_LIMIT ]]; then
+ : >".tmp/ssti_candidates.txt"
+
+ if [[ "$ssti_engine" == "tinja" ]] && command -v tinja >/dev/null 2>&1; then
+ _print_msg INFO "Running: SSTI Checks with TInjA"
+ local tinja_report_dir="$dir/.tmp/tinja"
+ mkdir -p "$tinja_report_dir"
+ local -a tinja_cmd=(tinja url --reportpath "${tinja_report_dir}/" --ratelimit "${TINJA_RATELIMIT:-0}" --timeout "${TINJA_TIMEOUT:-15}" --verbosity 0)
+ if [[ -n "${HEADER:-}" ]]; then
+ tinja_cmd+=(-H "${HEADER}")
+ fi
+ while IFS= read -r u; do
+ [[ -n "$u" ]] && tinja_cmd+=(--url "$u")
+ done <".tmp/tmp_ssti.txt"
- _print_msg INFO "Running: SSTI Fuzzing with FFUF"
+ if ! run_command "${tinja_cmd[@]}" 2>>"$LOGFILE" >/dev/null; then
+ log_note "ssti: tinja execution failed, no findings collected" "${FUNCNAME[0]}" "${LINENO}"
+ fi
- # Use Interlace to parallelize FFUF scanning
- run_command interlace -tL ".tmp/tmp_ssti.txt" -threads "$INTERLACE_THREADS" -c "ffuf -v -r -t ${FFUF_THREADS} -rate ${FFUF_RATELIMIT} -H \"${HEADER}\" -w \"${ssti_wordlist}\" -u \"_target_\" -mr \"ssti49\"" 2>>"$LOGFILE" \
- | grep "URL" | sed 's/| URL | //' | anew -q "vulns/ssti.txt"
+ local report_file=""
+ report_file=$(ls -1t "${tinja_report_dir}"/*.jsonl 2>/dev/null | head -n 1 || true)
+ if [[ -n "$report_file" && -s "$report_file" ]]; then
+ jq -r 'select((.isWebpageVulnerable == true) or any(.parameters[]?; .isParameterVulnerable == true)) | (.url // empty) + " [certainty:" + (.certainty // "unknown") + "]"' "$report_file" 2>/dev/null \
+ | sed '/^\s*$/d' \
+ | anew -q ".tmp/ssti_candidates.txt"
+ fi
+ else
+ [[ "$ssti_engine" == "tinja" ]] && _print_msg WARN "TInjA not found. Falling back to legacy SSTI check."
+ _print_msg INFO "Running: SSTI Fuzzing with FFUF"
+
+ # Use Interlace to parallelize FFUF scanning
+ run_command interlace -tL ".tmp/tmp_ssti.txt" -threads "$INTERLACE_THREADS" -c "ffuf -v -r -t ${FFUF_THREADS} -rate ${FFUF_RATELIMIT} -H \"${HEADER}\" -w \"${ssti_wordlist}\" -u \"_target_\" -mr \"ssti49\"" 2>>"$LOGFILE" \
+ | grep "URL" | sed 's/| URL | //' | anew -q ".tmp/ssti_candidates.txt"
+ fi
+
+ if [[ -s ".tmp/ssti_candidates.txt" ]]; then
+ cat ".tmp/ssti_candidates.txt" | anew -q "vulns/ssti_tinja.txt"
+ cat ".tmp/ssti_candidates.txt" | anew -q "vulns/ssti.txt"
+ fi
end_func "Results are saved in vulns/ssti.txt" "${FUNCNAME[0]}"
else
@@ -792,6 +826,15 @@ function webcache() {
cat "$dir/.tmp/webcache.txt" | anew -q "vulns/webcache.txt"
fi
+ # Optional second engine (toxicache) to complement findings
+ if [[ ${WEBCACHE_TOXICACHE:-true} == true ]] && command -v toxicache >/dev/null 2>&1; then
+ local toxicache_out="$dir/.tmp/webcache_toxicache.txt"
+ run_command toxicache -i "$dir/webs/webs_all.txt" -o "$toxicache_out" -t "${TOXICACHE_THREADS:-70}" -ua "${TOXICACHE_USER_AGENT:-Mozilla/5.0 (X11; Linux x86_64)}" 2>>"$LOGFILE" >/dev/null || true
+ if [[ -s "$toxicache_out" ]]; then
+ cat "$toxicache_out" | anew -q "vulns/webcache_toxicache.txt"
+ fi
+ fi
+
end_func "Results are saved in vulns/webcache.txt" "${FUNCNAME[0]}"
else
diff --git a/modules/web.sh b/modules/web.sh
index 582d629..d71f06f 100644
--- a/modules/web.sh
+++ b/modules/web.sh
@@ -2,6 +2,7 @@
# shellcheck disable=SC2154 # Variables defined in reconftw.cfg
# reconFTW - Web analysis module
# Contains: webprobe_simple, webprobe_full, screenshot, virtualhosts, favicon,
+# favirecon_tech,
# portscan, cdnprovider, waf_checks, nuclei_check, graphql_scan,
# param_discovery, grpc_reflection, fuzz, iishortname, cms_scanner,
# urlchecks, url_gf, url_ext, jschecks, websocket_checks,
@@ -415,6 +416,67 @@ function favicon() {
}
+function favirecon_tech() {
+
+ # Create necessary directories
+ if ! ensure_dirs .tmp webs; then return 1; fi
+
+ # Check if the function should run
+ if { [[ ! -f "$called_fn_dir/.${FUNCNAME[0]}" ]] || [[ $DIFF == true ]]; } \
+ && [[ ${FAVIRECON:-true} == true ]] \
+ && ! [[ $domain =~ ^[0-9]+\.[0-9]+\.[0-9]+\.[0-9]+$ ]]; then
+
+ start_func "${FUNCNAME[0]}" "Favicon Technology Recon"
+
+ # Combine webs.txt and webs_uncommon_ports.txt into webs_all.txt if it doesn't exist
+ if [[ ! -s "webs/webs_all.txt" ]]; then
+ cat webs/webs.txt webs/webs_uncommon_ports.txt 2>/dev/null | anew -q "webs/webs_all.txt"
+ fi
+
+ if [[ -s "webs/webs_all.txt" ]]; then
+ local fav_cmd=(
+ favirecon
+ -l "webs/webs_all.txt"
+ -c "${FAVIRECON_CONCURRENCY:-50}"
+ -t "${FAVIRECON_TIMEOUT:-10}"
+ -s
+ -j
+ -o "webs/favirecon.json"
+ )
+
+ if [[ -n "${FAVIRECON_PROXY:-}" ]]; then
+ fav_cmd+=(-px "${FAVIRECON_PROXY}")
+ fi
+ if [[ "${FAVIRECON_RATE_LIMIT:-0}" -gt 0 ]]; then
+ fav_cmd+=(-rl "${FAVIRECON_RATE_LIMIT}")
+ fi
+
+ if ! run_command "${fav_cmd[@]}" 2>>"$LOGFILE" >/dev/null; then
+ log_note "favirecon_tech: favirecon command failed" "${FUNCNAME[0]}" "${LINENO}"
+ fi
+
+ if [[ -s "webs/favirecon.json" ]]; then
+ jq -r '[(.URL // .url // ""), (.Name // .name // "unknown"), (.Hash // .hash // "unknown")] | @tsv' "webs/favirecon.json" 2>/dev/null \
+ | awk -F'\t' 'NF>=1 && $1 ~ /^https?:\/\// {printf "%s [%s] [%s]\n", $1, $2, $3}' \
+ | anew -q "webs/favirecon.txt"
+ fi
+ else
+ log_note "favirecon_tech: no webs/webs_all.txt found" "${FUNCNAME[0]}" "${LINENO}"
+ fi
+
+ end_func "Results are saved in webs/favirecon.[json|txt]" "${FUNCNAME[0]}"
+
+ else
+ if [[ ${FAVIRECON:-true} == false ]]; then
+ _print_msg WARN "${FUNCNAME[0]} skipped due to configuration settings."
+ elif [[ $domain =~ ^[0-9]+\.[0-9]+\.[0-9]+\.[0-9]+$ ]]; then
+ return
+ else
+ _print_msg WARN "${FUNCNAME[0]} already processed. To force execution, delete ${called_fn_dir}/.${FUNCNAME[0]}"
+ fi
+ fi
+}
+
function portscan() {
# Create necessary directories
@@ -1860,46 +1922,86 @@ function brokenLinks() {
# Check if webs_all.txt exists and is not empty
if [[ -s "webs/webs_all.txt" ]]; then
- if [[ $AXIOM != true ]]; then
- # Use katana for scanning
- if [[ ! -s ".tmp/katana.txt" ]]; then
- if [[ $DEEP == true ]]; then
- timeout 4h katana -silent -list "webs/webs_all.txt" -jc -kf all -c "$KATANA_THREADS" -d 3 -o ".tmp/katana.txt" 2>>"$LOGFILE" >/dev/null
- else
- timeout 3h katana -silent -list "webs/webs_all.txt" -jc -kf all -c "$KATANA_THREADS" -d 2 -o ".tmp/katana.txt" 2>>"$LOGFILE" >/dev/null
+ local bl_engine="${BROKENLINKS_ENGINE:-second-order}"
+ if [[ "$bl_engine" == "second-order" ]]; then
+ local so_depth="${SECOND_ORDER_DEPTH:-1}"
+ [[ $DEEP == true ]] && so_depth=$((so_depth + 1))
+
+ rm -rf ".tmp/second_order" >/dev/null 2>&1 || true
+ mkdir -p ".tmp/second_order"
+ : >".tmp/brokenLinks_total.txt"
+
+ while IFS= read -r target; do
+ [[ -z "$target" ]] && continue
+ local safe_target
+ safe_target=$(echo "$target" | sed 's|https\?://||; s|[^A-Za-z0-9._-]|_|g')
+ local out_dir=".tmp/second_order/${safe_target}"
+ mkdir -p "$out_dir"
+
+ local so_cmd=(
+ second-order
+ -target "$target"
+ -config "${SECOND_ORDER_CONFIG:-${tools}/second-order/config/takeover.json}"
+ -depth "$so_depth"
+ -threads "${SECOND_ORDER_THREADS:-10}"
+ -output "$out_dir"
+ )
+ if [[ ${SECOND_ORDER_INSECURE:-false} == true ]]; then
+ so_cmd+=(-insecure)
fi
- fi
- # Remove lines longer than 2048 characters
- if [[ -s ".tmp/katana.txt" ]]; then
- sed_i '/^.\{2048\}./d' ".tmp/katana.txt"
- fi
+ if [[ -n "${HEADER:-}" ]]; then
+ so_cmd+=(-header "${HEADER}")
+ fi
+
+ run_command "${so_cmd[@]}" 2>>"$LOGFILE" >/dev/null || true
+
+ if [[ -s "${out_dir}/non-200-url-attributes.json" ]]; then
+ jq -r 'to_entries[]?.value | to_entries[]?.value[]? // empty' "${out_dir}/non-200-url-attributes.json" 2>/dev/null \
+ | grep -aE '^https?://' \
+ | anew -q ".tmp/brokenLinks_total.txt"
+ fi
+ done <"webs/webs_all.txt"
else
- # Use axiom-scan for scanning
- if [[ ! -s ".tmp/katana.txt" ]]; then
- if [[ $DEEP == true ]]; then
- run_command axiom-scan "webs/webs_all.txt" -m katana -jc -kf all -d 3 --max-runtime 4h -o ".tmp/katana.txt" $AXIOM_EXTRA_ARGS 2>>"$LOGFILE" >/dev/null
- else
- run_command axiom-scan "webs/webs_all.txt" -m katana -jc -kf all -d 2 --max-runtime 3h -o ".tmp/katana.txt" $AXIOM_EXTRA_ARGS 2>>"$LOGFILE" >/dev/null
+ if [[ $AXIOM != true ]]; then
+ # Use katana for scanning
+ if [[ ! -s ".tmp/katana.txt" ]]; then
+ if [[ $DEEP == true ]]; then
+ timeout 4h katana -silent -list "webs/webs_all.txt" -jc -kf all -c "$KATANA_THREADS" -d 3 -o ".tmp/katana.txt" 2>>"$LOGFILE" >/dev/null
+ else
+ timeout 3h katana -silent -list "webs/webs_all.txt" -jc -kf all -c "$KATANA_THREADS" -d 2 -o ".tmp/katana.txt" 2>>"$LOGFILE" >/dev/null
+ fi
fi
# Remove lines longer than 2048 characters
if [[ -s ".tmp/katana.txt" ]]; then
sed_i '/^.\{2048\}./d' ".tmp/katana.txt"
fi
+ else
+ # Use axiom-scan for scanning
+ if [[ ! -s ".tmp/katana.txt" ]]; then
+ if [[ $DEEP == true ]]; then
+ run_command axiom-scan "webs/webs_all.txt" -m katana -jc -kf all -d 3 --max-runtime 4h -o ".tmp/katana.txt" $AXIOM_EXTRA_ARGS 2>>"$LOGFILE" >/dev/null
+ else
+ run_command axiom-scan "webs/webs_all.txt" -m katana -jc -kf all -d 2 --max-runtime 3h -o ".tmp/katana.txt" $AXIOM_EXTRA_ARGS 2>>"$LOGFILE" >/dev/null
+ fi
+ # Remove lines longer than 2048 characters
+ if [[ -s ".tmp/katana.txt" ]]; then
+ sed_i '/^.\{2048\}./d' ".tmp/katana.txt"
+ fi
+ fi
fi
- fi
- # Process katana.txt to find broken links
- if [[ -s ".tmp/katana.txt" ]]; then
- run_command httpx -follow-redirects -random-agent -status-code -threads "$HTTPX_THREADS" -rl "$HTTPX_RATELIMIT" -timeout "$HTTPX_TIMEOUT" -silent -retries 2 -no-color <".tmp/katana.txt" 2>>"$LOGFILE" \
- | grep "\[4" | cut -d ' ' -f1 | anew -q ".tmp/brokenLinks_total.txt"
+ # Process katana.txt to find broken links
+ if [[ -s ".tmp/katana.txt" ]]; then
+ run_command httpx -follow-redirects -random-agent -status-code -threads "$HTTPX_THREADS" -rl "$HTTPX_RATELIMIT" -timeout "$HTTPX_TIMEOUT" -silent -retries 2 -no-color <".tmp/katana.txt" 2>>"$LOGFILE" \
+ | grep "\[4" | cut -d ' ' -f1 | anew -q ".tmp/brokenLinks_total.txt"
+ fi
fi
# Update brokenLinks.txt with unique entries
if [[ -s ".tmp/brokenLinks_total.txt" ]]; then
- NUMOFLINES=$(wc -l <".tmp/brokenLinks_total.txt" 2>>"$LOGFILE" | awk '{print $1}')
- cat .tmp/brokenLinks_total.txt | anew -q "vulns/brokenLinks.txt"
+ cat ".tmp/brokenLinks_total.txt" | anew -q "vulns/brokenLinks.txt"
NUMOFLINES=$(sed '/^$/d' "vulns/brokenLinks.txt" | wc -l)
- notification "${NUMOFLINES} new broken links found" info
+ notification "${NUMOFLINES} broken links found" info
fi
end_func "Results are saved in vulns/brokenLinks.txt" "${FUNCNAME[0]}"
diff --git a/reconftw.cfg b/reconftw.cfg
index f636a1d..3503648 100644
--- a/reconftw.cfg
+++ b/reconftw.cfg
@@ -105,6 +105,10 @@ EMAILS=true # Fetch emails from differents sites
DOMAIN_INFO=true # whois info
IP_INFO=true # Reverse IP search, geolocation and whois
API_LEAKS=true # Check for API leaks
+API_LEAKS_POSTLEAKS=true # Enhance API leaks with postleaksNg
+POSTLEAKS_THREADS=10 # Threads for postleaksNg
+POSTLEAKS_INCLUDE="" # Optional include filter for postleaksNg URL results
+POSTLEAKS_EXCLUDE="" # Optional exclude filter for postleaksNg URL results
THIRD_PARTIES=true # Check for 3rd parties misconfigs
SPOOF=true # Check spoofable domains
METAFINDER_LIMIT=20 # Max 250
@@ -148,6 +152,11 @@ UNCOMMON_PORTS_WEB=$(cat "${SCRIPTPATH}/config/uncommon_ports_web.txt" 2>/dev/nu
# Host
FAVICON=true # Check Favicon domain discovery
+FAVIRECON=true # Favicon-based technology recon over discovered web targets
+FAVIRECON_CONCURRENCY=50 # favirecon concurrency
+FAVIRECON_TIMEOUT=10 # favirecon timeout seconds
+FAVIRECON_RATE_LIMIT=0 # favirecon rate limit per second (0 = unlimited)
+FAVIRECON_PROXY="" # Optional proxy URL for favirecon
PORTSCANNER=true # Enable or disable the whole Port scanner module
GEO_INFO=true # Fetch Geolocalization info
PORTSCAN_PASSIVE=true # Port scanner with Shodan
@@ -198,15 +207,26 @@ SSRF_CHECKS=true # SSRF checks
CRLF_CHECKS=true # CRLF checks
LFI=true # LFI by fuzzing
SSTI=true # SSTI by fuzzing
+SSTI_ENGINE="tinja" # SSTI engine: tinja|legacy
+TINJA_RATELIMIT=0 # TInjA requests per second (0 = unlimited)
+TINJA_TIMEOUT=15 # TInjA request timeout seconds
SQLI=true # Check SQLI
SQLMAP=true # Check SQLI with sqlmap
GHAURI=false # Check SQLI with ghauri
BROKENLINKS=true # Check for brokenlinks
+BROKENLINKS_ENGINE="second-order" # Broken links engine: second-order|legacy
+SECOND_ORDER_CONFIG="${tools}/second-order/config/takeover.json" # second-order config file path
+SECOND_ORDER_DEPTH=1 # second-order crawl depth
+SECOND_ORDER_THREADS=10 # second-order thread count
+SECOND_ORDER_INSECURE=false # second-order accept invalid TLS
SPRAY=true # Performs password spraying
COMM_INJ=true # Check for command injections with commix
PROTO_POLLUTION=true # Check for prototype pollution flaws
SMUGGLING=true # Check for HTTP request smuggling flaws
WEBCACHE=true # Check for Web Cache issues
+WEBCACHE_TOXICACHE=true # Complement webcache module with toxicache engine
+TOXICACHE_THREADS=70 # toxicache worker threads
+TOXICACHE_USER_AGENT="Mozilla/5.0 (X11; Linux x86_64; rv:128.0) Gecko/20100101 Firefox/128.0" # toxicache user-agent
BYPASSER4XX=true # Check for 4XX bypasses
FUZZPARAMS=true # Fuzz parameters values
@@ -217,8 +237,8 @@ CONTINUE_ON_TOOL_ERROR=true # Continue recon when a tool/module fails in paralle
PARALLEL_LOG_MODE="summary" # Parallel output mode: summary (compact) | tail (last N lines) | full (cat all)
PARALLEL_TAIL_LINES=20 # Number of tail lines shown per job in 'tail' mode (doubled on failure)
PARALLEL_UI_MODE="clean" # Parallel terminal UX: clean | balanced | trace
-PARALLEL_PROGRESS_SHOW_ETA=true # Show ETA estimate in parallel snapshots
-PARALLEL_PROGRESS_SHOW_ACTIVE=true # Show active tasks list in parallel snapshots
+PARALLEL_PROGRESS_SHOW_ETA=true # Show ETA in live progress once estimate is stable
+PARALLEL_PROGRESS_SHOW_ACTIVE=true # Show active tasks list in live parallel progress
PARALLEL_PROGRESS_COMPACT_ACTIVE_MAX=4 # Max active/done items shown before compacting with "+N more"
PARALLEL_TRACE_SLOW_SECONDS=30 # In balanced mode, show finished-line for jobs slower than this threshold
diff --git a/tests/unit/test_new_tool_integrations.bats b/tests/unit/test_new_tool_integrations.bats
new file mode 100644
index 0000000..14ee17f
--- /dev/null
+++ b/tests/unit/test_new_tool_integrations.bats
@@ -0,0 +1,190 @@
+#!/usr/bin/env bats
+
+setup() {
+ local project_root
+ project_root="$(cd "$(dirname "$BATS_TEST_FILENAME")/../.." && pwd)"
+ export SCRIPTPATH="$project_root"
+ export LOGFILE="/dev/null"
+ export bred='' bblue='' bgreen='' byellow='' yellow='' reset=''
+
+ export TEST_DIR="$BATS_TEST_TMPDIR/reconftw_new_tools"
+ mkdir -p "$TEST_DIR"
+ export dir="$TEST_DIR/target.example.com"
+ export called_fn_dir="$dir/.called_fn"
+ mkdir -p "$called_fn_dir" "$dir"
+ cd "$dir"
+
+ export MOCK_BIN="$TEST_DIR/mockbin"
+ mkdir -p "$MOCK_BIN"
+ export PATH="$MOCK_BIN:$PATH"
+
+ source "$project_root/reconftw.sh" --source-only
+
+ export domain="target.example.com"
+ export DIFF=false
+ export AXIOM=false
+}
+
+teardown() {
+ [[ -d "$TEST_DIR" ]] && rm -rf "$TEST_DIR"
+}
+
+@test "ssti uses tinja engine and writes compatible output" {
+ mkdir -p gf .tmp vulns
+ printf 'https://target.example.com/?q=test\n' > gf/ssti.txt
+
+ cat > "$MOCK_BIN/tinja" <<'SH'
+#!/usr/bin/env bash
+report_dir=""
+while [[ $# -gt 0 ]]; do
+ case "$1" in
+ --reportpath)
+ report_dir="$2"
+ shift 2
+ ;;
+ *)
+ shift
+ ;;
+ esac
+done
+mkdir -p "$report_dir"
+printf '%s\n' '{"url":"https://target.example.com/?q=FUZZ","isWebpageVulnerable":true,"certainty":"high","parameters":[]}' > "${report_dir}/mock_Report.jsonl"
+SH
+ chmod +x "$MOCK_BIN/tinja"
+
+ export SSTI=true
+ export SSTI_ENGINE="tinja"
+ export TINJA_RATELIMIT=0
+ export TINJA_TIMEOUT=15
+ export DEEP=false
+ export DEEP_LIMIT=500
+
+ run ssti
+ [ "$status" -eq 0 ]
+ [ -s "vulns/ssti.txt" ]
+ grep -q "target.example.com" "vulns/ssti.txt"
+}
+
+@test "brokenLinks supports second-order engine" {
+ mkdir -p webs .tmp vulns
+ printf 'https://target.example.com\n' > webs/webs_all.txt
+ printf '{"LogNon200Queries":{"script":"src"}}\n' > "$TEST_DIR/takeover.json"
+
+ cat > "$MOCK_BIN/second-order" <<'SH'
+#!/usr/bin/env bash
+out_dir=""
+while [[ $# -gt 0 ]]; do
+ case "$1" in
+ -output)
+ out_dir="$2"
+ shift 2
+ ;;
+ *)
+ shift
+ ;;
+ esac
+done
+mkdir -p "$out_dir"
+printf '%s\n' '{"https://target.example.com":{"script[src]":["https://cdn.dead.example.org/app.js"]}}' > "${out_dir}/non-200-url-attributes.json"
+SH
+ chmod +x "$MOCK_BIN/second-order"
+
+ export BROKENLINKS=true
+ export BROKENLINKS_ENGINE="second-order"
+ export SECOND_ORDER_CONFIG="$TEST_DIR/takeover.json"
+ export SECOND_ORDER_DEPTH=1
+ export SECOND_ORDER_THREADS=4
+ export SECOND_ORDER_INSECURE=false
+
+ run brokenLinks
+ [ "$status" -eq 0 ]
+ [ -s "vulns/brokenLinks.txt" ]
+ grep -q "cdn.dead.example.org" "vulns/brokenLinks.txt"
+}
+
+@test "favirecon_tech stores normalized technology findings" {
+ mkdir -p webs .tmp
+ printf 'https://target.example.com\n' > webs/webs_all.txt
+
+ cat > "$MOCK_BIN/favirecon" <<'SH'
+#!/usr/bin/env bash
+outfile=""
+while [[ $# -gt 0 ]]; do
+ case "$1" in
+ -o)
+ outfile="$2"
+ shift 2
+ ;;
+ *)
+ shift
+ ;;
+ esac
+done
+printf '%s\n' '{"URL":"https://target.example.com","Name":"GitLab","Hash":"12345"}' > "$outfile"
+SH
+ chmod +x "$MOCK_BIN/favirecon"
+
+ export FAVIRECON=true
+ export FAVIRECON_CONCURRENCY=10
+ export FAVIRECON_TIMEOUT=10
+ export FAVIRECON_RATE_LIMIT=0
+
+ run favirecon_tech
+ [ "$status" -eq 0 ]
+ [ -s "webs/favirecon.txt" ]
+ grep -q "GitLab" "webs/favirecon.txt"
+}
+
+@test "apileaks integrates postleaksNg output" {
+ mkdir -p osint
+ export tools="$TEST_DIR/tools"
+ mkdir -p "$tools/SwaggerSpy/venv/bin" "$tools/SwaggerSpy" "$tools/postleaksNg/.venv/bin"
+
+ cat > "$MOCK_BIN/porch-pirate" <<'SH'
+#!/usr/bin/env bash
+printf '%s\n' 'https://postman.initial.example.com/api'
+SH
+ chmod +x "$MOCK_BIN/porch-pirate"
+
+ cat > "$tools/SwaggerSpy/venv/bin/python3" <<'SH'
+#!/usr/bin/env bash
+printf '%s\n' 'URL https://swagger.example.com/openapi.json'
+SH
+ chmod +x "$tools/SwaggerSpy/venv/bin/python3"
+ printf '%s\n' 'print("mock")' > "$tools/SwaggerSpy/swaggerspy.py"
+
+ cat > "$tools/postleaksNg/.venv/bin/postleaksNg" <<'SH'
+#!/usr/bin/env bash
+out=""
+while [[ $# -gt 0 ]]; do
+ case "$1" in
+ --output)
+ out="$2"
+ shift 2
+ ;;
+ *)
+ shift
+ ;;
+ esac
+done
+mkdir -p "$out"
+printf '%s\n' '{"url":"https://postman.new.example.com/path"}' > "$out/postleaks.json"
+SH
+ chmod +x "$tools/postleaksNg/.venv/bin/postleaksNg"
+
+ cat > "$MOCK_BIN/trufflehog" <<'SH'
+#!/usr/bin/env bash
+printf '%s\n' '{"DetectorName":"mock"}'
+SH
+ chmod +x "$MOCK_BIN/trufflehog"
+
+ export API_LEAKS=true
+ export OSINT=true
+ export API_LEAKS_POSTLEAKS=true
+ export POSTLEAKS_THREADS=2
+
+ run apileaks
+ [ "$status" -eq 0 ]
+ [ -s "osint/postman_leaks.txt" ]
+ grep -q "postman.new.example.com" "osint/postman_leaks.txt"
+}