Skip to content

reconFTW is a tool designed to perform automated recon on a target domain by running the best set of tools to perform scanning and finding out vulnerabilities

Preparing 4.1

six2dez3c0972308b4e
diff --git a/CHANGELOG.md b/CHANGELOG.md
index 7aefd8d..45a08fa 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -5,6 +5,31 @@ All notable changes to this project will be documented in this file.
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
+## [v4.1] - 2026-03-06
+
+### Added
+
+**Advanced Subdomain & Asset Discovery**
+- `sub_srv` function: SRV record enumeration (`_ldap._tcp`, `_sip._tcp`, `_xmpp-server._tcp`, etc.) via dnsx. Discovers service infrastructure hosts. Config: `SRV_ENUM=true`. Output: `subdomains/srv_records.txt`. Data file: `data/wordlists/srv_prefixes.txt` (~27 SRV prefixes).
+- `sub_ptr_cidrs` function: PTR sweep over ASN CIDR ranges discovered by `sub_asn`. Expands CIDRs via mapcidr, runs reverse PTR lookups via dnsx, filters in-scope results. Config: `PTR_SWEEP=false` (off by default), `PTR_SWEEP_MAX_IPS=50000` (safety limit). Output: `subdomains/ptr_pivots.txt`.
+- `sub_ns_delegation` function: discovers delegated DNS zones (subdomains with their own NS records) and attempts AXFR zone transfers on each delegated nameserver. Complements existing `zonetransfer()` which only checks the main domain's NS. Config: `NS_DELEGATION=true`. Output: `subdomains/ns_delegated_zones.txt`.
+- `tls_ip_pivots` function: TLS certificate harvesting from raw IPs (not just known subdomains like `sub_tls`). Three phases: (A) passive cert harvest extracting SAN/CN via `tlsx -json`, (B) SNI brute-force using discovered labels as candidates (DEEP mode only), (C) reverse PTR + SNI probing via `tlsx -rev-ptr-sni`. Includes delta-only httpx probe for newly discovered subdomains. Config: `TLS_IP_PIVOTS=false`, `TLS_IP_SNI_BATCH_SIZE=1000`, `TLS_IP_DELTA_PROBE=true`. Output: `hosts/tls_ip_certs.jsonl`, `subdomains/tls_ip_pivots.txt`.
+- `sub_js_extract` function: extracts hostnames from JS/crawl output files (`js/nojs_links.txt`, `js/js_livelinks.txt`, `webs/url_extract.txt`, `js/js_secrets.txt`, etc.), resolves new candidates, and delta-probes them. Creates a feedback loop from web analysis back into subdomain discovery. Config: `JS_SUB_EXTRACT=true`.
+- `well_known_pivots` function: checks well-known metadata endpoints (`/.well-known/security.txt`, `/.well-known/openid-configuration`, `/.well-known/oauth-authorization-server`) for hostname references matching the target domain. Config: `WELLKNOWN_PIVOTS=false`, `WELLKNOWN_MAX_TARGETS=200`.
+- Reactivated `virtualhosts()` in all scan modes (`recon`, `subs_menu`, `webs_menu`, `zen_menu`, multi-domain recon). Was previously commented out. Gated by existing `VIRTUALHOSTS=false` config flag.
+
+**Pipeline Integration**
+- Subdomain Phase 4 (parallel): added `sub_srv` and `sub_ptr_cidrs` alongside `sub_noerror` and `sub_dns`.
+- Subdomain Phase 5 (parallel): added `sub_ns_delegation` alongside `sub_tls` and `sub_analytics`.
+- Web Detection: added `tls_ip_pivots` and `virtualhosts` after portscan/geo_info in both parallel and sequential paths.
+- Web Analysis: added `sub_js_extract` and `well_known_pivots` after `jschecks`.
+- `passive()` mode: `PTR_SWEEP`, `NS_DELEGATION`, and `TLS_IP_PIVOTS` are saved/restored as `false` to prevent active techniques in passive-only mode.
+
+**Config Profiles**
+- Full profile (`reconftw_full.cfg`): enables `PTR_SWEEP`, `SRV_ENUM`, `NS_DELEGATION`, `TLS_IP_PIVOTS`, `JS_SUB_EXTRACT`, `WELLKNOWN_PIVOTS`.
+- Quick profile (`reconftw_quick.cfg`): enables only `SRV_ENUM` (lightweight); disables all others.
+- Stealth profile (`reconftw_stealth.cfg`): enables only `SRV_ENUM`; disables all active techniques.
+
## [v4.0] - 2026-02-20
### Added
diff --git a/config/reconftw_full.cfg b/config/reconftw_full.cfg
index 3ed8f7f..21d580b 100644
--- a/config/reconftw_full.cfg
+++ b/config/reconftw_full.cfg
@@ -37,6 +37,9 @@ SUBANALYTICS=true
SUBTAKEOVER=true
ZONETRANSFER=true
S3BUCKETS=true
+PTR_SWEEP=true
+SRV_ENUM=true
+NS_DELEGATION=true
CLOUD_ENUM_S3_PROFILE=optimized
CLOUD_ENUM_S3_THREADS=20
DEEP_WILDCARD_FILTER=true
@@ -45,6 +48,7 @@ DEEP_WILDCARD_FILTER=true
WEBPROBEFULL=true
WEBSCREENSHOT=true
VIRTUALHOSTS=true
+TLS_IP_PIVOTS=true
FAVIRECON=true
# Host
@@ -66,6 +70,8 @@ WAYMORE_LIMIT=10000
URL_GF=true
URL_EXT=true
JSCHECKS=true
+JS_SUB_EXTRACT=true
+WELLKNOWN_PIVOTS=true
# Fuzzing
FUZZ=true
diff --git a/config/reconftw_quick.cfg b/config/reconftw_quick.cfg
index f8b13a5..9801ed4 100644
--- a/config/reconftw_quick.cfg
+++ b/config/reconftw_quick.cfg
@@ -16,6 +16,12 @@ SUB_RECURSIVE_BRUTE=false
SUBNOERROR=false
ZONETRANSFER=false
DEEP_WILDCARD_FILTER=false
+PTR_SWEEP=false
+SRV_ENUM=true
+NS_DELEGATION=false
+TLS_IP_PIVOTS=false
+JS_SUB_EXTRACT=false
+WELLKNOWN_PIVOTS=false
# Web: probing enabled (full port set)
WEBPROBEFULL=true
diff --git a/config/reconftw_stealth.cfg b/config/reconftw_stealth.cfg
index 46f519f..27bcdd5 100644
--- a/config/reconftw_stealth.cfg
+++ b/config/reconftw_stealth.cfg
@@ -36,6 +36,12 @@ SUBANALYTICS=true
SUBTAKEOVER=false
ZONETRANSFER=false
S3BUCKETS=false
+PTR_SWEEP=false
+SRV_ENUM=true
+NS_DELEGATION=false
+TLS_IP_PIVOTS=false
+JS_SUB_EXTRACT=false
+WELLKNOWN_PIVOTS=false
CLOUD_ENUM_S3_PROFILE=optimized
CLOUD_ENUM_S3_THREADS=20
DEEP_WILDCARD_FILTER=false
diff --git a/config/tool_versions.txt b/config/tool_versions.txt
new file mode 100644
index 0000000..823212e
--- /dev/null
+++ b/config/tool_versions.txt
@@ -0,0 +1,128 @@
+# reconFTW Tool Version Manifest
+# Format: tool_name=version
+# Use "latest" or "HEAD" for unpinned tools (not recommended)
+# Update versions here to control what gets installed.
+#
+# To update a single tool: change its version, re-run install.sh --tools
+# To update all: review changelogs, bump versions, re-run install.sh
+
+# ============================================================
+# Go tools (installed via go install)
+# ============================================================
+gf=latest
+brutespray=v2.4.2
+qsreplace=v0.0.3
+ffuf=v2.1.0
+github-subdomains=v1.2.2
+gitlab-subdomains=v1.0.1
+nuclei=v3.7.0
+anew=v0.1.1
+notify=v1.0.7
+unfurl=v0.4.3
+httpx=v1.8.1
+github-endpoints=v1.2.2
+dnsx=v1.2.3
+subjs=v1.0.1
+Gxss=v4.1
+katana=v1.4.0
+crlfuzz=v1.4.1
+dalfox=v2.12.0
+puredns=v2.1.1
+interactsh-client=v1.3.0
+analyticsrelationships=latest
+gotator=v1.1
+roboxtractor=latest
+mapcidr=v1.1.97
+cdncheck=v1.2.25
+asnmap=v1.1.1
+dnstake=v0.1.1
+tlsx=v1.2.2
+gitdorks_go=v0.1
+smap=0.1.12
+dsieve=v1.2.0
+inscope=latest
+enumerepo=v1.0.0
+Web-Cache-Vulnerability-Scanner=2.0.0
+subfinder=v2.12.0
+hakip2host=latest
+mantra=v3.1
+crt=v0.1.0
+s3scanner=v3.1.1
+nmapurls=v1.0.0
+naabu=v2.4.0
+shortscan=v0.9.2
+hakoriginfinder=latest
+sourcemapper=latest
+jsluice=latest
+urlfinder=v0.0.3
+cent=v2.0.0
+csprecon=v0.4.3
+VhostFinder=v0.1.0
+misconfig-mapper=v1.15.2
+grpcurl=v1.9.3
+toxicache=latest
+favirecon=v1.0.2
+second-order=v3.2
+TInjA=1.2.0
+nerva=v1.0.0
+brutus=v1.1.0
+julius=v1.2.0
+titus=v1.1.3
+
+# ============================================================
+# Python/uv tools (installed via uv tool install git+https://...)
+# Format: tool_name=version (appended as @version to git URL)
+# Use "HEAD" for tools without release tags
+# ============================================================
+dnsvalidator=HEAD
+interlace=1.6
+wafw00f=v2.4.2
+commix=v4.1
+waymore=v8.6
+urless=v2.6
+ghauri=1.4.3
+xnLinkFinder=v8.1
+xnldorker=v4.1
+porch-pirate=HEAD
+p1radup=HEAD
+subwiz=v1.0.1
+arjun=2.2.7
+gqlspection=0.2.3
+postleaksNg=HEAD
+cewler=v1.4.1
+
+# ============================================================
+# Git repositories (cloned via git clone)
+# Format: repo_name=version (used with git checkout after clone)
+# Use "HEAD" for repos without release tags
+# ============================================================
+[repos]
+dorks_hunter=v1.0
+gf=HEAD
+Gf-Patterns=HEAD
+sus_params=HEAD
+CMSeeK=v.1.1.3
+massdns=v1.1.0
+testssl.sh=v3.2.3
+JSA=HEAD
+cloud_enum=0.7
+ultimate-nmap-parser=HEAD
+gitdorks_go=v0.1
+Web-Cache-Vulnerability-Scanner=2.0.0
+regulator=HEAD
+gitleaks=v8.30.0
+ghleaks=HEAD
+trufflehog=v3.93.6
+nomore403=v1.1.8
+SwaggerSpy=HEAD
+LeakSearch=HEAD
+ffufPostprocessing=HEAD
+misconfig-mapper=v1.15.2
+Spoofy=v1.0.3
+msftrecon=HEAD
+Scopify=HEAD
+metagoofil=v1.4.0
+EmailHarvester=1.3.2
+reconftw_ai=HEAD
+gato=1.7
+SSTImap=v1.3
diff --git a/data/wordlists/srv_prefixes.txt b/data/wordlists/srv_prefixes.txt
new file mode 100644
index 0000000..77f06f4
--- /dev/null
+++ b/data/wordlists/srv_prefixes.txt
@@ -0,0 +1,27 @@
+_ldap._tcp
+_kerberos._tcp
+_kerberos._udp
+_kpasswd._tcp
+_kpasswd._udp
+_sip._tcp
+_sip._udp
+_sips._tcp
+_xmpp-server._tcp
+_xmpp-client._tcp
+_jabber._tcp
+_h323cs._tcp
+_h323ls._udp
+_imap._tcp
+_imaps._tcp
+_submission._tcp
+_pop3._tcp
+_pop3s._tcp
+_caldav._tcp
+_carddav._tcp
+_autodiscover._tcp
+_stun._udp
+_turn._udp
+_gc._tcp
+_vlmcs._tcp
+_msdcs._tcp
+_ntp._udp
diff --git a/modules/modes.sh b/modules/modes.sh
index f19480c..2f4ff16 100644
--- a/modules/modes.sh
+++ b/modules/modes.sh
@@ -431,6 +431,8 @@ function passive() {
local _saved_SUBPERMUTE="${SUBPERMUTE:-}" _saved_SUBREGEXPERMUTE="${SUBREGEXPERMUTE:-}"
local _saved_SUB_RECURSIVE_BRUTE="${SUB_RECURSIVE_BRUTE:-}"
local _saved_PORTSCAN_ACTIVE="${PORTSCAN_ACTIVE:-}"
+ local _saved_PTR_SWEEP="${PTR_SWEEP:-}" _saved_NS_DELEGATION="${NS_DELEGATION:-}"
+ local _saved_TLS_IP_PIVOTS="${TLS_IP_PIVOTS:-}"
# shellcheck disable=SC2034 # These globals are consumed by downstream module functions
SUBNOERROR=false
@@ -446,6 +448,12 @@ function passive() {
SUBREGEXPERMUTE=false
# shellcheck disable=SC2034
SUB_RECURSIVE_BRUTE=false
+ # shellcheck disable=SC2034
+ PTR_SWEEP=false
+ # shellcheck disable=SC2034
+ NS_DELEGATION=false
+ # shellcheck disable=SC2034
+ TLS_IP_PIVOTS=false
if [[ $AXIOM == true ]]; then
axiom_launch
axiom_selected
@@ -477,6 +485,9 @@ function passive() {
SUBREGEXPERMUTE="${_saved_SUBREGEXPERMUTE}"
SUB_RECURSIVE_BRUTE="${_saved_SUB_RECURSIVE_BRUTE}"
PORTSCAN_ACTIVE="${_saved_PORTSCAN_ACTIVE}"
+ PTR_SWEEP="${_saved_PTR_SWEEP}"
+ NS_DELEGATION="${_saved_NS_DELEGATION}"
+ TLS_IP_PIVOTS="${_saved_TLS_IP_PIVOTS}"
end
}
@@ -791,13 +802,16 @@ function recon() {
fi
fi
geo_info
+ tls_ip_pivots
+ virtualhosts
else
run_module_with_axiom_failover screenshot
- # virtualhosts
run_module_with_axiom_failover cdnprovider
run_module_with_axiom_failover portscan
favirecon_tech
run_module_with_axiom_failover geo_info
+ tls_ip_pivots
+ virtualhosts
fi
ui_module_end "Web Detection" "webs/" "hosts/" "screenshots/"
@@ -822,6 +836,8 @@ function recon() {
run_module_with_axiom_failover iishortname
run_module_with_axiom_failover urlchecks
run_module_with_axiom_failover jschecks
+ sub_js_extract
+ well_known_pivots
websocket_checks
run_module_with_axiom_failover param_discovery
grpc_reflection
@@ -977,10 +993,11 @@ function multi_recon() {
run_module_with_axiom_failover subtakeover
remove_big_files
run_module_with_axiom_failover screenshot
- # virtualhosts
run_module_with_axiom_failover cdnprovider
run_module_with_axiom_failover portscan
run_module_with_axiom_failover geo_info
+ tls_ip_pivots
+ virtualhosts
currently=$(date +"%H:%M:%S")
loopend=$(date +%s)
getElapsedTime "$loopstart" "$loopend"
@@ -1177,7 +1194,8 @@ function subs_menu() {
run_module_with_axiom_failover webprobe_full
favirecon_tech
run_module_with_axiom_failover screenshot
- # virtualhosts
+ tls_ip_pivots
+ virtualhosts
if [[ $AXIOM == true ]]; then
axiom_shutdown
@@ -1194,7 +1212,7 @@ function webs_menu() {
run_module_with_axiom_failover subtakeover
remove_big_files
run_module_with_axiom_failover screenshot
- # virtualhosts
+ virtualhosts
_print_section "Web Analysis"
@@ -1207,6 +1225,8 @@ function webs_menu() {
run_module_with_axiom_failover urlchecks
run_module_with_axiom_failover param_discovery
run_module_with_axiom_failover jschecks
+ sub_js_extract
+ well_known_pivots
websocket_checks
url_gf
wordlist_gen
@@ -1237,7 +1257,8 @@ function zen_menu() {
run_module_with_axiom_failover webprobe_full
favirecon_tech
run_module_with_axiom_failover screenshot
- # virtualhosts
+ tls_ip_pivots
+ virtualhosts
run_module_with_axiom_failover cdnprovider
_print_section "Web Analysis"
diff --git a/modules/subdomains.sh b/modules/subdomains.sh
index c62bc4b..fe65b9a 100644
--- a/modules/subdomains.sh
+++ b/modules/subdomains.sh
@@ -288,7 +288,7 @@ _subdomains_enumerate() {
done
# Phase 4: Dependent active enrichment (runs after sub_active is ready)
- parallel_funcs "${PAR_SUB_DEP_ACTIVE_GROUP_SIZE:-3}" sub_noerror sub_dns
+ parallel_funcs "${PAR_SUB_DEP_ACTIVE_GROUP_SIZE:-3}" sub_noerror sub_dns sub_srv sub_ptr_cidrs
local sub_g4_rc=$?
if ((sub_g4_rc > 0)); then
if [[ "${CONTINUE_ON_TOOL_ERROR:-true}" == "true" ]]; then
@@ -300,7 +300,7 @@ _subdomains_enumerate() {
fi
# Phase 5: Post-active analysis (depends on active/enrichment results)
- parallel_funcs "${PAR_SUB_POST_ACTIVE_GROUP_SIZE:-2}" sub_tls sub_analytics
+ parallel_funcs "${PAR_SUB_POST_ACTIVE_GROUP_SIZE:-2}" sub_tls sub_analytics sub_ns_delegation
local sub_g5_rc=$?
if ((sub_g5_rc > 0)); then
if [[ "${CONTINUE_ON_TOOL_ERROR:-true}" == "true" ]]; then
@@ -323,6 +323,7 @@ _subdomains_enumerate() {
sub_active
sub_tls
sub_noerror
+ sub_srv
sub_brute
sub_permut
sub_regex_permut
@@ -330,8 +331,10 @@ _subdomains_enumerate() {
sub_recursive_passive
sub_recursive_brute
sub_dns
+ sub_ptr_cidrs
sub_scraping
sub_analytics
+ sub_ns_delegation
fi
}
@@ -841,6 +844,74 @@ function sub_noerror() {
}
+function sub_srv() {
+ ensure_dirs .tmp subdomains
+
+ if { [[ ! -f "$called_fn_dir/.${FUNCNAME[0]}" ]] || [[ $DIFF == true ]]; } && [[ ${SRV_ENUM:-true} == true ]]; then
+ start_subfunc "${FUNCNAME[0]}" "Running: SRV Record Enumeration"
+
+ local srv_prefixes="${WORDLISTS_DIR}/srv_prefixes.txt"
+ if [[ ! -s "$srv_prefixes" ]]; then
+ _print_msg WARN "SRV prefixes file not found: ${srv_prefixes}; skipping."
+ end_subfunc "0 new subs (srv enum)" "${FUNCNAME[0]}" "SKIP"
+ return
+ fi
+
+ # Build SRV query list: prefix.domain for each prefix
+ : >.tmp/srv_queries.txt
+ while IFS= read -r prefix; do
+ [[ -z "$prefix" || "$prefix" =~ ^[[:space:]]*# ]] && continue
+ printf '%s.%s\n' "$prefix" "$domain" >> .tmp/srv_queries.txt
+ done < "$srv_prefixes"
+
+ if [[ ! -s ".tmp/srv_queries.txt" ]]; then
+ end_subfunc "0 new subs (srv enum)" "${FUNCNAME[0]}" "SKIP"
+ return
+ fi
+
+ # Query SRV records via dnsx
+ : >.tmp/srv_results_raw.txt
+ run_command dnsx -srv -resp -silent -retry 2 \
+ -t "${DNSX_THREADS:-100}" -rl "${DNSX_RATE_LIMIT:-500}" \
+ -r "$resolvers_trusted" \
+ <.tmp/srv_queries.txt >.tmp/srv_results_raw.txt 2>>"$LOGFILE" || true
+
+ # Parse SRV target hostnames from output
+ : >.tmp/srv_hosts.txt
+ if [[ -s ".tmp/srv_results_raw.txt" ]]; then
+ # Save raw data for analysis
+ cp .tmp/srv_results_raw.txt subdomains/srv_records.txt
+
+ # Extract hostnames, filter in-scope
+ grep -aoE '[a-zA-Z0-9][-a-zA-Z0-9]*(\.[a-zA-Z0-9][-a-zA-Z0-9]*)+' .tmp/srv_results_raw.txt \
+ | sed -e 's/\.$//' -e '/^$/d' \
+ | grep -E '^([a-zA-Z0-9][-a-zA-Z0-9]*\.)+[a-zA-Z]{2,}$' \
+ | grep -E "$DOMAIN_MATCH_REGEX" \
+ | sort -u >.tmp/srv_hosts.txt || true
+ fi
+
+ if [[ $INSCOPE == true ]] && [[ -s ".tmp/srv_hosts.txt" ]]; then
+ if ! check_inscope .tmp/srv_hosts.txt 2>>"$LOGFILE" >/dev/null; then
+ print_warnf "check_inscope command failed."
+ fi
+ fi
+
+ NUMOFLINES=0
+ if [[ -s ".tmp/srv_hosts.txt" ]]; then
+ NUMOFLINES=$(anew subdomains/subdomains.txt <.tmp/srv_hosts.txt | sed '/^$/d' | wc -l | tr -d ' ' || true)
+ [[ "$NUMOFLINES" =~ ^[0-9]+$ ]] || NUMOFLINES=0
+ fi
+
+ end_subfunc "${NUMOFLINES} new subs (srv enum)" "${FUNCNAME[0]}"
+ else
+ if [[ ${SRV_ENUM:-true} == false ]]; then
+ skip_notification "disabled"
+ else
+ skip_notification "processed"
+ fi
+ fi
+}
+
function sub_dns() {
ensure_dirs .tmp subdomains hosts
@@ -925,6 +996,78 @@ function sub_dns() {
fi
}
+function sub_ptr_cidrs() {
+ ensure_dirs .tmp subdomains hosts
+
+ if { [[ ! -f "$called_fn_dir/.${FUNCNAME[0]}" ]] || [[ $DIFF == true ]]; } && [[ ${PTR_SWEEP:-false} == true ]]; then
+ start_subfunc "${FUNCNAME[0]}" "Running: PTR Sweep over ASN CIDRs"
+
+ if [[ ! -s "hosts/asn_cidrs.txt" ]]; then
+ _print_msg WARN "No ASN CIDRs available (hosts/asn_cidrs.txt missing); skipping PTR sweep."
+ end_subfunc "0 new subs (ptr sweep)" "${FUNCNAME[0]}" "SKIP"
+ return
+ fi
+
+ if ! command -v mapcidr &>/dev/null; then
+ _print_msg WARN "mapcidr not found; skipping CIDR expansion for PTR sweep."
+ end_subfunc "0 new subs (ptr sweep)" "${FUNCNAME[0]}" "SKIP"
+ return
+ fi
+
+ # Expand CIDRs to IPs with safety limit
+ local max_ips="${PTR_SWEEP_MAX_IPS:-50000}"
+ : >.tmp/ptr_ips_expanded.txt
+ mapcidr -silent <hosts/asn_cidrs.txt 2>>"$LOGFILE" \
+ | head -n "$max_ips" >.tmp/ptr_ips_expanded.txt || true
+
+ local expanded_count
+ expanded_count=$(wc -l <.tmp/ptr_ips_expanded.txt 2>/dev/null | tr -d ' ')
+ if [[ "${expanded_count:-0}" -eq 0 ]]; then
+ end_subfunc "0 new subs (ptr sweep - empty expansion)" "${FUNCNAME[0]}" "SKIP"
+ return
+ fi
+ _print_msg INFO "PTR sweep: scanning ${expanded_count} IPs from ASN CIDRs (limit: ${max_ips})"
+
+ # PTR lookups via dnsx
+ : >.tmp/ptr_results_raw.txt
+ run_command dnsx -ptr -resp-only -silent -retry 2 \
+ -t "${DNSX_THREADS:-100}" -rl "${DNSX_RATE_LIMIT:-500}" \
+ -r "$resolvers_trusted" \
+ <.tmp/ptr_ips_expanded.txt >.tmp/ptr_results_raw.txt 2>>"$LOGFILE" || true
+
+ # Filter in-scope, save raw + merged
+ : >.tmp/ptr_inscope.txt
+ if [[ -s ".tmp/ptr_results_raw.txt" ]]; then
+ sed -e 's/\.$//' -e '/^$/d' .tmp/ptr_results_raw.txt \
+ | grep -E '^([a-zA-Z0-9][-a-zA-Z0-9]*\.)+[a-zA-Z]{2,}$' \
+ | sort -u >subdomains/ptr_pivots.txt || true
+
+ grep -E "$DOMAIN_MATCH_REGEX" subdomains/ptr_pivots.txt \
+ >.tmp/ptr_inscope.txt 2>/dev/null || true
+ fi
+
+ if [[ $INSCOPE == true ]] && [[ -s ".tmp/ptr_inscope.txt" ]]; then
+ if ! check_inscope .tmp/ptr_inscope.txt 2>>"$LOGFILE" >/dev/null; then
+ print_warnf "check_inscope command failed."
+ fi
+ fi
+
+ NUMOFLINES=0
+ if [[ -s ".tmp/ptr_inscope.txt" ]]; then
+ NUMOFLINES=$(anew subdomains/subdomains.txt <.tmp/ptr_inscope.txt | sed '/^$/d' | wc -l | tr -d ' ' || true)
+ [[ "$NUMOFLINES" =~ ^[0-9]+$ ]] || NUMOFLINES=0
+ fi
+
+ end_subfunc "${NUMOFLINES} new subs (ptr sweep)" "${FUNCNAME[0]}"
+ else
+ if [[ ${PTR_SWEEP:-false} == false ]]; then
+ skip_notification "disabled"
+ else
+ skip_notification "processed"
+ fi
+ fi
+}
+
function sub_brute() {
ensure_dirs .tmp subdomains
@@ -1246,6 +1389,90 @@ function sub_analytics() {
fi
}
+function sub_ns_delegation() {
+ ensure_dirs .tmp subdomains
+
+ if { [[ ! -f "$called_fn_dir/.${FUNCNAME[0]}" ]] || [[ $DIFF == true ]]; } && [[ ${NS_DELEGATION:-true} == true ]]; then
+ start_subfunc "${FUNCNAME[0]}" "Running: NS Delegation Zone Transfer Check"
+
+ if [[ ! -s "subdomains/subdomains.txt" ]]; then
+ _print_msg WARN "No subdomains available for NS delegation check; skipping."
+ end_subfunc "0 new subs (ns delegation)" "${FUNCNAME[0]}" "SKIP"
+ return
+ fi
+
+ # Check NS records for each known subdomain
+ : >.tmp/ns_delegation_raw.txt
+ run_command dnsx -ns -resp -silent -retry 2 \
+ -t "${DNSX_THREADS:-100}" -rl "${DNSX_RATE_LIMIT:-500}" \
+ -r "$resolvers_trusted" \
+ <subdomains/subdomains.txt >.tmp/ns_delegation_raw.txt 2>>"$LOGFILE" || true
+
+ if [[ ! -s ".tmp/ns_delegation_raw.txt" ]]; then
+ end_subfunc "0 new subs (ns delegation - no NS records)" "${FUNCNAME[0]}" "SKIP"
+ return
+ fi
+
+ # Parse delegated zones and attempt AXFR on each
+ : >.tmp/ns_delegated_zones.txt
+ : >.tmp/ns_axfr_results.txt
+
+ while IFS= read -r line; do
+ local sub ns_raw
+ sub=$(echo "$line" | awk '{print $1}')
+ # Skip the base domain itself (already checked by zonetransfer())
+ [[ "$sub" == "$domain" ]] && continue
+ # Extract NS hostnames from the bracketed response
+ ns_raw=$(echo "$line" | grep -aoE '[a-zA-Z0-9][-a-zA-Z0-9]*(\.[a-zA-Z0-9][-a-zA-Z0-9]*)+' | tail -n +2)
+ if [[ -n "$ns_raw" ]]; then
+ echo "$sub" >> .tmp/ns_delegated_zones.txt
+ # Attempt AXFR on each delegated NS
+ while IFS= read -r ns; do
+ [[ -z "$ns" ]] && continue
+ dig axfr "$sub" @"$ns" +short 2>>"$LOGFILE" \
+ | awk '{print $1}' \
+ | sed -e 's/\.$//' -e '/^$/d' \
+ >> .tmp/ns_axfr_results.txt || true
+ done <<< "$ns_raw"
+ fi
+ done < .tmp/ns_delegation_raw.txt
+
+ # Save delegation info
+ if [[ -s ".tmp/ns_delegated_zones.txt" ]]; then
+ sort -u .tmp/ns_delegated_zones.txt -o subdomains/ns_delegated_zones.txt
+ fi
+
+ # Filter and merge AXFR results
+ NUMOFLINES=0
+ if [[ -s ".tmp/ns_axfr_results.txt" ]]; then
+ grep -E '^([a-zA-Z0-9][-a-zA-Z0-9]*\.)+[a-zA-Z]{2,}$' .tmp/ns_axfr_results.txt \
+ | grep -E "$DOMAIN_MATCH_REGEX" \
+ | sort -u >.tmp/ns_axfr_inscope.txt 2>/dev/null || true
+
+ if [[ $INSCOPE == true ]] && [[ -s ".tmp/ns_axfr_inscope.txt" ]]; then
+ if ! check_inscope .tmp/ns_axfr_inscope.txt 2>>"$LOGFILE" >/dev/null; then
+ print_warnf "check_inscope command failed."
+ fi
+ fi
+
+ if [[ -s ".tmp/ns_axfr_inscope.txt" ]]; then
+ NUMOFLINES=$(anew subdomains/subdomains.txt <.tmp/ns_axfr_inscope.txt | sed '/^$/d' | wc -l | tr -d ' ' || true)
+ [[ "$NUMOFLINES" =~ ^[0-9]+$ ]] || NUMOFLINES=0
+ fi
+ fi
+
+ local delegated_count
+ delegated_count=$(wc -l <subdomains/ns_delegated_zones.txt 2>/dev/null | tr -d ' ')
+ end_subfunc "${NUMOFLINES} new subs (ns delegation, ${delegated_count:-0} delegated zones)" "${FUNCNAME[0]}"
+ else
+ if [[ ${NS_DELEGATION:-true} == false ]]; then
+ skip_notification "disabled"
+ else
+ skip_notification "processed"
+ fi
+ fi
+}
+
_select_permutations_wordlist() {
local source_file="$1"
local full_list="${WORDLISTS_DIR}/permutations_list.txt"
diff --git a/modules/web.sh b/modules/web.sh
index 35a7d62..ebb8939 100644
--- a/modules/web.sh
+++ b/modules/web.sh
@@ -380,6 +380,160 @@ function virtualhosts() {
}
+function tls_ip_pivots() {
+ ensure_dirs .tmp subdomains hosts webs
+
+ if { [[ ! -f "$called_fn_dir/.${FUNCNAME[0]}" ]] || [[ $DIFF == true ]]; } && [[ ${TLS_IP_PIVOTS:-false} == true ]]; then
+ start_func "${FUNCNAME[0]}" "TLS Certificate Harvesting from IPs"
+
+ # Collect IP sources
+ : >.tmp/tls_ip_targets.txt
+ [[ -s "hosts/ips.txt" ]] && cat hosts/ips.txt >> .tmp/tls_ip_targets.txt
+ [[ -s "hosts/origin_ips.txt" ]] && cat hosts/origin_ips.txt >> .tmp/tls_ip_targets.txt
+ sort -u .tmp/tls_ip_targets.txt -o .tmp/tls_ip_targets.txt
+
+ if [[ ! -s ".tmp/tls_ip_targets.txt" ]]; then
+ end_func "No IPs available for TLS IP pivoting" "${FUNCNAME[0]}" "SKIP_NOINPUT"
+ return
+ fi
+
+ local ip_count tls_ports batch_size
+ ip_count=$(wc -l <.tmp/tls_ip_targets.txt | tr -d ' ')
+ tls_ports="${TLS_PORTS:-443}"
+ batch_size="${TLS_IP_SNI_BATCH_SIZE:-1000}"
+ _print_msg INFO "TLS IP pivots: scanning ${ip_count} IPs for certificates"
+
+ # Phase A: Passive cert harvest — extract SAN/CN from TLS certs on IPs
+ : >hosts/tls_ip_certs.jsonl
+ if [[ $AXIOM != true ]]; then
+ run_command tlsx -san -cn -silent -ro -resp-only \
+ -p "$tls_ports" \
+ -c "$TLSX_THREADS" \
+ -json \
+ <.tmp/tls_ip_targets.txt \
+ >hosts/tls_ip_certs.jsonl 2>>"$LOGFILE" || true
+ else
+ run_command axiom-scan .tmp/tls_ip_targets.txt -m tlsx \
+ -san -cn -silent -ro -resp-only \
+ -p "$tls_ports" \
+ -c "$TLSX_THREADS" \
+ -json \
+ -o hosts/tls_ip_certs.jsonl $AXIOM_EXTRA_ARGS 2>>"$LOGFILE" >/dev/null
+ fi
+
+ # Extract hostnames from SAN/CN in JSONL
+ : >.tmp/tls_ip_sans_all.txt
+ if [[ -s "hosts/tls_ip_certs.jsonl" ]]; then
+ jq -r '
+ (.subject_cn // empty),
+ (.subject_an[]? // empty)
+ ' hosts/tls_ip_certs.jsonl 2>/dev/null \
+ | sed -e 's/^\*\.//' -e 's/\.$//' -e '/^$/d' \
+ | grep -E '^([a-zA-Z0-9][-a-zA-Z0-9]*\.)+[a-zA-Z]{2,}$' \
+ | sort -u >.tmp/tls_ip_sans_all.txt || true
+ fi
+
+ # Phase B: SNI brute — use discovered labels + domain as SNI candidates (only in DEEP mode)
+ : >.tmp/tls_ip_sni_results.txt
+ if [[ -s ".tmp/tls_ip_sans_all.txt" ]] && [[ ${DEEP:-false} == true ]]; then
+ # Build SNI candidate list from discovered names + existing subdomains
+ : >.tmp/tls_ip_sni_candidates.txt
+ cat .tmp/tls_ip_sans_all.txt >> .tmp/tls_ip_sni_candidates.txt
+ [[ -s "subdomains/subdomains.txt" ]] && cat subdomains/subdomains.txt >> .tmp/tls_ip_sni_candidates.txt
+ sort -u .tmp/tls_ip_sni_candidates.txt -o .tmp/tls_ip_sni_candidates.txt
+
+ head -n "$batch_size" .tmp/tls_ip_targets.txt \
+ | run_command tlsx -san -cn -silent -ro -resp-only \
+ -p "$tls_ports" \
+ -c "$TLSX_THREADS" \
+ -sni-file .tmp/tls_ip_sni_candidates.txt \
+ >.tmp/tls_ip_sni_results.txt 2>>"$LOGFILE" || true
+ fi
+
+ # Phase C: Reverse PTR + SNI probing
+ if [[ -s ".tmp/tls_ip_targets.txt" ]]; then
+ head -n "$batch_size" .tmp/tls_ip_targets.txt \
+ | run_command tlsx -san -cn -silent -ro -resp-only \
+ -rev-ptr-sni \
+ -p "$tls_ports" \
+ -c "$TLSX_THREADS" \
+ >>.tmp/tls_ip_sni_results.txt 2>>"$LOGFILE" || true
+ fi
+
+ # Merge all discovered hostnames
+ : >.tmp/tls_ip_all_hosts.txt
+ [[ -s ".tmp/tls_ip_sans_all.txt" ]] && cat .tmp/tls_ip_sans_all.txt >> .tmp/tls_ip_all_hosts.txt
+ if [[ -s ".tmp/tls_ip_sni_results.txt" ]]; then
+ sed -e 's/^\*\.//' -e 's/\.$//' -e '/^$/d' .tmp/tls_ip_sni_results.txt \
+ | grep -E '^([a-zA-Z0-9][-a-zA-Z0-9]*\.)+[a-zA-Z]{2,}$' \
+ >> .tmp/tls_ip_all_hosts.txt 2>/dev/null || true
+ fi
+ sort -u .tmp/tls_ip_all_hosts.txt -o .tmp/tls_ip_all_hosts.txt
+
+ # Filter in-scope
+ : >subdomains/tls_ip_pivots.txt
+ if [[ -s ".tmp/tls_ip_all_hosts.txt" ]]; then
+ grep -E "$DOMAIN_MATCH_REGEX" .tmp/tls_ip_all_hosts.txt \
+ | sort -u >subdomains/tls_ip_pivots.txt 2>/dev/null || true
+ fi
+
+ if [[ $INSCOPE == true ]] && [[ -s "subdomains/tls_ip_pivots.txt" ]]; then
+ if ! check_inscope subdomains/tls_ip_pivots.txt 2>>"$LOGFILE" >/dev/null; then
+ print_warnf "check_inscope command failed."
+ fi
+ fi
+
+ # Resolve new candidates and merge
+ NUMOFLINES=0
+ if [[ -s "subdomains/tls_ip_pivots.txt" ]]; then
+ : >.tmp/tls_ip_pivots_resolved.txt
+ if [[ $AXIOM != true ]]; then
+ _resolve_domains subdomains/tls_ip_pivots.txt .tmp/tls_ip_pivots_resolved.txt
+ else
+ run_command axiom-scan subdomains/tls_ip_pivots.txt -m puredns-resolve \
+ -r "${AXIOM_RESOLVERS_PATH}" --resolvers-trusted "${AXIOM_RESOLVERS_TRUSTED_PATH}" \
+ --wildcard-tests "$PUREDNS_WILDCARDTEST_LIMIT" --wildcard-batch "$PUREDNS_WILDCARDBATCH_LIMIT" \
+ -o .tmp/tls_ip_pivots_resolved.txt "$AXIOM_EXTRA_ARGS" 2>>"$LOGFILE" >/dev/null
+ fi
+
+ if [[ -s ".tmp/tls_ip_pivots_resolved.txt" ]]; then
+ NUMOFLINES=$(anew subdomains/subdomains.txt <.tmp/tls_ip_pivots_resolved.txt | sed '/^$/d' | wc -l | tr -d ' ' || true)
+ [[ "$NUMOFLINES" =~ ^[0-9]+$ ]] || NUMOFLINES=0
+ fi
+ fi
+
+ # Delta probe: run targeted httpx on new subs only
+ if [[ ${TLS_IP_DELTA_PROBE:-true} == true ]] && [[ ${NUMOFLINES:-0} -gt 0 ]] && [[ -s ".tmp/tls_ip_pivots_resolved.txt" ]]; then
+ _print_msg INFO "TLS IP pivots: delta-probing ${NUMOFLINES} new subdomains"
+ # Identify genuinely new subs by comparing against pre-existing list
+ if [[ -s ".tmp/subdomains_old.txt" ]]; then
+ comm -23 <(sort -u .tmp/tls_ip_pivots_resolved.txt) \
+ <(sort -u .tmp/subdomains_old.txt) \
+ >.tmp/tls_ip_delta_subs.txt 2>/dev/null || true
+ else
+ cp .tmp/tls_ip_pivots_resolved.txt .tmp/tls_ip_delta_subs.txt
+ fi
+
+ if [[ -s ".tmp/tls_ip_delta_subs.txt" ]]; then
+ run_command httpx -follow-host-redirects -random-agent -silent \
+ -status-code -p "${WEBPROBE_PORTS:-80,443}" \
+ -threads "${HTTPX_THREADS:-50}" -rl "${HTTPX_RATELIMIT:-0}" \
+ -timeout "${HTTPX_TIMEOUT:-10}" -retries 2 -no-color \
+ <.tmp/tls_ip_delta_subs.txt \
+ | awk '{print $1}' | anew -q webs/webs.txt 2>/dev/null || true
+ fi
+ fi
+
+ end_func "${NUMOFLINES} new subs (tls ip pivots)" "${FUNCNAME[0]}"
+ else
+ if [[ ${TLS_IP_PIVOTS:-false} == false ]]; then
+ skip_notification "disabled"
+ else
+ skip_notification "processed"
+ fi
+ fi
+}
+
###############################################################################################################
############################################# HOST SCAN #######################################################
###############################################################################################################
@@ -2040,6 +2194,182 @@ function jschecks() {
}
+function sub_js_extract() {
+ ensure_dirs .tmp subdomains webs
+
+ if { [[ ! -f "$called_fn_dir/.${FUNCNAME[0]}" ]] || [[ $DIFF == true ]]; } && [[ ${JS_SUB_EXTRACT:-true} == true ]]; then
+ start_func "${FUNCNAME[0]}" "Hostname extraction from JS/crawl outputs"
+
+ : >.tmp/js_extracted_hosts.txt
+
+ # Extract hostnames from URLs in JS/crawl output files
+ for f in js/nojs_links.txt js/js_livelinks.txt .tmp/subjslinks.txt .tmp/katana.txt webs/url_extract.txt; do
+ if [[ -s "$f" ]]; then
+ grep -aoE 'https?://[a-zA-Z0-9][-a-zA-Z0-9]*(\.[a-zA-Z0-9][-a-zA-Z0-9]*)+' "$f" \
+ | sed -E 's|^https?://||' \
+ | sed -E 's|[:/].*||' \
+ | grep -E "$DOMAIN_MATCH_REGEX" \
+ >> .tmp/js_extracted_hosts.txt 2>/dev/null || true
+ fi
+ done
+
+ # Extract hostnames from JS secrets files (may reference internal hosts)
+ for f in js/js_secrets.txt js/js_secrets_jsmap.txt; do
+ if [[ -s "$f" ]]; then
+ grep -aoE '[a-zA-Z0-9][-a-zA-Z0-9]*(\.[a-zA-Z0-9][-a-zA-Z0-9]*)+' "$f" \
+ | grep -E "$DOMAIN_MATCH_REGEX" \
+ >> .tmp/js_extracted_hosts.txt 2>/dev/null || true
+ fi
+ done
+
+ if [[ ! -s ".tmp/js_extracted_hosts.txt" ]]; then
+ end_func "No hostnames found in JS/crawl outputs" "${FUNCNAME[0]}" "SKIP_NOINPUT"
+ return
+ fi
+
+ # Deduplicate and filter valid domains
+ sort -u .tmp/js_extracted_hosts.txt \
+ | grep -E '^([a-zA-Z0-9][-a-zA-Z0-9]*\.)+[a-zA-Z]{2,}$' \
+ >.tmp/js_extracted_hosts_clean.txt 2>/dev/null || true
+
+ # Remove already-known subdomains
+ if [[ -s "subdomains/subdomains.txt" ]] && [[ -s ".tmp/js_extracted_hosts_clean.txt" ]]; then
+ comm -23 <(sort -u .tmp/js_extracted_hosts_clean.txt) \
+ <(sort -u subdomains/subdomains.txt) \
+ >.tmp/js_extracted_hosts_new.txt 2>/dev/null || true
+ else
+ cp .tmp/js_extracted_hosts_clean.txt .tmp/js_extracted_hosts_new.txt 2>/dev/null || true
+ fi
+
+ NUMOFLINES=0
+ if [[ -s ".tmp/js_extracted_hosts_new.txt" ]]; then
+ # Resolve to validate
+ : >.tmp/js_extracted_hosts_resolved.txt
+ if [[ $AXIOM != true ]]; then
+ _resolve_domains .tmp/js_extracted_hosts_new.txt .tmp/js_extracted_hosts_resolved.txt
+ else
+ run_command axiom-scan .tmp/js_extracted_hosts_new.txt -m puredns-resolve \
+ -r "${AXIOM_RESOLVERS_PATH}" --resolvers-trusted "${AXIOM_RESOLVERS_TRUSTED_PATH}" \
+ --wildcard-tests "$PUREDNS_WILDCARDTEST_LIMIT" --wildcard-batch "$PUREDNS_WILDCARDBATCH_LIMIT" \
+ -o .tmp/js_extracted_hosts_resolved.txt "$AXIOM_EXTRA_ARGS" 2>>"$LOGFILE" >/dev/null
+ fi
+
+ if [[ -s ".tmp/js_extracted_hosts_resolved.txt" ]]; then
+ NUMOFLINES=$(anew subdomains/subdomains.txt <.tmp/js_extracted_hosts_resolved.txt | sed '/^$/d' | wc -l | tr -d ' ' || true)
+ [[ "$NUMOFLINES" =~ ^[0-9]+$ ]] || NUMOFLINES=0
+
+ # Delta probe new subs
+ if [[ $NUMOFLINES -gt 0 ]]; then
+ _print_msg INFO "JS extract: delta-probing ${NUMOFLINES} new subdomains"
+ run_command httpx -follow-host-redirects -random-agent -silent \
+ -status-code -p "${WEBPROBE_PORTS:-80,443}" \
+ -threads "${HTTPX_THREADS:-50}" -rl "${HTTPX_RATELIMIT:-0}" \
+ -timeout "${HTTPX_TIMEOUT:-10}" -retries 2 -no-color \
+ <.tmp/js_extracted_hosts_resolved.txt \
+ | awk '{print $1}' | anew -q webs/webs.txt 2>/dev/null || true
+ fi
+ fi
+ fi
+
+ end_func "${NUMOFLINES} new subs from JS/crawl extraction" "${FUNCNAME[0]}"
+ else
+ if [[ ${JS_SUB_EXTRACT:-true} == false ]]; then
+ skip_notification "disabled"
+ else
+ skip_notification "processed"
+ fi
+ fi
+}
+
+function well_known_pivots() {
+ ensure_dirs .tmp subdomains webs
+
+ if { [[ ! -f "$called_fn_dir/.${FUNCNAME[0]}" ]] || [[ $DIFF == true ]]; } && [[ ${WELLKNOWN_PIVOTS:-false} == true ]]; then
+ start_func "${FUNCNAME[0]}" "Well-known metadata endpoint pivots"
+
+ ensure_webs_all || true
+
+ if [[ ! -s "webs/webs_all.txt" ]]; then
+ end_func "No web targets for well-known pivots" "${FUNCNAME[0]}" "SKIP_NOINPUT"
+ return
+ fi
+
+ : >.tmp/wellknown_hosts.txt
+ local max_targets="${WELLKNOWN_MAX_TARGETS:-200}"
+
+ head -n "$max_targets" webs/webs_all.txt | while IFS= read -r url; do
+ [[ -z "$url" ]] && continue
+
+ # security.txt (RFC 9116)
+ local resp
+ for path in "/.well-known/security.txt" "/security.txt"; do
+ resp=$(curl -s -m 5 -L "${url}${path}" 2>/dev/null || true)
+ if [[ -n "$resp" ]]; then
+ echo "$resp" \
+ | grep -aoE '[a-zA-Z0-9][-a-zA-Z0-9]*(\.[a-zA-Z0-9][-a-zA-Z0-9]*)+' \
+ | grep -E "$DOMAIN_MATCH_REGEX" \
+ >> .tmp/wellknown_hosts.txt 2>/dev/null || true
+ fi
+ done
+
+ # OpenID Configuration
+ local oidc_resp
+ oidc_resp=$(curl -s -m 5 -L "${url}/.well-known/openid-configuration" 2>/dev/null || true)
+ if [[ -n "$oidc_resp" ]] && echo "$oidc_resp" | jq -e . >/dev/null 2>&1; then
+ echo "$oidc_resp" | jq -r '.. | strings' 2>/dev/null \
+ | grep -aoE '[a-zA-Z0-9][-a-zA-Z0-9]*(\.[a-zA-Z0-9][-a-zA-Z0-9]*)+' \
+ | grep -E "$DOMAIN_MATCH_REGEX" \
+ >> .tmp/wellknown_hosts.txt 2>/dev/null || true
+ fi
+
+ # OAuth authorization server metadata (RFC 8414)
+ local oauth_resp
+ oauth_resp=$(curl -s -m 5 -L "${url}/.well-known/oauth-authorization-server" 2>/dev/null || true)
+ if [[ -n "$oauth_resp" ]] && echo "$oauth_resp" | jq -e . >/dev/null 2>&1; then
+ echo "$oauth_resp" | jq -r '.. | strings' 2>/dev/null \
+ | grep -aoE '[a-zA-Z0-9][-a-zA-Z0-9]*(\.[a-zA-Z0-9][-a-zA-Z0-9]*)+' \
+ | grep -E "$DOMAIN_MATCH_REGEX" \
+ >> .tmp/wellknown_hosts.txt 2>/dev/null || true
+ fi
+ done
+
+ NUMOFLINES=0
+ if [[ -s ".tmp/wellknown_hosts.txt" ]]; then
+ sort -u .tmp/wellknown_hosts.txt \
+ | grep -E '^([a-zA-Z0-9][-a-zA-Z0-9]*\.)+[a-zA-Z]{2,}$' \
+ >.tmp/wellknown_hosts_clean.txt 2>/dev/null || true
+
+ # Remove already known
+ if [[ -s "subdomains/subdomains.txt" ]]; then
+ comm -23 <(sort -u .tmp/wellknown_hosts_clean.txt) \
+ <(sort -u subdomains/subdomains.txt) \
+ >.tmp/wellknown_hosts_new.txt 2>/dev/null || true
+ else
+ cp .tmp/wellknown_hosts_clean.txt .tmp/wellknown_hosts_new.txt 2>/dev/null || true
+ fi
+
+ if [[ -s ".tmp/wellknown_hosts_new.txt" ]]; then
+ # Resolve
+ : >.tmp/wellknown_hosts_resolved.txt
+ _resolve_domains .tmp/wellknown_hosts_new.txt .tmp/wellknown_hosts_resolved.txt
+
+ if [[ -s ".tmp/wellknown_hosts_resolved.txt" ]]; then
+ NUMOFLINES=$(anew subdomains/subdomains.txt <.tmp/wellknown_hosts_resolved.txt | sed '/^$/d' | wc -l | tr -d ' ' || true)
+ [[ "$NUMOFLINES" =~ ^[0-9]+$ ]] || NUMOFLINES=0
+ fi
+ fi
+ fi
+
+ end_func "${NUMOFLINES} new subs from well-known endpoints" "${FUNCNAME[0]}"
+ else
+ if [[ ${WELLKNOWN_PIVOTS:-false} == false ]]; then
+ skip_notification "disabled"
+ else
+ skip_notification "processed"
+ fi
+ fi
+}
+
function websocket_checks() {
mkdir -p webs vulns .tmp
diff --git a/reconftw.cfg b/reconftw.cfg
index 335e458..057c41b 100644
--- a/reconftw.cfg
+++ b/reconftw.cfg
@@ -162,12 +162,19 @@ ZONETRANSFER=true # Check zone transfer
S3BUCKETS=true # Check S3 buckets misconfigs
REVERSE_IP=false # Check reverse IP subdomain search (set True if your target is CIDR/IP)
TLS_PORTS=$(cat "${SCRIPTPATH}/config/tls_ports.txt" 2>/dev/null | tr -d '\n') # TLS ports for certificate grabbing
-INSCOPE=false # Uses inscope tool to filter the scope, requires .scope file in reconftw folder
+PTR_SWEEP=false # Reverse PTR sweep over ASN CIDRs (can be slow on large ranges)
+PTR_SWEEP_MAX_IPS=50000 # Safety limit: maximum IPs to expand from CIDRs for PTR sweep
+SRV_ENUM=true # SRV record enumeration for service discovery (~25 DNS queries)
+NS_DELEGATION=true # Check NS delegation and attempt AXFR on delegated subdomains
+INSCOPE=false # Uses inscope tool to filter the scope, requires .scope file in reconftw folder
# Web detection
WEBPROBEFULL=true # Unified web probing over configured ports
WEBSCREENSHOT=true # Webs screenshooting
VIRTUALHOSTS=false # Check virtualhosts by fuzzing HOST header
+TLS_IP_PIVOTS=false # Harvest TLS certificates from discovered IPs for new subdomains
+TLS_IP_SNI_BATCH_SIZE=1000 # Max IPs to SNI-probe in a single batch
+TLS_IP_DELTA_PROBE=true # Run targeted httpx on newly discovered subs from TLS pivoting
UNCOMMON_PORTS_WEB=$(cat "${SCRIPTPATH}/config/uncommon_ports_web.txt" 2>/dev/null | tr -d '\n') # Uncommon web ports for full probing
WEBPROBE_PORTS="80,443,${UNCOMMON_PORTS_WEB}" # Ports used by webprobe_full
@@ -210,6 +217,9 @@ WAYMORE_LIMIT=5000 # Optional URL collection limit for waymore (0 means tool def
URL_GF=true # Url patterns classification
URL_EXT=true # Returns a list of files divided by extension
JSCHECKS=true # JS analysis
+JS_SUB_EXTRACT=true # Extract hostnames from JS/crawl outputs and resolve new subdomains
+WELLKNOWN_PIVOTS=false # Check well-known metadata endpoints (security.txt, openid, oauth) for hostnames
+WELLKNOWN_MAX_TARGETS=200 # Max web targets to check for well-known endpoints
# Python to run getjswords.py (set to venv python if pip is system-restricted)
# Example: GETJSWORDS_PYTHON="$HOME/Tools/reconftw_venv/bin/python3"
GETJSWORDS_PYTHON=python3