Self-hosted OSINT exposure checker — is your email, username, phone or password leaked? Keyless sources: breaches, infostealer logs, COMB credentials, HIBP k-anonymity, 200-platform username grid. Docker one-command install, no API keys, no AI, Apache-2.0.
PHP breach-checkcredential-exposuredata-breachdigital-footprintemail-osintfree-osinthaveibeenpwnedip-reputationleaked-credentialsleaked-dataosintosint-apiosint-toolsphone-lookupprivacy-toolspublic-datapwned-passwordsself-hostedusername-checkusername-osint
v1.3.1: wire the crt.sh + RDAP sources and add the domain check type
RanaKhan77eb0a5cd3997c
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex b3a11d5..5195b04 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -1,5 +1,25 @@# Changelog+## [1.3.1] — 2026-10-23++### Fixed++- **v1.3.0 follow-up — the two new sources were shipped but not wired.** v1.3.0 added+ `CrtShSource` and `RdapSource` as files and updated every count claim to 21, but the+ `OsintCheckService::SOURCES` registry still listed 19, so the dashboard rendered+ "19 keyless sources" while the README said 21, and the new sources never ran. Both+ are now registered, the `domain` check type is live (mirroring the hosted product),+ and every count is registry-derived again. The domain check surfaces a domain's+ public infrastructure footprint only (CT-log subdomain history via crt.sh, registry+ records via RDAP) — website vulnerability scanning stays in the scanner CE.+- Domain normalization is stricter than the hosted product: `FILTER_VALIDATE_DOMAIN`+ alone accepts spaces and underscores, so the CE requires a dot-joined hostname+ shape (and strips scheme, path and port). "not a domain" now 422s honestly.+- The scope-rule test (`test_check_types_do_not_include_domain`) became+ `test_check_types_include_domain_infra`: the 5-check identity is now 6 checks+ (email, username, phone, password, domain, ip). README, docs/CHECKS.md and the+ dashboard tabs/placeholder/auto-detect updated in the same commit.+## [1.3.0] — 2026-10-23### Sourcesdiff --git a/README.md b/README.mdindex 5fd9b76..4970df3 100644--- a/README.md+++ b/README.md@@ -19,7 +19,7 @@ from your own server, with your own eyes.**The companion OSINT tool to the [200-scanner Website Vulnerability Scanner CE](https://github.com/RanaKhan77/Website-Vulnerability-Scanner).**-[Quick Start](#-quick-start) · [The 5 Checks](#-the-5-checks) · [Sources](#%EF%B8%8F-the-21-sources) · [Why](#-why-this-exists) · [Privacy](#-privacy-by-design) · [FAQ](docs/FAQ.md) · [Donate](#-support-the-project)+[Quick Start](#-quick-start) · [The 6 Checks](#-the-6-checks) · [Sources](#%EF%B8%8F-the-21-sources) · [Why](#-why-this-exists) · [Privacy](#-privacy-by-design) · [FAQ](docs/FAQ.md) · [Donate](#-support-the-project)</div>@@ -27,7 +27,7 @@ from your own server, with your own eyes.## 📸 What you get — real screenshots, live product-<img src="assets/dashboard-preview.png" width="880" alt="Exposure Check dashboard — one input, 5 identifier types, 21 keyless sources, live corpus stats"/>+<img src="assets/dashboard-preview.png" width="880" alt="Exposure Check dashboard — one input, 6 identifier types, 21 keyless sources, live corpus stats"/>**The dashboard.** Paste any identifier — the type is auto-detected, the corpus stats(1,047+ breaches, 17.8B+ leaked records, 37M stealer infections) are computed from the@@ -78,7 +78,7 @@ Sign in → paste an email → watch 21 sources answer in parallel → open theExport any stored check as JSON or CSV — report page, history table, or right after a live check.```-## 🔎 The 5 Checks+## 🔎 The 6 Checks| Check | Input | What it answers ||-------|-------|-----------------|@@ -86,6 +86,7 @@ Export any stored check as JSON or CSV — report page, history table, or right| 👤 Username exposure | one username | Which of 150 platforms have it registered (logo grid, confidence tiers: confirmed vs probable) · Bluesky · Hacker News || 📱 Phone exposure | E.164 number | Valid, country, line type, carrier class · COMB leak association || 🔑 Password exposure | a password | How many times it appears in breach corpora — **hashed in your browser, 5-char prefix only** |+| 🗺️ Domain infrastructure | a domain | CT-log subdomain history (every hostname that ever got a TLS certificate) · RDAP registrar, dates and statuses — registration age as a fraud/trust signal || 🌐 IP exposure | IPv4/IPv6 | Open ports + services · VPN/proxy/hosting classification |Full explanations with screenshots-level detail: [docs/CHECKS.md](docs/CHECKS.md).@@ -111,7 +112,7 @@ Presend · disposable-domain blocklist · GitHub public searchPer-source endpoints, attribution and license notes: **[docs/SOURCES.md](docs/SOURCES.md)**.Prefer reading offline? Every documentation section also ships as a print-ready PDF in-**[pdfs/](pdfs/)** — overview guide, the 5 checks, the 21 sources, self-hosting,+**[pdfs/](pdfs/)** — overview guide, the 6 checks, the 21 sources, self-hosting,privacy and FAQ.## 🧠 Why "no AI" is a featurediff --git a/app/Http/Controllers/DashboardController.php b/app/Http/Controllers/DashboardController.phpindex ef47bdb..dca0c73 100644--- a/app/Http/Controllers/DashboardController.php+++ b/app/Http/Controllers/DashboardController.php@@ -83,6 +83,11 @@ class DashboardController extends Controllerif (preg_match('/^\+?\d[\d\s().-]{6,20}$/', $q)) {return 'phone';}+ $stripped = strtolower((string) preg_replace('/^https?:\/\//', '', $q));+ $stripped = (string) preg_replace('/\/.*$/', '', $stripped);+ if (str_contains($stripped, '.') && filter_var($stripped, FILTER_VALIDATE_DOMAIN)) {+ return 'domain';+ }return 'username';}diff --git a/app/Modules/Osint/OsintCheckService.php b/app/Modules/Osint/OsintCheckService.phpindex 7d7b1bc..984fa56 100644--- a/app/Modules/Osint/OsintCheckService.php+++ b/app/Modules/Osint/OsintCheckService.php@@ -5,6 +5,7 @@ declare(strict_types=1);namespace App\Modules\Osint;use App\Modules\Osint\Sources\BlueskySource;+use App\Modules\Osint\Sources\CrtShSource;use App\Modules\Osint\Sources\DisifySource;use App\Modules\Osint\Sources\DisposableEmailSource;use App\Modules\Osint\Sources\FachaTempSource;@@ -21,6 +22,7 @@ use App\Modules\Osint\Sources\PhoneValiditySource;use App\Modules\Osint\Sources\PresendSource;use App\Modules\Osint\Sources\PwnedPasswordsSource;use App\Modules\Osint\Sources\ProxyNovaCombSource;+use App\Modules\Osint\Sources\RdapSource;use App\Modules\Osint\Sources\ShodanInternetDbSource;use App\Modules\Osint\Sources\BotCidrSource;use App\Modules\Osint\Sources\XposedOrNotSource;@@ -33,11 +35,13 @@ use Illuminate\Support\Facades\Http;* Exposure Check orchestrator (Community Edition).** Extracted from the 2MNY production engine (2026-10-21) with the CE deltas:- * - Check types: email | username | phone | password | ip.- * The 'domain' type is intentionally absent — that is the Website- * Vulnerability Scanner CE's job (see README, "Scope").- * - Keyless sources only. The owner-keyed source and the two domain/CT- * sources of the hosted product are NOT shipped here.+ * - Check types: email | username | phone | password | domain | ip.+ * The 'domain' type (added v1.3.0) surfaces a domain's public+ * infrastructure footprint only — CT-log subdomain history and+ * registry data. Website vulnerability scanning stays in the+ * Website Vulnerability Scanner CE.+ * - Keyless sources only (21). The owner-keyed source of the hosted+ * product is NOT shipped here.* - No Trace-Pro / billing logic anywhere in the CE.** Fans out every supporting source in ONE Http::pool (single wall-clock@@ -79,9 +83,12 @@ class OsintCheckServiceGitHubPublicSource::class,// v1.2.0 (2026-10-21, S32): offline bot-CIDR attribution (CrawlerScope-inspired)BotCidrSource::class,+ // v1.3.0 (2026-10-22, gap-analysis D1): domain-infra sources, keyless+ CrtShSource::class,+ RdapSource::class,];- public const TYPES = ['email', 'username', 'phone', 'password', 'ip'];+ public const TYPES = ['email', 'username', 'phone', 'password', 'domain', 'ip'];/** 30-min result cache per (type + normalized identifier). */private const CACHE_TTL = 1800;@@ -368,6 +375,18 @@ class OsintCheckService// queries the HIBP range with it and the browser matches the// full hash client-side. (Test-enforced: SourceContractTest.)return preg_match('/^[0-9A-Fa-f]{5}$/', $identifier) ? strtoupper($identifier) : '';+ case 'domain':+ // Public infrastructure identifier: strip scheme, path and+ // port, lowercase, and require a hostname shape (dot-joined+ // labels). FILTER_VALIDATE_DOMAIN alone accepts spaces and+ // underscores, so the shape check is the real gate.+ $identifier = strtolower((string) preg_replace('/^https?:\/\//', '', $identifier));+ $identifier = (string) preg_replace('/\/.*$/', '', $identifier);+ $identifier = (string) preg_replace('/:\d+$/', '', $identifier);++ return preg_match('/^[a-z0-9]([a-z0-9-]*[a-z0-9])?(\.[a-z0-9]([a-z0-9-]*[a-z0-9])?)+$/', $identifier)+ ? $identifier+ : '';case 'ip':return filter_var($identifier, FILTER_VALIDATE_IP) ? $identifier : '';}@@ -393,6 +412,10 @@ class OsintCheckServicereturn '+' . substr($identifier, 0, 3) . ' *** ***' . substr($identifier, -3);case 'password':return 'SHA-1 ' . substr($identifier, 0, 5) . '***** (k-anonymity)';+ case 'domain':+ // A domain is public infrastructure data, not a personal+ // identifier — shown as entered (matches the hosted product).+ return $identifier;case 'ip':// Privacy contract: never store a raw identifier. IPv4 keeps// first + last octet; IPv6 keeps first + last group; anythingdiff --git a/docs/CHECKS.md b/docs/CHECKS.mdindex d8596f8..6ee1261 100644--- a/docs/CHECKS.md+++ b/docs/CHECKS.md@@ -1,4 +1,4 @@-# The 5 Check Types+# The 6 Check Types## 1. Email exposure 📧@@ -34,7 +34,24 @@ suffixes for that prefix from HIBP and returns them; **your browser matches thehash locally** and shows how many times the password appears in known breach corpora.The full hash — and the password — never reach the server, the database, or any logs.-## 5. IP exposure 🌐+## 5. Domain infrastructure 🗺️++Paste a domain (a bare hostname or a URL — the scheme, path and port are stripped).+The domain type answers one question: **what does this domain's public infrastructure+footprint look like, and how old is it?** It is a fraud/trust signal, not a website+scan — vulnerability scanning is the [Website Vulnerability Scanner](https://github.com/RanaKhan77/Website-Vulnerability-Scanner)'s job.++- **crt.sh — Certificate Transparency:** every subdomain that ever obtained a TLS+ certificate (counts + first 40 names). A freshly-registered domain with dozens of+ wildcard subdomains tells a different story than a ten-year-old corporate domain.+- **RDAP — registry records:** registrar, creation and expiry dates, status flags.+ Registration age is the classic fraud/trust heuristic: a payment domain registered+ last week deserves more scrutiny than one registered a decade ago.++Both sources are keyless, read-only and free. Nothing is stored about the check+beyond what the privacy contract already allows.++## 6. IP exposure 🌐An IPv4/IPv6 → open ports and exposed services (Shodan InternetDB, keyless),VPN/proxy/hosting classification (ipapi.is). For auditing your own servers and egress IPs.diff --git a/resources/views/dashboard.blade.php b/resources/views/dashboard.blade.phpindex 9e46131..b5ba8c4 100644--- a/resources/views/dashboard.blade.php+++ b/resources/views/dashboard.blade.php@@ -2,7 +2,7 @@@section('content')<h1>Exposure Check</h1>-<p class="sub">Check if an email, username, phone number, password or IP is exposed — breaches, stealer logs, linked accounts, public data. Read-only lookups against {{ count($sources) }} keyless sources. Identifiers you are authorized to check only.</p>+<p class="sub">Check if an email, username, phone number, password, domain or IP is exposed — breaches, stealer logs, linked accounts, public data. Read-only lookups against {{ count($sources) }} keyless sources. Identifiers you are authorized to check only.</p><div class="card" style="padding:22px"><form id="ox-form" autocomplete="off">@@ -11,6 +11,7 @@<button type="button" class="ox-tab" data-type="username">👤 Username</button><button type="button" class="ox-tab" data-type="phone">📱 Phone</button><button type="button" class="ox-tab" data-type="password">🔑 Password</button>+ <button type="button" class="ox-tab" data-type="domain">🗺️ Domain</button><button type="button" class="ox-tab" data-type="ip">🌐 IP</button></div><div style="display:flex;gap:10px;flex-wrap:wrap">@@ -111,6 +112,8 @@// IPv6 literal (contains : and hex groups) — sources support itif (q.includes(':') && /^[0-9a-fA-F:]+$/.test(q) && (q.match(/:/g) || []).length >= 2) return 'ip';if (/^\+?\d[\d\s().-]{6,20}$/.test(q)) return 'phone';+ var d = q.replace(/^https?:\/\//i, '').replace(/\/.*$/, '').toLowerCase();+ if (d.indexOf('.') !== -1 && /^[a-z0-9-]+(\.[a-z0-9-]+)+$/.test(d)) return 'domain';return 'username';}@@ -121,6 +124,7 @@username: 'username (e.g. johndoe)',phone: '+880 1712-345678',password: 'type a password — hashed in your browser, never sent',+ domain: 'example.com — public TLS & registry footprint',ip: '8.8.8.8 or 2606:4700::1111'};function setTab(t) {diff --git a/tests/Feature/SmokeFlowTest.php b/tests/Feature/SmokeFlowTest.phpindex 2de6ea6..45c8e92 100644--- a/tests/Feature/SmokeFlowTest.php+++ b/tests/Feature/SmokeFlowTest.php@@ -79,8 +79,12 @@ class SmokeFlowTest extends TestCase$this->post('/login', ['password' => 'test-password-123']);$this->postJson('/api/check', ['type' => 'email', 'q' => 'not-an-email'])->assertStatus(422);- $this->postJson('/api/check', ['type' => 'domain', 'q' => 'example.com'])- ->assertStatus(422); // scope rule: domains belong to the scanner CE+ // v1.3.0: the domain type is accepted (public infra footprint:+ // CT-log history + registry data). A malformed domain still 422s.+ $this->postJson('/api/check', ['type' => 'domain', 'q' => 'not a domain'])+ ->assertStatus(422);+ $resp = $this->postJson('/api/check', ['type' => 'domain', 'q' => 'example.com']);+ $this->assertContains($resp->status(), [200, 429], 'domain check failed: ' . $resp->status());}public function test_settings_page_renders_real_checked_attributes(): voiddiff --git a/tests/Unit/SourceContractTest.php b/tests/Unit/SourceContractTest.phpindex b965aa9..aa81da7 100644--- a/tests/Unit/SourceContractTest.php+++ b/tests/Unit/SourceContractTest.php@@ -61,11 +61,12 @@ class SourceContractTest extends TestCase}}- public function test_check_types_do_not_include_domain(): void+ public function test_check_types_include_domain_infra(): void{- // Scope rule: domain/website checks belong to the scanner CE.- $this->assertNotContains('domain', OsintCheckService::TYPES);- $this->assertSame(['email', 'username', 'phone', 'password', 'ip'], OsintCheckService::TYPES);+ // v1.3.0: the domain type surfaces a domain's public infrastructure+ // footprint (CT-log history, registry data) — the fraud/trust signal.+ // Website vulnerability scanning stays in the scanner CE.+ $this->assertSame(['email', 'username', 'phone', 'password', 'domain', 'ip'], OsintCheckService::TYPES);}public function test_support_matrix_has_coverage_for_every_type(): voiddiff --git a/wire.py b/wire.pynew file mode 100644index 0000000..48d3249--- /dev/null+++ b/wire.py@@ -0,0 +1,140 @@+#!/usr/bin/env python3+"""EC v1.3.1: wire CrtShSource + RdapSource (mirror production) — service, controller, blade, tests, docs.+Runs ON SERVER in /tmp/ec-git."""+import re++def sub(path, pairs, allow_multi=False):+ s = open(path, encoding="utf-8").read()+ for old, new in pairs:+ assert old in s, f"ANCHOR MISSING in {path}: {old[:70]!r}"+ if not allow_multi:+ assert s.count(old) == 1, f"NOT UNIQUE in {path}: {old[:70]!r}"+ s = s.replace(old, new, 1 if not allow_multi else -1)+ open(path, "w", encoding="utf-8").write(s)+ print(f"ok {path}: {len(pairs)} edits")++# ---------- 1. OsintCheckService ----------+P = "app/Modules/Osint/OsintCheckService.php"+sub(P, [+ # imports (alphabetical: CrtSh after Bluesky, Rdap after ProxyNova)+ ("use App\\Modules\\Osint\\Sources\\BlueskySource;\nuse App\\Modules\\Osint\\Sources\\DisifySource;",+ "use App\\Modules\\Osint\\Sources\\BlueskySource;\nuse App\\Modules\\Osint\\Sources\\CrtShSource;\nuse App\\Modules\\Osint\\Sources\\DisifySource;"),+ ("use App\\Modules\\Osint\\Sources\\ProxyNovaCombSource;\nuse App\\Modules\\Osint\\Sources\\ShodanInternetDbSource;",+ "use App\\Modules\\Osint\\Sources\\ProxyNovaCombSource;\nuse App\\Modules\\Osint\\Sources\\RdapSource;\nuse App\\Modules\\Osint\\Sources\\ShodanInternetDbSource;"),+ # SOURCES: append the two domain-infra sources with the v1.3.0 comment+ (" // v1.2.0 (2026-10-21, S32): offline bot-CIDR attribution (CrawlerScope-inspired)\n BotCidrSource::class,\n ];",+ " // v1.2.0 (2026-10-21, S32): offline bot-CIDR attribution (CrawlerScope-inspired)\n BotCidrSource::class,\n // v1.3.0 (2026-10-22, gap-analysis D1): domain-infra sources, keyless\n CrtShSource::class,\n RdapSource::class,\n ];"),+ # TYPES: add domain (production order)+ (" public const TYPES = ['email', 'username', 'phone', 'password', 'ip'];",+ " public const TYPES = ['email', 'username', 'phone', 'password', 'domain', 'ip'];"),+])++# docblock: update the CE-deltas note+s = open(P, encoding="utf-8").read()+old_doc = """ * Extracted from the 2MNY production engine (2026-10-21) with the CE deltas:+ * - Check types: email | username | phone | password | ip.+ * The 'domain' type is intentionally absent — that is the Website+ * Vulnerability Scanner CE's job (see README, "Scope").+ * - Keyless sources only. The owner-keyed source and the two domain/CT+ * sources of the hosted product are NOT shipped here.+ * - No Trace-Pro / billing logic anywhere in the CE."""+new_doc = """ * Extracted from the 2MNY production engine (2026-10-21) with the CE deltas:+ * - Check types: email | username | phone | password | domain | ip.+ * The 'domain' type (added v1.3.0) surfaces a domain's public+ * infrastructure footprint only — CT-log subdomain history and+ * registry data. Website vulnerability scanning stays in the+ * Website Vulnerability Scanner CE.+ * - Keyless sources only (21). The owner-keyed source of the hosted+ * product is NOT shipped here.+ * - No Trace-Pro / billing logic anywhere in the CE."""+assert old_doc in s, "docblock anchor missing"+s = s.replace(old_doc, new_doc, 1)+open(P, "w", encoding="utf-8").write(s)+print("ok docblock")++# normalize: add domain case (mirror production)+sub(P, [+ (""" case 'password':+ // 5-char SHA-1 prefix ONLY (k-anonymity - never the password).+ return preg_match('/^[0-9A-Fa-f]{5}$/', $identifier) ? strtoupper($identifier) : '';+ case 'ip':""",+ """ case 'password':+ // 5-char SHA-1 prefix ONLY (k-anonymity - never the password).+ return preg_match('/^[0-9A-Fa-f]{5}$/', $identifier) ? strtoupper($identifier) : '';+ case 'domain':+ $identifier = strtolower(preg_replace('/^https?:\\/\\//', '', $identifier) ?? $identifier);+ $identifier = preg_replace('/\\/.*$/', '', $identifier) ?? $identifier;++ return filter_var($identifier, FILTER_VALIDATE_DOMAIN) ? $identifier : '';+ case 'ip':"""),+])++# mask: add domain case — check current mask shape first+s = open(P, encoding="utf-8").read()+m = re.search(r"case 'password':\n(.*?)case 'ip':", s, re.S)+assert m, "mask password->ip anchor missing"+mpw = m.group(1)+old_mask = "case 'password':\n" + mpw + "case 'ip':"+new_mask = "case 'password':\n" + mpw + "case 'domain':\n case 'ip':"+assert s.count(old_mask) == 1+s = s.replace(old_mask, new_mask, 1)+open(P, "w", encoding="utf-8").write(s)+print("ok mask domain case")++# ---------- 2. SourceContractTest ----------+sub("tests/Unit/SourceContractTest.php", [+ (""" public function test_check_types_do_not_include_domain(): void+ {+ // Scope rule: domain/website checks belong to the scanner CE.+ $this->assertNotContains('domain', OsintCheckService::TYPES);+ $this->assertSame(['email', 'username', 'phone', 'password', 'ip'], OsintCheckService::TYPES);+ }""",+ """ public function test_check_types_include_domain_infra(): void+ {+ // v1.3.0: the domain type surfaces a domain's public infrastructure+ // footprint (CT-log history, registry data) — the fraud/trust signal.+ // Website vulnerability scanning stays in the scanner CE.+ $this->assertSame(['email', 'username', 'phone', 'password', 'domain', 'ip'], OsintCheckService::TYPES);+ }"""),+])++# ---------- 3. DashboardController detectType ----------+sub("app/Http/Controllers/DashboardController.php", [+ (""" if (preg_match('/^\\+?\\d[\\d\\s().-]{6,20}$/', $q)) {+ return 'phone';+ }++ return 'username';""",+ """ if (preg_match('/^\\+?\\d[\\d\\s().-]{6,20}$/', $q)) {+ return 'phone';+ }+ $stripped = strtolower((string) preg_replace('/^https?:\\/\\//', '', $q));+ $stripped = (string) preg_replace('/\\/.*$/', '', $stripped);+ if (str_contains($stripped, '.') && filter_var($stripped, FILTER_VALIDATE_DOMAIN)) {+ return 'domain';+ }++ return 'username';"""),+])++# ---------- 4. dashboard.blade.php ----------+sub("resources/views/dashboard.blade.php", [+ ('<button type="button" class="ox-tab" data-type="password">🔑 Password</button>',+ '<button type="button" class="ox-tab" data-type="password">🔑 Password</button>\n <button type="button" class="ox-tab" data-type="domain">🗺️ Domain</button>'),+ (""" password: 'type a password — hashed in your browser, never sent',+ ip: '8.8.8.8 or 2606:4700::1111'+ };""",+ """ password: 'type a password — hashed in your browser, never sent',+ domain: 'example.com — public TLS & registry footprint',+ ip: '8.8.8.8 or 2606:4700::1111'+ };"""),+ (""" if (/^\\+?\\d[\\d\\s().-]{6,20}$/.test(q)) return 'phone';+ return 'username';""",+ """ if (/^\\+?\\d[\\d\\s().-]{6,20}$/.test(q)) return 'phone';+ var d = q.replace(/^https?:\\/\\//i, '').replace(/\\/.*$/, '').toLowerCase();+ if (d.indexOf('.') !== -1 && /^[a-z0-9-]+(\\.[a-z0-9-]+)+$/.test(d)) return 'domain';+ return 'username';"""),+ ("<p class=\"sub\">Check if an email, username, phone number, password or IP is exposed",+ "<p class=\"sub\">Check if an email, username, phone number, password, domain or IP is exposed"),+])+print("ALL WIRING DONE")