Skip to content

Self-hosted OSINT exposure checker — is your email, username, phone or password leaked? Keyless sources: breaches, infostealer logs, COMB credentials, HIBP k-anonymity, 200-platform username grid. Docker one-command install, no API keys, no AI, Apache-2.0.

v1.2.0: 19th source — Bot CIDR Attribution (offline, CrawlerScope-inspired)

Rana Khan6ac224ec4887
diff --git a/CHANGELOG.md b/CHANGELOG.md
index 978d1db..e6ef39b 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -1,5 +1,19 @@
# Changelog
+
+## [1.2.0] — 2026-10-21
+
+### Added
+- **19th source: Bot CIDR Attribution** (offline, zero requests) — IP checks now
+ say whether the IP belongs to an operator-published crawler network range
+ (Googlebot, Bingbot, Meta crawler, Applebot). In-range traffic is verifiable
+ crawler traffic; OUT-of-range traffic claiming those user-agents is spoofed.
+ Includes the operator-documented reverse-DNS verification hint per range.
+ Inspired by CrawlerScope research (S32).
+
+### Changed
+- Source count 18 → 19 across README, dashboard copy, Docker label and FAQ.
+
All notable changes to Exposure-Check-OSINT are documented here.
## [1.1.0] — 2026-10-21
diff --git a/README.md b/README.md
index 37b484d..3ab300a 100644
--- a/README.md
+++ b/README.md
@@ -13,7 +13,7 @@
[![Keyless](https://img.shields.io/badge/sources-18%20%C2%B7%20all%20keyless-34D399.svg)](#%EF%B8%8F-the-18-sources)
[![Docker](https://img.shields.io/badge/install-one%20command-2496ED.svg)](#-quick-start)
-Check your personal identifiers against **18 free OSINT sources** — breach databases,
+Check your personal identifiers against **19 free OSINT sources** — breach databases,
infostealer corpora, 11B+ leaked credential pairs, 150+ platform username registries —
from your own server, with your own eyes.
@@ -27,7 +27,7 @@ from your own server, with your own eyes.
## 📸 What you get — real screenshots, live product
-<img src="assets/dashboard-preview.png" width="880" alt="Exposure Check dashboard — one input, 5 identifier types, 18 keyless sources, live corpus stats"/>
+<img src="assets/dashboard-preview.png" width="880" alt="Exposure Check dashboard — one input, 5 identifier types, 19 keyless sources, live corpus stats"/>
**The dashboard.** Paste any identifier — the type is auto-detected, the corpus stats
(1,047+ breaches, 17.8B+ leaked records, 37M stealer infections) are computed from the
@@ -74,7 +74,7 @@ docker compose exec app php artisan ec:doctor # add --json for machine-reada
```
```
-Sign in → paste an email → watch 18 sources answer in parallel → open the printable report.
+Sign in → paste an email → watch 19 sources answer in parallel → open the printable report.
Export any stored check as JSON or CSV — report page, history table, or right after a live check.
```
@@ -109,7 +109,7 @@ Presend · disposable-domain blocklist · GitHub public search
Per-source endpoints, attribution and license notes: **[docs/SOURCES.md](docs/SOURCES.md)**.
Prefer reading offline? Every documentation section also ships as a print-ready PDF in
-**[pdfs/](pdfs/)** — overview guide, the 5 checks, the 18 sources, self-hosting,
+**[pdfs/](pdfs/)** — overview guide, the 5 checks, the 19 sources, self-hosting,
privacy and FAQ.
## 🧠 Why "no AI" is a feature
diff --git a/app/Modules/Osint/OsintCheckService.php b/app/Modules/Osint/OsintCheckService.php
index 2616a75..7d7b1bc 100644
--- a/app/Modules/Osint/OsintCheckService.php
+++ b/app/Modules/Osint/OsintCheckService.php
@@ -22,6 +22,7 @@ use App\Modules\Osint\Sources\PresendSource;
use App\Modules\Osint\Sources\PwnedPasswordsSource;
use App\Modules\Osint\Sources\ProxyNovaCombSource;
use App\Modules\Osint\Sources\ShodanInternetDbSource;
+use App\Modules\Osint\Sources\BotCidrSource;
use App\Modules\Osint\Sources\XposedOrNotSource;
use App\Services\SettingsService;
use Illuminate\Http\Client\Pool;
@@ -76,6 +77,8 @@ class OsintCheckService
HackerNewsSource::class,
// v2.1 (2026-10-20): where-is-this-identifier-used signals (free)
GitHubPublicSource::class,
+ // v1.2.0 (2026-10-21, S32): offline bot-CIDR attribution (CrawlerScope-inspired)
+ BotCidrSource::class,
];
public const TYPES = ['email', 'username', 'phone', 'password', 'ip'];
diff --git a/app/Modules/Osint/Sources/BotCidrSource.php b/app/Modules/Osint/Sources/BotCidrSource.php
new file mode 100644
index 0000000..6d2a03f
--- /dev/null
+++ b/app/Modules/Osint/Sources/BotCidrSource.php
@@ -0,0 +1,154 @@
+<?php
+
+declare(strict_types=1);
+
+namespace App\Modules\Osint\Sources;
+
+/**
+ * Bot-CIDR context (v1.2.0, S32 — CrawlerScope-inspired bot attribution).
+ * ============================================================
+ *
+ * OFFLINE source: zero HTTP requests. Answers one question for IP checks:
+ * "is this IP part of an operator-PUBLISHED crawler network range?"
+ *
+ * Why it matters (exposure-check context):
+ * - IN range: traffic from this IP is verifiable crawler traffic
+ * (Googlebot/Bingbot/Meta/Apple); verify via the documented PTR
+ * pattern before blocking or reporting it.
+ * - NOT in range: any user-agent CLAIMING to be those crawlers from
+ * this IP is spoofed — classic scanner-evasion / scraping signal.
+ *
+ * Honesty rules (same as the whole tool):
+ * - The table is a SNAPSHOT of operator-published prefixes (2026-10).
+ * A MISS is never proof of "not a crawler" — operators add ranges
+ * over time. The card says exactly that.
+ * - IPv6 inputs return a clean "not assessed (IPv4 ranges only)" —
+ * no silent wrong answers.
+ */
+class BotCidrSource implements OsintSource
+{
+ /**
+ * Operator-published crawler prefixes (snapshot 2026-10).
+ * format: prefix => [operator, kind, ptr_hint]
+ */
+ private const RANGES = [
+ // Google — publishes the live list at
+ // developers.google.com/search/apis/ipranges/googlebot.json
+ '66.249.64.0/19' => ['Google (Googlebot)', 'search_crawler', '*.googlebot.com / *.google.com'],
+ '64.233.160.0/19' => ['Google (Googlebot)', 'search_crawler', '*.googlebot.com / *.google.com'],
+ '72.14.192.0/18' => ['Google (Googlebot)', 'search_crawler', '*.googlebot.com / *.google.com'],
+ '209.85.128.0/17' => ['Google (Googlebot)', 'search_crawler', '*.googlebot.com / *.google.com'],
+ '216.239.32.0/19' => ['Google (Googlebot)', 'search_crawler', '*.googlebot.com / *.google.com'],
+ '74.125.0.0/16' => ['Google (Googlebot)', 'search_crawler', '*.googlebot.com / *.google.com'],
+ // Microsoft — bing.com/toolbox/bingbot.json
+ '157.55.39.0/24' => ['Microsoft (Bingbot)', 'search_crawler', '*.search.msn.com'],
+ '40.77.167.0/24' => ['Microsoft (Bingbot)', 'search_crawler', '*.search.msn.com'],
+ '207.46.12.0/23' => ['Microsoft (Bingbot)', 'search_crawler', '*.search.msn.com'],
+ // Meta — developers.facebook.com/docs/sharing/webmasters/crawler/
+ '69.171.224.0/19' => ['Meta (Facebook Crawler)', 'social_crawler', '*.facebook.com / *.tfbnw.net'],
+ '66.220.144.0/20' => ['Meta (Facebook Crawler)', 'social_crawler', '*.facebook.com / *.tfbnw.net'],
+ '173.252.64.0/18' => ['Meta (Facebook Crawler)', 'social_crawler', '*.facebook.com / *.tfbnw.net'],
+ // Apple — developers.apple.com/applebot/
+ '17.249.0.0/16' => ['Apple (Applebot)', 'ai_crawler', '*.applebot.apple.com / *.apple.com'],
+ '17.252.57.0/24' => ['Apple (Applebot)', 'ai_crawler', '*.applebot.apple.com / *.apple.com'],
+ ];
+
+ public function key(): string
+ {
+ return 'botcidr';
+ }
+
+ public function label(): string
+ {
+ return 'Bot CIDR Attribution — Crawler Network Check';
+ }
+
+ public function category(): string
+ {
+ return 'infra';
+ }
+
+ public function supports(string $type): bool
+ {
+ return $type === 'ip';
+ }
+
+ /**
+ * Offline source: no HTTP requests are ever issued.
+ *
+ * @return array<int, array<string, mixed>>
+ */
+ public function requests(string $type, string $identifier): array
+ {
+ return [];
+ }
+
+ public function parse(string $type, string $identifier, array $responses): array
+ {
+ $ip = trim($identifier);
+
+ if (!filter_var($ip, FILTER_VALIDATE_IP, FILTER_FLAG_IPV4)) {
+ return [
+ 'status' => 'unavailable',
+ 'summary' => 'Bot-CIDR attribution applies to IPv4 addresses only.',
+ 'data' => ['note' => 'IPv6 crawler ranges are not covered by the offline snapshot.'],
+ 'severity' => 'info',
+ ];
+ }
+
+ $hit = $this->lookup($ip);
+ if ($hit !== null) {
+ return [
+ 'status' => 'hit',
+ 'summary' => "Verified {$hit['operator']} crawler network range ({$hit['network']}).",
+ 'data' => [
+ 'Operator' => $hit['operator'],
+ 'Published range' => $hit['network'],
+ 'Crawler kind' => $hit['kind'],
+ 'Verify via reverse DNS' => $hit['ptr_hint'],
+ 'What it means' => 'Traffic from this IP is crawler infrastructure. A website HOSTED here is unusual (likely a DNS misconfiguration). Requests FROM this range claiming the operator\'s user-agent are legitimate.',
+ ],
+ 'severity' => 'info',
+ ];
+ }
+
+ return [
+ 'status' => 'clean',
+ 'summary' => 'Not in any operator-published crawler range (Googlebot, Bingbot, Meta, Apple).',
+ 'data' => [
+ 'Checked against' => 'Googlebot, Bingbot, Meta crawler, Applebot published prefixes (offline snapshot 2026-10)',
+ 'What it means' => 'Any user-agent claiming to be those crawlers from this IP is SPOOFED — treat as automated scraping or scanning traffic.',
+ 'Note' => 'Operators add ranges over time; a miss is not absolute proof. Verify surprising traffic via the operator\'s documented reverse-DNS method.',
+ ],
+ 'severity' => 'info',
+ ];
+ }
+
+ /**
+ * @return null|array{operator: string, network: string, kind: string, ptr_hint: string}
+ */
+ private function lookup(string $ip): ?array
+ {
+ $long = ip2long($ip);
+ if ($long === false) {
+ return null;
+ }
+ foreach (self::RANGES as $prefix => [$operator, $kind, $ptrHint]) {
+ [$net, $bits] = explode('/', $prefix, 2);
+ $netLong = ip2long($net);
+ if ($netLong === false || !ctype_digit($bits) || (int) $bits < 0 || (int) $bits > 32) {
+ continue;
+ }
+ $mask = (int) $bits === 0 ? 0 : ((-1 << (32 - (int) $bits)) & 0xFFFFFFFF);
+ if (($long & $mask) === ($netLong & $mask)) {
+ return [
+ 'operator' => $operator,
+ 'network' => $prefix,
+ 'kind' => $kind,
+ 'ptr_hint' => $ptrHint,
+ ];
+ }
+ }
+ return null;
+ }
+}
diff --git a/composer.json b/composer.json
index fbffefd..baf6e32 100644
--- a/composer.json
+++ b/composer.json
@@ -2,7 +2,7 @@
"$schema": "https://getcomposer.org/schema.json",
"name": "2mny/exposure-check-osint",
"type": "project",
- "description": "Self-hosted personal exposure checker: email / username / phone / password / IP against 18 keyless OSINT sources. Non-AI, Laravel + Docker, k-anonymity password checks.",
+ "description": "Self-hosted personal exposure checker: email / username / phone / password / IP against 19 keyless OSINT sources. Non-AI, Laravel + Docker, k-anonymity password checks.",
"keywords": [
"osint",
"email-osint",
diff --git a/docker/Dockerfile b/docker/Dockerfile
index c7ffccc..6db6568 100644
--- a/docker/Dockerfile
+++ b/docker/Dockerfile
@@ -13,7 +13,7 @@
FROM php:8.3-apache
LABEL org.opencontainers.image.title="Exposure-Check-OSINT"
-LABEL org.opencontainers.image.description="Self-hosted personal exposure checker (email/username/phone/password/IP) — 18 keyless OSINT sources, no AI"
+LABEL org.opencontainers.image.description="Self-hosted personal exposure checker (email/username/phone/password/IP) — 19 keyless OSINT sources, no AI"
LABEL org.opencontainers.image.version="1.1.0"
LABEL org.opencontainers.image.licenses="Apache-2.0"
LABEL org.opencontainers.image.source="https://github.com/RanaKhan77/Exposure-Check-OSINT"
diff --git a/docs/FAQ.md b/docs/FAQ.md
index 7914be0..15583c2 100644
--- a/docs/FAQ.md
+++ b/docs/FAQ.md
@@ -36,7 +36,7 @@ rest of the check (per-source isolation). Re-run the check to retry.
## Where does the data come from?
-18 keyless public sources — breach databases (XposedOrNot, HIBP Pwned Passwords),
+19 keyless public sources — breach databases (XposedOrNot, HIBP Pwned Passwords),
infostealer corpus (HudsonRock), the COMB credential corpus (ProxyNova), disposable-email
databases, the Maigret/WhatsMyName 150-site username corpus, Bluesky, Hacker News, GitHub
public search, Shodan InternetDB, ipapi.is and more. Full table with attribution:
diff --git a/resources/views/dashboard.blade.php b/resources/views/dashboard.blade.php
index e80a5fd..2c546c6 100644
--- a/resources/views/dashboard.blade.php
+++ b/resources/views/dashboard.blade.php
@@ -2,7 +2,7 @@
@section('content')
<h1>Exposure Check</h1>
-<p class="sub">Check if an email, username, phone number, password or IP is exposed — breaches, stealer logs, linked accounts, public data. Read-only lookups against 18 keyless sources. Identifiers you are authorized to check only.</p>
+<p class="sub">Check if an email, username, phone number, password or IP is exposed — breaches, stealer logs, linked accounts, public data. Read-only lookups against 19 keyless sources. Identifiers you are authorized to check only.</p>
<div class="card" style="padding:22px">
<form id="ox-form" autocomplete="off">
diff --git a/tests/Unit/BotCidrSourceTest.php b/tests/Unit/BotCidrSourceTest.php
new file mode 100644
index 0000000..e7ded6f
--- /dev/null
+++ b/tests/Unit/BotCidrSourceTest.php
@@ -0,0 +1,81 @@
+<?php
+
+declare(strict_types=1);
+
+namespace Tests\Unit;
+
+use App\Modules\Osint\Sources\BotCidrSource;
+use PHPUnit\Framework\TestCase;
+
+/**
+ * BotCidrSource tests (v1.2.0, S32 — offline bot-CIDR attribution).
+ */
+final class BotCidrSourceTest extends TestCase
+{
+ private BotCidrSource $src;
+
+ protected function setUp(): void
+ {
+ $this->src = new BotCidrSource();
+ }
+
+ public function test_supports_ip_only(): void
+ {
+ $this->assertTrue($this->src->supports('ip'));
+ $this->assertFalse($this->src->supports('email'));
+ $this->assertFalse($this->src->supports('username'));
+ }
+
+ public function test_makes_zero_http_requests(): void
+ {
+ $this->assertSame([], $this->src->requests('ip', '66.249.66.1'));
+ }
+
+ public function test_googlebot_range_is_a_hit(): void
+ {
+ $r = $this->src->parse('ip', '66.249.66.1', []);
+ $this->assertSame('hit', $r['status']);
+ $this->assertSame('info', $r['severity']);
+ $this->assertStringContainsString('Google', $r['summary']);
+ $this->assertSame('66.249.64.0/19', $r['data']['Published range']);
+ }
+
+ public function test_bingbot_range_is_a_hit(): void
+ {
+ $r = $this->src->parse('ip', '157.55.39.7', []);
+ $this->assertSame('hit', $r['status']);
+ $this->assertStringContainsString('Bingbot', $r['summary']);
+ }
+
+ public function test_outside_all_ranges_is_clean_with_spoof_warning(): void
+ {
+ $r = $this->src->parse('ip', '203.0.113.10', []);
+ $this->assertSame('clean', $r['status']);
+ $this->assertStringContainsString('SPOOFED', $r['data']['What it means']);
+ }
+
+ public function test_boundary_ip_outside_prefix_is_clean(): void
+ {
+ // 66.249.64.0/19 ends at 66.249.95.255
+ $r = $this->src->parse('ip', '66.249.96.1', []);
+ $this->assertSame('clean', $r['status']);
+ }
+
+ public function test_ipv6_is_honest_unavailable(): void
+ {
+ $r = $this->src->parse('ip', '2620:11c:f008::108', []);
+ $this->assertSame('unavailable', $r['status']);
+ }
+
+ public function test_malformed_ip_is_honest_unavailable(): void
+ {
+ $r = $this->src->parse('ip', 'not-an-ip', []);
+ $this->assertSame('unavailable', $r['status']);
+ }
+
+ public function test_meta_and_apple_ranges(): void
+ {
+ $this->assertSame('hit', $this->src->parse('ip', '69.171.230.5', [])['status']);
+ $this->assertSame('hit', $this->src->parse('ip', '17.249.32.10', [])['status']);
+ }
+}