Skip to content

Context7 Platform -- Up-to-date docs for AI agents

docs: explain website crawl scope and trailing slash (#3472)

context7[bot]98fb27dbcbc8
diff --git a/docs/howto/claiming-libraries.mdx b/docs/howto/claiming-libraries.mdx
index de4ed6a7..c580cc1f 100644
--- a/docs/howto/claiming-libraries.mdx
+++ b/docs/howto/claiming-libraries.mdx
@@ -181,6 +181,12 @@ Context7 checks a new title or description before it saves it. If the text gives
| **Frames** | Read text inside iframes. Turn on when each page loads into an iframe. Disabled by default. | Boolean |
<Note>
+ The crawl stays under the Base URL. A Base URL without a trailing slash is a plain
+ prefix, so `https://example.com/docs/api/admin` also includes
+ `https://example.com/docs/api/admin-graphql/...`. Add a trailing slash to keep the
+ folder boundary: `https://example.com/docs/` includes `/docs` and `/docs/x` but
+ not `/docs-old`.
+
Hash fragments (`#...`) are not indexed. Pages that differ only by their fragment, such as
hash-routed documentation sites, are crawled as a single page.
</Note>