Skip to content

Context7 Platform -- Up-to-date docs for AI agents

docs: document failed website refresh crawls (#3475)

context7[bot]ccdb1990688e
diff --git a/docs/library-updates.mdx b/docs/library-updates.mdx
index 30691b8a..52b7a9d3 100644
--- a/docs/library-updates.mdx
+++ b/docs/library-updates.mdx
@@ -53,6 +53,10 @@ Automatic and manual refreshes work across all supported source types:
- **Websites** — re-crawled from the base URL
- **OpenAPI specs** — re-fetched and re-indexed from the spec source
+### When a Website Refresh Fails
+
+A website refresh replaces the current version only when the crawl succeeds. If the crawl reads fewer than 10% of the pages in the last version, for example because the site now blocks the crawler, the last version stays in place. The reason appears in the library logs, and the refresh is tried again later. If the site really became smaller, change its crawl settings: the first refresh after a settings change skips this check.
+
## Related
- [Adding Libraries](/adding-libraries)