Skip to content

an open-source alternative to the dots, bots and muses of the world, run an office of claude code/codex like agents on your laptop, sandboxes or anywhere, uses your existing subscriptions

feat(blog): own root sitemap.xml; drop redundant blog robots

Chaitanya Giri70b842fc9e4b
diff --git a/.github/workflows/blog.yml b/.github/workflows/blog.yml
index a8924281..08054934 100644
--- a/.github/workflows/blog.yml
+++ b/.github/workflows/blog.yml
@@ -39,8 +39,10 @@ jobs:
run: |
git config user.name "github-actions[bot]"
git config user.email "github-actions[bot]@users.noreply.github.com"
- if [ -n "$(git status --porcelain docs/blog)" ]; then
- git add docs/blog
+ # docs/blog = the built site; docs/sitemap.xml = root sitemap the
+ # build regenerates (owned by this build, per the Kevin handoff).
+ if [ -n "$(git status --porcelain docs/blog docs/sitemap.xml)" ]; then
+ git add docs/blog docs/sitemap.xml
git commit -m "chore(blog): rebuild static output [skip ci]"
git push
else
diff --git a/blog/BLOG_README.md b/blog/BLOG_README.md
index 05221ef7..e4eb565b 100644
--- a/blog/BLOG_README.md
+++ b/blog/BLOG_README.md
@@ -121,7 +121,9 @@ They map onto this blog as follows:
- **OpenGraph** + **Twitter** card tags, with a default OG image and per-post override.
- **JSON-LD**: `Blog` (index), `BlogPosting` + `BreadcrumbList` (every post), `FAQPage` (when a post
declares `faq`).
-- Auto-generated **`sitemap.xml`**, **`robots.txt`**, and an Atom **`feed.xml`**.
+- Auto-generated **root `sitemap.xml`** and an Atom **`feed.xml`**.
+- **`robots.txt`** is owned by the marketing site (`docs/robots.txt`, maintained alongside
+ `docs/index.html`) and points at `https://munderdiffl.in/sitemap.xml`.
- Semantic HTML, single `<h1>`, skip-link, `:focus-visible` outlines, WCAG-AA contrast,
`prefers-reduced-motion` support, lazy-loaded images.
@@ -141,6 +143,17 @@ The blog ships as static files under `docs/blog/`, served by the **existing** Pa
No GitHub Pages configuration change is needed. If you ever move the blog off `/blog`, update
`BASE` in `eleventy.config.js` and `origin`/`baseUrl` in `src/_data/site.js`.
+### Sitemap ownership
+
+This build **owns the root `docs/sitemap.xml`** (agreed with the SEO owner — "Option A"). The build
+generates the full sitemap — the marketing homepage **plus** every blog page — and a postbuild step
+(`scripts/postbuild.mjs`) moves it from `docs/blog/sitemap.xml` up to `docs/sitemap.xml`, which is
+where `docs/robots.txt` points crawlers. Post `<lastmod>` values come from real publish/update dates,
+never build time. Don't hand-edit `docs/sitemap.xml` — it's regenerated every build.
+
+The blog **RSS** feed is emitted at `docs/blog/feed.xml` (served at `/blog/feed.xml`), matching the
+`<link rel="alternate">` already in the marketing site's `<head>`.
+
---
## Project layout
@@ -149,6 +162,7 @@ No GitHub Pages configuration change is needed. If you ever move the blog off `/
blog/
eleventy.config.js # config, filters, collections, /blog base + markdown anchors
package.json
+ scripts/postbuild.mjs # moves the generated sitemap to docs/sitemap.xml (root)
src/
_data/
site.js # site-level SEO + cluster config (Kevin's site-level inputs)
@@ -164,6 +178,6 @@ blog/
topics-index.njk # /topics
topic.njk # /topics/<cluster>/ (paginated per category)
tag.njk # /tags/<tag>/ (paginated per tag)
- about.md 404.njk feed.njk sitemap.njk robots.njk
-→ builds into ../docs/blog/
+ about.md 404.njk feed.njk sitemap.njk
+→ builds into ../docs/blog/ (+ ../docs/sitemap.xml at the root)
```
diff --git a/blog/package.json b/blog/package.json
index b5c3c339..fa9e7e3b 100644
--- a/blog/package.json
+++ b/blog/package.json
@@ -6,7 +6,7 @@
"license": "MIT",
"type": "module",
"scripts": {
- "build": "npm run clean && eleventy",
+ "build": "npm run clean && eleventy && node scripts/postbuild.mjs",
"dev": "eleventy --serve --port=8088",
"clean": "rimraf ../docs/blog"
},
diff --git a/blog/scripts/postbuild.mjs b/blog/scripts/postbuild.mjs
new file mode 100644
index 00000000..036dfb9f
--- /dev/null
+++ b/blog/scripts/postbuild.mjs
@@ -0,0 +1,20 @@
+// Postbuild: move the generated sitemap to the site ROOT (docs/sitemap.xml).
+//
+// Eleventy can only write inside its output dir (docs/blog), but robots.txt
+// points crawlers at https://munderdiffl.in/sitemap.xml — the repo root. So we
+// move docs/blog/sitemap.xml up to docs/sitemap.xml after the build. The sitemap
+// uses absolute URLs, so its location on disk doesn't affect its contents.
+//
+// Runs with cwd = blog/ (npm sets it to the package dir).
+import { rename } from "node:fs/promises";
+
+const from = "../docs/blog/sitemap.xml";
+const to = "../docs/sitemap.xml";
+
+try {
+ await rename(from, to);
+ console.log(`[postbuild] sitemap → docs/sitemap.xml (root)`);
+} catch (err) {
+ console.error(`[postbuild] failed to move sitemap: ${err.message}`);
+ process.exit(1);
+}
diff --git a/blog/src/_data/build.js b/blog/src/_data/build.js
index b1c6f418..b6961be1 100644
--- a/blog/src/_data/build.js
+++ b/blog/src/_data/build.js
@@ -1,6 +1,8 @@
// Build-time metadata. `new Date()` here is fine — it's the build machine clock,
// not the Eleventy template layer.
+const now = new Date();
export default {
- year: new Date().getUTCFullYear(),
- timestamp: new Date().toISOString(),
+ year: now.getUTCFullYear(),
+ timestamp: now.toISOString(),
+ date: now.toISOString().slice(0, 10), // YYYY-MM-DD
};
diff --git a/blog/src/robots.njk b/blog/src/robots.njk
deleted file mode 100644
index 127a1259..00000000
--- a/blog/src/robots.njk
+++ /dev/null
@@ -1,8 +0,0 @@
----
-permalink: /robots.txt
-eleventyExcludeFromCollections: true
----
-User-agent: *
-Allow: /
-
-Sitemap: {{ site.baseUrl }}sitemap.xml
diff --git a/blog/src/sitemap.njk b/blog/src/sitemap.njk
index 30d91ff4..a07c0ab5 100644
--- a/blog/src/sitemap.njk
+++ b/blog/src/sitemap.njk
@@ -2,15 +2,29 @@
permalink: /sitemap.xml
eleventyExcludeFromCollections: true
---
-<?xml version="1.0" encoding="utf-8"?>
+<?xml version="1.0" encoding="UTF-8"?>
+<!--
+ ROOT sitemap for munderdiffl.in. Owned + auto-generated by the Eleventy blog
+ build (agreed with Kevin, Option A): includes the marketing homepage plus every
+ blog page so posts never orphan. Eleventy emits it under docs/blog/, then the
+ postbuild step (scripts/postbuild.mjs) moves it to docs/sitemap.xml — which is
+ where robots.txt points (https://munderdiffl.in/sitemap.xml).
+ Post <lastmod> uses real publish/update dates, not build time.
+-->
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
- <url><loc>{{ site.baseUrl }}</loc><changefreq>daily</changefreq><priority>1.0</priority></url>
+ <url>
+ <loc>{{ site.origin }}/</loc>
+ <lastmod>{{ build.date }}</lastmod>
+ <changefreq>weekly</changefreq>
+ <priority>1.0</priority>
+ </url>
+ <url><loc>{{ site.baseUrl }}</loc><changefreq>daily</changefreq><priority>0.9</priority></url>
<url><loc>{{ site.origin }}{{ '/topics/' | u }}</loc><changefreq>weekly</changefreq><priority>0.6</priority></url>
<url><loc>{{ site.origin }}{{ '/about/' | u }}</loc><changefreq>monthly</changefreq><priority>0.4</priority></url>
{%- for p in collections.posts %}
<url>
<loc>{{ site.origin }}{{ p.url | u }}</loc>
- <lastmod>{{ (p.data.updated or p.date) | isoDate }}</lastmod>
+ <lastmod>{{ (p.data.updated or p.date) | htmlDate }}</lastmod>
<changefreq>monthly</changefreq>
<priority>0.8</priority>
</url>
diff --git a/docs/blog/robots.txt b/docs/blog/robots.txt
deleted file mode 100644
index ad6e216d..00000000
--- a/docs/blog/robots.txt
+++ /dev/null
@@ -1,4 +0,0 @@
-User-agent: *
-Allow: /
-
-Sitemap: https://munderdiffl.in/blog/sitemap.xml
diff --git a/docs/blog/sitemap.xml b/docs/blog/sitemap.xml
deleted file mode 100644
index a7b04cf9..00000000
--- a/docs/blog/sitemap.xml
+++ /dev/null
@@ -1,34 +0,0 @@
-<?xml version="1.0" encoding="utf-8"?>
-<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
- <url><loc>https://munderdiffl.in/blog/</loc><changefreq>daily</changefreq><priority>1.0</priority></url>
- <url><loc>https://munderdiffl.in/blog/topics/</loc><changefreq>weekly</changefreq><priority>0.6</priority></url>
- <url><loc>https://munderdiffl.in/blog/about/</loc><changefreq>monthly</changefreq><priority>0.4</priority></url>
- <url>
- <loc>https://munderdiffl.in/blog/how-to-run-multiple-claude-code-agents/</loc>
- <lastmod>2026-06-01T00:00:00.000Z</lastmod>
- <changefreq>monthly</changefreq>
- <priority>0.8</priority>
- </url>
- <url>
- <loc>https://munderdiffl.in/blog/give-claude-code-long-term-memory/</loc>
- <lastmod>2026-05-27T00:00:00.000Z</lastmod>
- <changefreq>monthly</changefreq>
- <priority>0.8</priority>
- </url>
- <url>
- <loc>https://munderdiffl.in/blog/what-is-a-multi-agent-harness/</loc>
- <lastmod>2026-05-22T00:00:00.000Z</lastmod>
- <changefreq>monthly</changefreq>
- <priority>0.8</priority>
- </url>
- <url><loc>https://munderdiffl.in/blog/topics/concepts/</loc><changefreq>weekly</changefreq><priority>0.5</priority></url>
- <url><loc>https://munderdiffl.in/blog/topics/memory/</loc><changefreq>weekly</changefreq><priority>0.5</priority></url>
- <url><loc>https://munderdiffl.in/blog/topics/guides/</loc><changefreq>weekly</changefreq><priority>0.5</priority></url>
- <url><loc>https://munderdiffl.in/blog/tags/claude-code/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>
- <url><loc>https://munderdiffl.in/blog/tags/multi-agent/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>
- <url><loc>https://munderdiffl.in/blog/tags/concepts/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>
- <url><loc>https://munderdiffl.in/blog/tags/memory/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>
- <url><loc>https://munderdiffl.in/blog/tags/mempalace/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>
- <url><loc>https://munderdiffl.in/blog/tags/guides/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>
- <url><loc>https://munderdiffl.in/blog/tags/getting-started/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>
-</urlset>
diff --git a/docs/sitemap.xml b/docs/sitemap.xml
index c8445457..2610f4d2 100644
--- a/docs/sitemap.xml
+++ b/docs/sitemap.xml
@@ -1,45 +1,48 @@
<?xml version="1.0" encoding="UTF-8"?>
+<!--
+ ROOT sitemap for munderdiffl.in. Owned + auto-generated by the Eleventy blog
+ build (agreed with Kevin, Option A): includes the marketing homepage plus every
+ blog page so posts never orphan. Eleventy emits it under docs/blog/, then the
+ postbuild step (scripts/postbuild.mjs) moves it to docs/sitemap.xml — which is
+ where robots.txt points (https://munderdiffl.in/sitemap.xml).
+ Post <lastmod> uses real publish/update dates, not build time.
+-->
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<url>
<loc>https://munderdiffl.in/</loc>
- <lastmod>2026-06-03</lastmod>
+ <lastmod>2026-06-02</lastmod>
<changefreq>weekly</changefreq>
<priority>1.0</priority>
</url>
+ <url><loc>https://munderdiffl.in/blog/</loc><changefreq>daily</changefreq><priority>0.9</priority></url>
+ <url><loc>https://munderdiffl.in/blog/topics/</loc><changefreq>weekly</changefreq><priority>0.6</priority></url>
+ <url><loc>https://munderdiffl.in/blog/about/</loc><changefreq>monthly</changefreq><priority>0.4</priority></url>
<url>
- <loc>https://munderdiffl.in/blog/</loc>
- <lastmod>2026-06-03</lastmod>
- <changefreq>weekly</changefreq>
- <priority>0.8</priority>
- </url>
- <url>
- <loc>https://munderdiffl.in/blog/about/</loc>
- <lastmod>2026-06-03</lastmod>
+ <loc>https://munderdiffl.in/blog/how-to-run-multiple-claude-code-agents/</loc>
+ <lastmod>2026-06-01</lastmod>
<changefreq>monthly</changefreq>
- <priority>0.5</priority>
- </url>
- <url>
- <loc>https://munderdiffl.in/blog/topics/</loc>
- <lastmod>2026-06-03</lastmod>
- <changefreq>weekly</changefreq>
- <priority>0.5</priority>
- </url>
- <url>
- <loc>https://munderdiffl.in/blog/build-your-first-agent-office/</loc>
- <lastmod>2026-06-03</lastmod>
- <changefreq>monthly</changefreq>
- <priority>0.7</priority>
+ <priority>0.8</priority>
</url>
<url>
- <loc>https://munderdiffl.in/blog/how-the-hive-routes-work/</loc>
- <lastmod>2026-06-03</lastmod>
+ <loc>https://munderdiffl.in/blog/give-claude-code-long-term-memory/</loc>
+ <lastmod>2026-05-27</lastmod>
<changefreq>monthly</changefreq>
- <priority>0.7</priority>
+ <priority>0.8</priority>
</url>
<url>
- <loc>https://munderdiffl.in/blog/agentic-coding-while-you-sleep/</loc>
- <lastmod>2026-06-03</lastmod>
+ <loc>https://munderdiffl.in/blog/what-is-a-multi-agent-harness/</loc>
+ <lastmod>2026-05-22</lastmod>
<changefreq>monthly</changefreq>
- <priority>0.7</priority>
+ <priority>0.8</priority>
</url>
+ <url><loc>https://munderdiffl.in/blog/topics/concepts/</loc><changefreq>weekly</changefreq><priority>0.5</priority></url>
+ <url><loc>https://munderdiffl.in/blog/topics/memory/</loc><changefreq>weekly</changefreq><priority>0.5</priority></url>
+ <url><loc>https://munderdiffl.in/blog/topics/guides/</loc><changefreq>weekly</changefreq><priority>0.5</priority></url>
+ <url><loc>https://munderdiffl.in/blog/tags/claude-code/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>
+ <url><loc>https://munderdiffl.in/blog/tags/multi-agent/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>
+ <url><loc>https://munderdiffl.in/blog/tags/concepts/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>
+ <url><loc>https://munderdiffl.in/blog/tags/memory/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>
+ <url><loc>https://munderdiffl.in/blog/tags/mempalace/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>
+ <url><loc>https://munderdiffl.in/blog/tags/guides/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>
+ <url><loc>https://munderdiffl.in/blog/tags/getting-started/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>
</urlset>