an open-source alternative to the dots, bots and muses of the world, run an office of claude code/codex like agents on your laptop, sandboxes or anywhere, uses your existing subscriptions
HTML agent-harnessagent-orchestrationagentsai-agentsautonomous-agentsclaude-codecodexcoding-agentsdesktop-appdeveloper-toolselectrongemini-cliharnessharness-engineeringlocal-firstmemorymulti-agentopencodeorchestrationtypescript
feat(blog): own root sitemap.xml; drop redundant blog robots
Chaitanya Giri70b842fc9e4b
diff --git a/.github/workflows/blog.yml b/.github/workflows/blog.ymlindex a8924281..08054934 100644--- a/.github/workflows/blog.yml+++ b/.github/workflows/blog.yml@@ -39,8 +39,10 @@ jobs:run: |git config user.name "github-actions[bot]"git config user.email "github-actions[bot]@users.noreply.github.com"- if [ -n "$(git status --porcelain docs/blog)" ]; then- git add docs/blog+ # docs/blog = the built site; docs/sitemap.xml = root sitemap the+ # build regenerates (owned by this build, per the Kevin handoff).+ if [ -n "$(git status --porcelain docs/blog docs/sitemap.xml)" ]; then+ git add docs/blog docs/sitemap.xmlgit commit -m "chore(blog): rebuild static output [skip ci]"git pushelsediff --git a/blog/BLOG_README.md b/blog/BLOG_README.mdindex 05221ef7..e4eb565b 100644--- a/blog/BLOG_README.md+++ b/blog/BLOG_README.md@@ -121,7 +121,9 @@ They map onto this blog as follows:- **OpenGraph** + **Twitter** card tags, with a default OG image and per-post override.- **JSON-LD**: `Blog` (index), `BlogPosting` + `BreadcrumbList` (every post), `FAQPage` (when a postdeclares `faq`).-- Auto-generated **`sitemap.xml`**, **`robots.txt`**, and an Atom **`feed.xml`**.+- Auto-generated **root `sitemap.xml`** and an Atom **`feed.xml`**.+- **`robots.txt`** is owned by the marketing site (`docs/robots.txt`, maintained alongside+ `docs/index.html`) and points at `https://munderdiffl.in/sitemap.xml`.- Semantic HTML, single `<h1>`, skip-link, `:focus-visible` outlines, WCAG-AA contrast,`prefers-reduced-motion` support, lazy-loaded images.@@ -141,6 +143,17 @@ The blog ships as static files under `docs/blog/`, served by the **existing** PaNo GitHub Pages configuration change is needed. If you ever move the blog off `/blog`, update`BASE` in `eleventy.config.js` and `origin`/`baseUrl` in `src/_data/site.js`.+### Sitemap ownership++This build **owns the root `docs/sitemap.xml`** (agreed with the SEO owner — "Option A"). The build+generates the full sitemap — the marketing homepage **plus** every blog page — and a postbuild step+(`scripts/postbuild.mjs`) moves it from `docs/blog/sitemap.xml` up to `docs/sitemap.xml`, which is+where `docs/robots.txt` points crawlers. Post `<lastmod>` values come from real publish/update dates,+never build time. Don't hand-edit `docs/sitemap.xml` — it's regenerated every build.++The blog **RSS** feed is emitted at `docs/blog/feed.xml` (served at `/blog/feed.xml`), matching the+`<link rel="alternate">` already in the marketing site's `<head>`.+---## Project layout@@ -149,6 +162,7 @@ No GitHub Pages configuration change is needed. If you ever move the blog off `/blog/eleventy.config.js # config, filters, collections, /blog base + markdown anchorspackage.json+ scripts/postbuild.mjs # moves the generated sitemap to docs/sitemap.xml (root)src/_data/site.js # site-level SEO + cluster config (Kevin's site-level inputs)@@ -164,6 +178,6 @@ blog/topics-index.njk # /topicstopic.njk # /topics/<cluster>/ (paginated per category)tag.njk # /tags/<tag>/ (paginated per tag)- about.md 404.njk feed.njk sitemap.njk robots.njk-→ builds into ../docs/blog/+ about.md 404.njk feed.njk sitemap.njk+→ builds into ../docs/blog/ (+ ../docs/sitemap.xml at the root)```diff --git a/blog/package.json b/blog/package.jsonindex b5c3c339..fa9e7e3b 100644--- a/blog/package.json+++ b/blog/package.json@@ -6,7 +6,7 @@"license": "MIT","type": "module","scripts": {- "build": "npm run clean && eleventy",+ "build": "npm run clean && eleventy && node scripts/postbuild.mjs","dev": "eleventy --serve --port=8088","clean": "rimraf ../docs/blog"},diff --git a/blog/scripts/postbuild.mjs b/blog/scripts/postbuild.mjsnew file mode 100644index 00000000..036dfb9f--- /dev/null+++ b/blog/scripts/postbuild.mjs@@ -0,0 +1,20 @@+// Postbuild: move the generated sitemap to the site ROOT (docs/sitemap.xml).+//+// Eleventy can only write inside its output dir (docs/blog), but robots.txt+// points crawlers at https://munderdiffl.in/sitemap.xml — the repo root. So we+// move docs/blog/sitemap.xml up to docs/sitemap.xml after the build. The sitemap+// uses absolute URLs, so its location on disk doesn't affect its contents.+//+// Runs with cwd = blog/ (npm sets it to the package dir).+import { rename } from "node:fs/promises";++const from = "../docs/blog/sitemap.xml";+const to = "../docs/sitemap.xml";++try {+ await rename(from, to);+ console.log(`[postbuild] sitemap → docs/sitemap.xml (root)`);+} catch (err) {+ console.error(`[postbuild] failed to move sitemap: ${err.message}`);+ process.exit(1);+}diff --git a/blog/src/_data/build.js b/blog/src/_data/build.jsindex b1c6f418..b6961be1 100644--- a/blog/src/_data/build.js+++ b/blog/src/_data/build.js@@ -1,6 +1,8 @@// Build-time metadata. `new Date()` here is fine — it's the build machine clock,// not the Eleventy template layer.+const now = new Date();export default {- year: new Date().getUTCFullYear(),- timestamp: new Date().toISOString(),+ year: now.getUTCFullYear(),+ timestamp: now.toISOString(),+ date: now.toISOString().slice(0, 10), // YYYY-MM-DD};diff --git a/blog/src/robots.njk b/blog/src/robots.njkdeleted file mode 100644index 127a1259..00000000--- a/blog/src/robots.njk+++ /dev/null@@ -1,8 +0,0 @@-----permalink: /robots.txt-eleventyExcludeFromCollections: true-----User-agent: *-Allow: /--Sitemap: {{ site.baseUrl }}sitemap.xmldiff --git a/blog/src/sitemap.njk b/blog/src/sitemap.njkindex 30d91ff4..a07c0ab5 100644--- a/blog/src/sitemap.njk+++ b/blog/src/sitemap.njk@@ -2,15 +2,29 @@permalink: /sitemap.xmleleventyExcludeFromCollections: true----<?xml version="1.0" encoding="utf-8"?>+<?xml version="1.0" encoding="UTF-8"?>+<!--+ ROOT sitemap for munderdiffl.in. Owned + auto-generated by the Eleventy blog+ build (agreed with Kevin, Option A): includes the marketing homepage plus every+ blog page so posts never orphan. Eleventy emits it under docs/blog/, then the+ postbuild step (scripts/postbuild.mjs) moves it to docs/sitemap.xml — which is+ where robots.txt points (https://munderdiffl.in/sitemap.xml).+ Post <lastmod> uses real publish/update dates, not build time.+--><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">- <url><loc>{{ site.baseUrl }}</loc><changefreq>daily</changefreq><priority>1.0</priority></url>+ <url>+ <loc>{{ site.origin }}/</loc>+ <lastmod>{{ build.date }}</lastmod>+ <changefreq>weekly</changefreq>+ <priority>1.0</priority>+ </url>+ <url><loc>{{ site.baseUrl }}</loc><changefreq>daily</changefreq><priority>0.9</priority></url><url><loc>{{ site.origin }}{{ '/topics/' | u }}</loc><changefreq>weekly</changefreq><priority>0.6</priority></url><url><loc>{{ site.origin }}{{ '/about/' | u }}</loc><changefreq>monthly</changefreq><priority>0.4</priority></url>{%- for p in collections.posts %}<url><loc>{{ site.origin }}{{ p.url | u }}</loc>- <lastmod>{{ (p.data.updated or p.date) | isoDate }}</lastmod>+ <lastmod>{{ (p.data.updated or p.date) | htmlDate }}</lastmod><changefreq>monthly</changefreq><priority>0.8</priority></url>diff --git a/docs/blog/robots.txt b/docs/blog/robots.txtdeleted file mode 100644index ad6e216d..00000000--- a/docs/blog/robots.txt+++ /dev/null@@ -1,4 +0,0 @@-User-agent: *-Allow: /--Sitemap: https://munderdiffl.in/blog/sitemap.xmldiff --git a/docs/blog/sitemap.xml b/docs/blog/sitemap.xmldeleted file mode 100644index a7b04cf9..00000000--- a/docs/blog/sitemap.xml+++ /dev/null@@ -1,34 +0,0 @@-<?xml version="1.0" encoding="utf-8"?>-<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">- <url><loc>https://munderdiffl.in/blog/</loc><changefreq>daily</changefreq><priority>1.0</priority></url>- <url><loc>https://munderdiffl.in/blog/topics/</loc><changefreq>weekly</changefreq><priority>0.6</priority></url>- <url><loc>https://munderdiffl.in/blog/about/</loc><changefreq>monthly</changefreq><priority>0.4</priority></url>- <url>- <loc>https://munderdiffl.in/blog/how-to-run-multiple-claude-code-agents/</loc>- <lastmod>2026-06-01T00:00:00.000Z</lastmod>- <changefreq>monthly</changefreq>- <priority>0.8</priority>- </url>- <url>- <loc>https://munderdiffl.in/blog/give-claude-code-long-term-memory/</loc>- <lastmod>2026-05-27T00:00:00.000Z</lastmod>- <changefreq>monthly</changefreq>- <priority>0.8</priority>- </url>- <url>- <loc>https://munderdiffl.in/blog/what-is-a-multi-agent-harness/</loc>- <lastmod>2026-05-22T00:00:00.000Z</lastmod>- <changefreq>monthly</changefreq>- <priority>0.8</priority>- </url>- <url><loc>https://munderdiffl.in/blog/topics/concepts/</loc><changefreq>weekly</changefreq><priority>0.5</priority></url>- <url><loc>https://munderdiffl.in/blog/topics/memory/</loc><changefreq>weekly</changefreq><priority>0.5</priority></url>- <url><loc>https://munderdiffl.in/blog/topics/guides/</loc><changefreq>weekly</changefreq><priority>0.5</priority></url>- <url><loc>https://munderdiffl.in/blog/tags/claude-code/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>- <url><loc>https://munderdiffl.in/blog/tags/multi-agent/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>- <url><loc>https://munderdiffl.in/blog/tags/concepts/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>- <url><loc>https://munderdiffl.in/blog/tags/memory/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>- <url><loc>https://munderdiffl.in/blog/tags/mempalace/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>- <url><loc>https://munderdiffl.in/blog/tags/guides/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>- <url><loc>https://munderdiffl.in/blog/tags/getting-started/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>-</urlset>diff --git a/docs/sitemap.xml b/docs/sitemap.xmlindex c8445457..2610f4d2 100644--- a/docs/sitemap.xml+++ b/docs/sitemap.xml@@ -1,45 +1,48 @@<?xml version="1.0" encoding="UTF-8"?>+<!--+ ROOT sitemap for munderdiffl.in. Owned + auto-generated by the Eleventy blog+ build (agreed with Kevin, Option A): includes the marketing homepage plus every+ blog page so posts never orphan. Eleventy emits it under docs/blog/, then the+ postbuild step (scripts/postbuild.mjs) moves it to docs/sitemap.xml — which is+ where robots.txt points (https://munderdiffl.in/sitemap.xml).+ Post <lastmod> uses real publish/update dates, not build time.+--><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"><url><loc>https://munderdiffl.in/</loc>- <lastmod>2026-06-03</lastmod>+ <lastmod>2026-06-02</lastmod><changefreq>weekly</changefreq><priority>1.0</priority></url>+ <url><loc>https://munderdiffl.in/blog/</loc><changefreq>daily</changefreq><priority>0.9</priority></url>+ <url><loc>https://munderdiffl.in/blog/topics/</loc><changefreq>weekly</changefreq><priority>0.6</priority></url>+ <url><loc>https://munderdiffl.in/blog/about/</loc><changefreq>monthly</changefreq><priority>0.4</priority></url><url>- <loc>https://munderdiffl.in/blog/</loc>- <lastmod>2026-06-03</lastmod>- <changefreq>weekly</changefreq>- <priority>0.8</priority>- </url>- <url>- <loc>https://munderdiffl.in/blog/about/</loc>- <lastmod>2026-06-03</lastmod>+ <loc>https://munderdiffl.in/blog/how-to-run-multiple-claude-code-agents/</loc>+ <lastmod>2026-06-01</lastmod><changefreq>monthly</changefreq>- <priority>0.5</priority>- </url>- <url>- <loc>https://munderdiffl.in/blog/topics/</loc>- <lastmod>2026-06-03</lastmod>- <changefreq>weekly</changefreq>- <priority>0.5</priority>- </url>- <url>- <loc>https://munderdiffl.in/blog/build-your-first-agent-office/</loc>- <lastmod>2026-06-03</lastmod>- <changefreq>monthly</changefreq>- <priority>0.7</priority>+ <priority>0.8</priority></url><url>- <loc>https://munderdiffl.in/blog/how-the-hive-routes-work/</loc>- <lastmod>2026-06-03</lastmod>+ <loc>https://munderdiffl.in/blog/give-claude-code-long-term-memory/</loc>+ <lastmod>2026-05-27</lastmod><changefreq>monthly</changefreq>- <priority>0.7</priority>+ <priority>0.8</priority></url><url>- <loc>https://munderdiffl.in/blog/agentic-coding-while-you-sleep/</loc>- <lastmod>2026-06-03</lastmod>+ <loc>https://munderdiffl.in/blog/what-is-a-multi-agent-harness/</loc>+ <lastmod>2026-05-22</lastmod><changefreq>monthly</changefreq>- <priority>0.7</priority>+ <priority>0.8</priority></url>+ <url><loc>https://munderdiffl.in/blog/topics/concepts/</loc><changefreq>weekly</changefreq><priority>0.5</priority></url>+ <url><loc>https://munderdiffl.in/blog/topics/memory/</loc><changefreq>weekly</changefreq><priority>0.5</priority></url>+ <url><loc>https://munderdiffl.in/blog/topics/guides/</loc><changefreq>weekly</changefreq><priority>0.5</priority></url>+ <url><loc>https://munderdiffl.in/blog/tags/claude-code/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>+ <url><loc>https://munderdiffl.in/blog/tags/multi-agent/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>+ <url><loc>https://munderdiffl.in/blog/tags/concepts/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>+ <url><loc>https://munderdiffl.in/blog/tags/memory/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>+ <url><loc>https://munderdiffl.in/blog/tags/mempalace/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>+ <url><loc>https://munderdiffl.in/blog/tags/guides/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url>+ <url><loc>https://munderdiffl.in/blog/tags/getting-started/</loc><changefreq>weekly</changefreq><priority>0.3</priority></url></urlset>