Agent Mesh
Go a2aa2a-protocolagent-meshagentic-aiinferencemcpmeshmesh-networknetwork-securitynetworking-aip2p-network
Private DIY Enterprise Stack — Safely On-Premises & in Cloud (Gemma / DeepSeek + Agent Harness + Agent Mesh)
Run a zero-trust AI workforce safely across on-premises infrastructure and Google Cloud (Cloud Run, GKE, or local servers) without site-to-site VPNs, inbound firewall holes, or raw credentials inside agent containers:
The "Sidecar" Node Architecture Across On-Prem & Cloud:
node-agent.yamlruns alongside your agent (agent_harness.py, whether on a workstation, Cloud Run, or GKE) and exposes the mesh as a local Model Context Protocol (MCP) server (127.0.0.1:19101/mcp) and a local OpenAI-compatible endpoint (127.0.0.1:19101/v1). The agent has zero database credentials or network routing code.node-inference.yamlsits next to your GPU reasoning server (Ollama/vLLMservingdeepseek-r1:1.5borgemma3in cloud or on-prem) and publishesinference://private-llmto the mesh.node-tools.yamlsits inside the on-premises vault zone next to your private SQLite ERP database (mcp://erp-db), Payroll vault (mcp://payroll-vault), and internal Vendor Compliance REST API (egress://compliance.internal), injecting the Vault-brokered API secret (secrets/compliance-api-key) at the egress boundary so sensitive credentials never leave the vault node.
Zero-Trust Identity & Default-Deny Policy (
policy.json):- Default-Deny on Service Names: Even though
mcp://payroll-vaultruns on the same vault node asmcp://erp-db, the control plane policy only grantsmcp://erp-db—calls tomcp://payroll-vaultare cryptographically rejected. - HTTP Method/Path Guardrails:
egress://compliance.internalpermitsGET /v1/vendors/*and blocksPOSTmutations withHTTP 403. - Residency & Department Labels:
node-tools.yamlenforcescheck if label("residency", "on-prem");andcheck if label("dept", "finance");. - Task-Scoped Sealed Biscuits (
tar_block): Minting a task token via RFC 8693/oauth/tokennarrows the agent's Biscuit tolookup_invoiceandcheck_inventory, blocking prompt-injected calls toexecute_wire_transfer.
- Default-Deny on Service Names: Even though
Quick Start
# 1. Run the 4-act CLI verification script (~12s, zero external dependencies)
make -C development/examples/private-diy-stack run
# 2. Launch the Interactive Browser Workbench on http://127.0.0.1:18899
make -C development/examples/private-diy-stack ui
# 3. Or connect inference://private-llm to a live Ollama / vLLM server:
USE_LIVE_OLLAMA=1 OLLAMA_MODEL=deepseek-r1:1.5b \
make -C development/examples/private-diy-stack ui
# 4. Re-record the 3-pane terminal MP4 walkthrough (see SCRIPT.md):
make -C development/examples/private-diy-stack record