|
Office1: edge route to the compose net + Tailscale subnet router + an as-built connection reference
THE ROUTE -- and an OUTAGE I CAUSED AND REVERTED. Adding a LAN gateway on OPNsense for voffice1 SILENTLY STOLE THE DEFAULT ROUTE: the edge's default flipped from 172.30.1.1 (ISP) to 10.10.0.20, and the site lost egress. Root cause: OPNsense's `defaultgw` field in the API output is DERIVED FROM `priority` (lower = more preferred), NOT from the value you send -- I sent defaultgw="0", it came back True, and I had ALREADY run `reconfigure` before reading anything back. Detected within ~2 minutes by checking egress, reverted by deleting the gateway; default route and egress restored. Redone SAFELY: add the gateway, READ THE CONFIG BACK, verify WAN_GW is still the default, and only THEN apply. WAN_GW is now priority 1 (explicitly preferred); OFFICE1_LXD_GW is 255. Verified after apply: default still 172.30.1.1, egress OK, and the edge now routes 10.10.1.0/24 -> 10.10.0.20 and reaches NetBox. The lesson is in the as-built doc's trap list. Also re-learned the hard way: root's shell on the edge is tcsh, so `2>&1` in my verification command died with "Ambiguous output redirect" -- the exact trap already written down in this repo's standing lessons. Feed remote commands to `sh -s`. TAILSCALE: office1-tailscale composed by MAAS (2 cores / 2 GiB / 25 GB -- VR0's sizing), deployed Ubuntu 24.04, Tailscale 1.98.8 installed, IP forwarding on, brought up as a SUBNET ROUTER advertising 10.10.0.0/22 -- exactly the D-115 Office1 carve, so "Office1 only" (D-107) is enforced by the carve itself. Authenticated via the login-URL flow, NOT an auth key: no tailnet secret passes through the session. PENDING OPERATOR: authorize the node, and approve the 10.10.0.0/22 route in the admin console. The tailnet ACL/tag policy remains operator design (runbook open question 5). NEW: docs/vr1-office1-as-built.md -- the operator-requested connection reference. Every value MEASURED, not planned: networks + who owns DHCP on each, hosts/services/levels, how to reach each thing from vcloud AND from a workstation, where every credential lives, and the site's standing traps. Explicitly NOT an address authority -- NetBox is the IPAM apex; this is operational. Also noted: MAAS's bind9 intermittently SERVFAILs a first-time external lookup and succeeds on retry (seen twice -- docker registry, tailscale.com). Retry before diagnosing. repo-lint 0 fail. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> |
|---|
|
|
| docs/vr1-office1-as-built.md 0 → 100644 |
|---|