Session changelog (GA-R2/D1: ONE per session). Branch dc-dc-stage5-preconditions. Session open reconciled at HEAD c620f99: repo-lint 0 fail / 1 legacy warn, ledger-scan 3 open decisions / 28 open SEC / next-free D-141, DOCFIX-208, BUNDLEFIX-053. Status claims live in docs/CURRENT-STATE.md ONLY.
Scope: the item both the 2026-08-02 (part 2) close and docs/CURRENT-STATE.md name as the next session's FIRST item -- the preflight-P2 / phase-4 machines-overlay asymmetry -- worked to completion ahead of the bundle deploy.
WHAT WAS WRONG. runbooks/dc-dc-phase4-juju-bundle-per-dc.md told the operator to deploy vr1-dc0 as bundle.yaml + vr1-dc0-vips.yaml + vr1-dc0-octavia-pki.yaml, omitting overlays/vr1-dc0-machines.yaml. Its stated reason -- "there is no overlays/vr1-dc0-machines.yaml" (:527-528) -- had been FALSE since 2026-07-29, when that file was created (changelog-20260729 item 3.8). scripts/preflight.sh:144-145 folds the file into the merged input that gate P2 validates, so P2 was grading an input the deploy would not have passed.
WHY IT WAS NOT HYGIENE. The classification carried into this session was "DOCFIX-shaped ... likely bundles with the outstanding D-138 run-location DOCFIX" (changelog-20260802-queued-items item 5, finding 2). That is too low: the disputed artifact is the argument list of the very next live mutation. Executed as written, a dc0 deploy would have taken TWO independent injuries, neither of which surfaces as a deploy error:
bundle.yaml:494 states bridge-interface-mappings "IS NOT IN THIS FILE, and must never be re-added here" -- the overlay is its ONLY source. ovn-chassis would deploy with no br-ex mapping and tenant networks would come up with no external path. This is exactly the defect the 2026-07-29 move out of the base bundle was made to fix, reintroduced by stale prose.openstack-origin + 3 ceph source at the in-DC mirror. Without it those charms fetch ubuntu-cloud.archive.canonical.com, MEASURED UNREACHABLE from a node (000) under the D-107 airgap -- a failure at package-install time.MEASURED, NOT REASONED. Deep-merging bundle.yaml against the overlay:
overlay top-level keys: ['applications'] <- NO machines: block at all
apps in overlay: 16
ovn-chassis.bridge-interface-mappings: ADDS
barbican / magnum / octavia / ceph-mon / ceph-osd / ceph-radosgw : OVERRIDES (6)
cinder, designate, glance, keystone, neutron-api, nova-cloud-controller,
nova-compute, openstack-dashboard, placement : ADDS (9)
base ovn-chassis options: {'ovn-bridge-mappings': 'physnet1:br-ex',
'prefer-chassis-as-gw': True}
THIS CORRECTS THIS REPO'S OWN EARLIER FINDING (GA-R1 C2). docs/CURRENT-STATE.md recorded 2026-07-31 that "the only delta it makes to the merged input is ovn-chassis.options.bridge-interface-mappings". That was TRUE WHEN TAKEN and was overtaken HOURS LATER IN THE SAME SESSION by the UCA build. Sixteen applications, not one. The correcting capture is folded into the same CURRENT-STATE entry rather than replacing it.
THE FILE NAME IS WHAT MISLED THE RUNBOOK. dc0 genuinely needs no machines RETAG -- bundle.yaml's machines block already reads tags=openstack-vr1-dc0,<role> -- and the old table row said so correctly. The error was concluding from that true fact that the FILE is unnecessary. The overlay is the per-DC HAND-MAINTAINED overlay and its applications: half is load-bearing; its own header says so and says not to add a machines: block for symmetry.
WHAT CHANGED (runbooks/dc-dc-phase4-juju-bundle-per-dc.md, 6 sites):
overlays/${DC}-machines.yaml, REQUIRED for BOTH DCs, with the measured 16-app delta and the reason the old reading was wrong.vr1-dc0" paragraph replaced. The never-silently-skip-an-overlay rule is KEPT (it is right, and it is why a dc1 deploy cannot merge dc0 tags); only its dc0 exemption goes.--dry-run.applications.options merge).NOT CHANGED, because it was already right: scripts/preflight.sh P2 and runbooks/phase-01-bundle-deploy.md:199-201 both assemble the three-overlay set behind a [ -f ] guard. This was one wrong surface, not two disagreeing.
git revert this commit. The runbook returns to a dc0 command that omits a required overlay -- do not revert without also re-opening the finding in docs/CURRENT-STATE.md.The standing rule that a checker which cannot fail is not a gate applies to the gate as much as the command. Step 4.2's four gate items read the machines block, the machine count, the VIP prefixes, and overlay-path errors. The machines overlay's entire payload is under applications:, so all four would have passed a dc0 deploy with no provider bridge mapping and 15 unreachable package sources. Two added:
ovn-chassis shows THREE options, not one. bridge-interface-mappings must appear ALONGSIDE ovn-bridge-mappings: physnet1:br-ex and prefer-chassis-as-gw: true. This is the VERIFY-LIVE assertion both overlays' headers demand and that NO offline check can make: provider-bundle-check.py's _deep_merge merges key-by-key BY CONSTRUCTION, so validating through it cannot distinguish a key-by-key merge from a map REPLACE. Only the live dry-run can. If only the new key appears, the physnet mapping and the B2 gateway-chassis election are both gone from the deploy input and provider egress dies by a different route than the defect item 1 fixes. Also: exactly TWO MACs, a third means a wrong node.openstack-origin / ceph source resolves to an address this DC's nodes can reach. Names dc1's deliberate absence of the block as D-135's experiment RESULT, so a later reader does not "fix" the asymmetry.>>> ITEMS 5 AND 6 AS FIRST WRITTEN WERE THEMSELVES CHECKERS THAT COULD NOT FAIL, AND WERE REMOVED WITHIN THE HOUR. SEE ITEM 3. <<< Left recorded here rather than edited out: the mistake is the point.
THE RUN. docs/audit/stage5-dryrun-dc0-20260802.txt (400 lines). From the dc0 rack (D-138), model vr1-dc0, juju 3.6.27, model EMPTY at run time. Deploy input sha256-verified against HEAD immediately before the run, not inherited from the prior close: all five tracked files match, PKI overlay unchanged at 5fc117f1 mode 0600 (hashed, never read). EXIT 0.
PASSED: nine machines 0-8; all 9 constraint lines arch=amd64 tags=openstack-vr1-dc0,<role> in the 3/2/4 split, none naming the other DC; all three overlays consumed without a path error. Also settled the ceph-osd tags=openstack item CURRENT-STATE deferred to this gate: the plan places ceph-osd/0..3 on machines 5-8 by explicit placement and the bare tag never appears -- the exposure remains a later UNPLACED add-unit, which this deploy does not perform.
THE INSTRUMENT FINDING. Measured at both verbosities: juju deploy --dry-run on a bundle prints ONLY located charms, upload/deploy lines, BARE machine ids, placement and relations. No application options, no VIPs, at any verbosity. Greps over the --debug capture: bridge-interface-mappings 0, physnet1 0, openstack-origin 0, cloud-archive 0, prefer-chassis 0. The only 10.12.4. hits are the controller's own API addresses; the only vip hit is the echoed command line. --debug adds exactly one thing -- the per-machine constraint lines (bundlehandler.go:1035).
Three consequences, all fixed here:
--dry-run --debug, with the measurement quoted as the reason so nobody drops the flag as noise.juju config read run the moment juju deploy returns, before the model settles. That is the only thing that can prove the merge: _deep_merge in provider-bundle-check.py merges key-by-key BY CONSTRUCTION, so it cannot distinguish a key-by-key merge from a map REPLACE, and the dry-run sees no options at all.OWNED. I added two assertions that could not fail to the very gate whose purpose was to catch a defect that had survived precisely because nothing could see it. They were caught by the live run, not by re-reading my own work -- instance fourteen of this repo's instrument-currency pattern and the second consecutive session where measurement, not review, was the catching agent.
ALSO CORRECTED: both machines overlays' VERIFY-LIVE headers, which instructed the reader to assert the options merge "at the live dry-run". Measured impossible. Corrected in place (not deleted) and pointed at Step 4.4. dc1's header additionally notes the split that dc0's does not have: dc1's machines BLOCK is visible in the --debug plan and is gradable at 4.2; only its options half is not.
git revert. Restores a gate with three ungradable items and two overlay headers naming an impossible check.runbooks/phase-00-teardown-maas-reset.md:233 runs provider-bundle-check.py with the vips overlay ONLY, so it grades a narrower input than either preflight P2 or the deploy command. Not deploy-blocking (teardown-time check), DOCFIX material for the same fold. Recorded in docs/CURRENT-STATE.md, not actioned.I raised, as an unresolved question for the operator, that the plan deploys four designate applications while the phase-4 bullet says the bundle ships "NO designate". There was nothing to resolve, and two greps would have shown it.
bundle.yaml on 2026-07-10, and runbooks/phase-01-bundle-deploy.md:13-16 / :174 already record it -- :174 says the change "corrects this GATE's old 'NO designate (D-019)' text, since D-019 is superseded".os-public-hostname reversal (docs/dc-dc-deployment-workflow.md Stage 7; bundle.yaml:898-902 says the same).Four designate applications in the Stage-5 plan is the PLANNED outcome; their absence would have been the defect. The stale artifact was the phase-4 bullet alone, paraphrasing a gate text phase-01 corrected 23 days earlier. It is rewritten to state the D-106 reactivation and the Stage-5/Stage-7 split; my annotation is DELETED rather than kept as history, because leaving it would mislead the next reader about a live deploy input.
OPERATOR CORRECTION, quoted because the failure is the point: "you have completely missed the shape, grounding, and goal of this version of the deployment. We have been building on each previous successful deployment and layering on new services and features in a deliberate and planned manner ... In the past that has caused huge problems with next step attention and you have gotten stuck troubleshooting and diagnosing rather than working through steps to continue the deployment."
The durable rule: VR0 -> VR1 is ADDITIVE. Before flagging any application in a plan as unexpected, check whether a D-number ADDS it in this generation -- Designate (D-106), cinder-backup and ceph-rbd-mirror (D-108) all arrive that way in the same shared bundle. This repo's standing lesson already covers the process failure: a finding is an observation, not a conclusion -- measure before putting it to the operator.
Same class, also withdrawn: the dry-run's WARNING These fields ... name ... variables ... will be ignored is the pair of benign R11 warnings phase-01-bundle-deploy.md:175-176 already documents. I had not flagged it, but I had not recognised it either.
references/platform-traps.md gains a Juju section: what a bundle --dry-run prints, what it does not print at any verbosity, the two grep decoys (the controller's own API addresses look like VIPs from the DC's band; --debug echoes the command line so overlay FILENAMES hit), and the three consequences -- a dry-run cannot verify an options merge, --debug is load-bearing for any tags/constraints assertion, and juju config on the deployed model is the only instrument that settles the merge question. It generalizes past this repo's phase-4 gate to any bundle deploy in the chain, so a changelog was the wrong home for it (standing rule: durable observations graduate to their repo surface).
Two corrections to the block written in item 3, both before it ever runs:
--format=json read indexed ["settings"][key]["value"] directly. A missing key raises KeyError, and a traceback printed into a results column reads like output -- this repo has a logged instance of an assertion being satisfied by a traceback. Now .get(...) with a visible <<UNSET-OR-APP-ABSENT>> sentinel, documented as a FAILURE rather than a blank.Step 4.4 is AUTHORED, NOT EXERCISED. It is written against a measured instrument but has never run -- the model was empty when it was written, so its first execution is at deploy time. Stated in the runbook itself, with the instruction to report a shape correction rather than work around one, and a note that designate appears in its loop while an unresolved contradiction says the bundle should not carry designate at this stage.
Revert: restore the direct index. Do not.
Gates at delivery: bash scripts/repo-lint.sh -- 0 fail, 1 warn (the legacy D-001..018 ASCII carve-out). provider-bundle-check.py over the dc0 merged input PASS. Both machines overlays re-parsed after editing (dc0: applications only, 16 apps; dc1: applications + machines). No script changed, so no harness is implicated; the gauntlet's last full run stands at ALL GREEN (98) from the 2026-08-02 (part 2) close.
THE DEPLOY IS NOT RUN. Step 4.3 is a gated mutation and awaits operator approval. This session stops at the dry-run.
Operator: "Approved, continue as autonomously as possible" -- covering the single-file overlay re-stage and Step 4.3.
Re-stage (mutation 1). scp -p overlays/vr1-dc0-machines.yaml to the rack's ~/repo-stage, restoring the digest-match invariant after this session's comment-only edit. Verified dd914358 both ends. Single file, for the same reason the 2026-07-31 and 08-02 re-stages were single-file: a wholesale refresh risks the 0600 PKI overlay (SEC-029).
Deploy (mutation 2). All six inputs sha256-verified against HEAD in the same window, model confirmed empty, then the DOCFIX-208 command. Result: Deploy of bundle completed. EXIT 0. Capture: docs/audit/stage5-deploy-dc0-20260802.txt.
Step 4.4 -- first ever execution, ALL THREE ITEMS PASS.
options map KEY-BY-KEY, it does not replace it. ovn-chassis shows all three options source: user -- bridge-interface-mappings (exactly two MACs), ovn-bridge-mappings: physnet1:br-ex, prefer-chassis-as-gw: true. Nothing offline could settle this (_deep_merge merges key-by-key by construction) and the dry-run prints no options at all. The whole *-vips.yaml architecture rests on it.ovn-central reads source: zed -- its charm default, deliberately left alone.The gate needed no shape correction. The .get()/sentinel hardening was never exercised, because every key was present; that is the good outcome, not evidence the hardening was unnecessary.
Measured in passing: ceph-osd/0..3 already carry GUA IPv6 (2602:f3e2:f02:10::150-153), so the D-139 carve is live on the addresses juju is provisioning against.
juju remove-application per app, or destroy and recreate the vr1-dc0 model. Not a git revert -- this item is a live-cloud mutation.