diff --git a/docs/milestones/mil-011-code-metrics-default-tools-ref.md b/docs/milestones/mil-011-code-metrics-default-tools-ref.md index d207093..f1ebf67 100644 --- a/docs/milestones/mil-011-code-metrics-default-tools-ref.md +++ b/docs/milestones/mil-011-code-metrics-default-tools-ref.md @@ -10,6 +10,7 @@ | Date | Status | Author | Reviewer | Change | Commit | | --- | --- | --- | --- | --- | --- | | 2026-10-14 | Accepted | Jens Tirsvad Nielsen | S01 | Initial version; reviewed (RC-076), accepted by the author in chat as stand-in for S01 | [02e3794] | +| 2026-10-14 | Proposed | Jens Tirsvad Nielsen | S01 | Added the results of task 1 (reproduction and the defaults of the five workflows) | [e11c43f] | --- @@ -77,6 +78,27 @@ A patch release (`2.1.1`, [ADR-0006]) in which: the default `tools-ref` of every | 8 | Add MIL-011 to the Project Plan | Add the schedule row, the Gantt bar, the scope entry and the dependency to [PP-001], and its review to the traceability matrix. | No | | | 9 | Review | Record `RC-*` for this milestone, the workflow and tests, and the guides, each with a verdict. | No | | +## Verification results + +Task 1 was run on 2026-10-14 with the throwaway branch `verify-code-metrics-defaults` of `TirSystem/github-action`. It calls `code-metrics.yml` at the two refs a caller could use, with every input at its default. + +| Call | Result | Evidence | +| --- | --- | --- | +| `...code-metrics.yml@v2`, defaults | Fails in the step "Validate the inputs": `bash: shared-scripts/tools/code-metrics.sh: No such file or directory`, exit code 127. The input `tools-ref` is `v1`, so the scripts are fetched from `v1`. | run 1499, job 1638 | +| `...code-metrics.yml@v1`, defaults | No run is created at all, and no error is shown: two pushes of a workflow that calls it (once with the `@v2` job beside it, once alone) made no run in over a minute, while the push of the `@v2` call alone made one | commits `5654905` and `46e752d` (no run), `9a17868` (run 1499) | + +The defaults of the five reusable workflows at `v2.1.0` (`v1` is `1.2.2`, `v2` is `2.1.0`): + +| Workflow | Default `tools-ref` | Script it runs | At the default | At `v2` | +| --- | --- | --- | --- | --- | +| `code-metrics.yml` | `v1` | `tools/code-metrics.sh` | **absent** | present | +| `quality-checks.yml` | `v1` | `tools/quality-checks.sh` | present | present | +| `quality-checks-cpp.yml` | `v1` | `tools/quality-checks-cpp.sh` | present | present | +| `quality-checks-csharp.yml` | `v1` | `tools/quality-checks-csharp.sh` | present | present | +| `publish-wiki-pages.yml` | `v1` | `tools/publish_wiki.py` | present | present | + +Only `code-metrics.yml` is broken. The other four resolve, but a caller at `@v2` runs their scripts from `1.2.2` and not from `2.1.0`; `tools/publish_wiki.py` changed in `2.0.0` (it requires `WIKI_PRUNE` and no longer reads a marker). Whether that is a defect is decided in task 2. + --- [BC-001]: ../business-case.md @@ -86,3 +108,4 @@ A patch release (`2.1.1`, [ADR-0006]) in which: the default `tools-ref` of every [ADR-0006]: ../adr/adr-0006-release-process-and-version-pinning.md [PP-001]: ../project-plan.md [02e3794]: https://git.tirsystem.com/TirSystem/github-action/commit/02e3794d7b05799af2544ca303c99271da788e82 +[e11c43f]: https://git.tirsystem.com/TirSystem/github-action/commit/e11c43f0a41e7dd9647f7804947d6e464407a597