diff --git a/docs/reference/full-release-validation.md b/docs/reference/full-release-validation.md index b73cc36763d..c241d94dc03 100644 --- a/docs/reference/full-release-validation.md +++ b/docs/reference/full-release-validation.md @@ -29,14 +29,14 @@ when validating an older release branch or tag. ## Top-level stages -| Stage | Workflow job name | Child workflow | What it proves | Rerun handle | -| --------------------- | --------------------------------------- | ------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | ---------------------------------------------------------------- | -| Target resolution | `Resolve target ref` | none | Resolves the release branch, tag, or full commit SHA and records selected inputs. | Rerun the umbrella if this fails. | -| Vitest and normal CI | `Run normal full CI` | `CI` | Manual full CI graph against the target ref, including Linux Node lanes, bundled plugin shards, channel contracts, Node 22 compatibility, `check`, `check-additional`, build smoke, docs checks, Python skills, Windows, macOS, Control UI i18n, and Android via the umbrella. | `rerun_group=ci` | -| Plugin prerelease | `Run plugin prerelease validation` | `Plugin Prerelease` | Release-only plugin static checks, agentic plugin coverage, full extension batch shards, and plugin prerelease Docker lanes. | `rerun_group=plugin-prerelease` | -| Release checks | `Run release/live/Docker/QA validation` | `OpenClaw Release Checks` | Install smoke, cross-OS package checks, live/E2E suites, Docker release-path chunks, Package Acceptance, QA Lab parity, live Matrix, and live Telegram. | `rerun_group=release-checks` or a narrower release-checks handle | -| Post-publish Telegram | `Run post-publish Telegram E2E` | `NPM Telegram Beta E2E` | Optional published-package Telegram proof when `npm_telegram_package_spec` is set. | `rerun_group=npm-telegram` | -| Umbrella verifier | `Verify full validation` | none | Re-checks recorded child run conclusions and appends slowest-job tables from child workflows. | Rerun only this job after rerunning a failed child to green. | +| Stage | Details | +| --------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | +| Target resolution | **Job:** `Resolve target ref`
**Child workflow:** none
**Proves:** resolves the release branch, tag, or full commit SHA and records selected inputs.
**Rerun:** rerun the umbrella if this fails. | +| Vitest and normal CI | **Job:** `Run normal full CI`
**Child workflow:** `CI`
**Proves:** manual full CI graph against the target ref, including Linux Node lanes, bundled plugin shards, channel contracts, Node 22 compatibility, `check`, `check-additional`, build smoke, docs checks, Python skills, Windows, macOS, Control UI i18n, and Android via the umbrella.
**Rerun:** `rerun_group=ci`. | +| Plugin prerelease | **Job:** `Run plugin prerelease validation`
**Child workflow:** `Plugin Prerelease`
**Proves:** release-only plugin static checks, agentic plugin coverage, full extension batch shards, and plugin prerelease Docker lanes.
**Rerun:** `rerun_group=plugin-prerelease`. | +| Release checks | **Job:** `Run release/live/Docker/QA validation`
**Child workflow:** `OpenClaw Release Checks`
**Proves:** install smoke, cross-OS package checks, live/E2E suites, Docker release-path chunks, Package Acceptance, QA Lab parity, live Matrix, and live Telegram.
**Rerun:** `rerun_group=release-checks` or a narrower release-checks handle. | +| Post-publish Telegram | **Job:** `Run post-publish Telegram E2E`
**Child workflow:** `NPM Telegram Beta E2E`
**Proves:** optional published-package Telegram proof when `npm_telegram_package_spec` is set.
**Rerun:** `rerun_group=npm-telegram`. | +| Umbrella verifier | **Job:** `Verify full validation`
**Child workflow:** none
**Proves:** re-checks recorded child run conclusions and appends slowest-job tables from child workflows.
**Rerun:** rerun only this job after rerunning a failed child to green. | For `ref=main` and `rerun_group=all`, a newer umbrella supersedes an older one. When the parent is cancelled, its monitor cancels any child workflow it already @@ -49,19 +49,19 @@ default. once and prepares a shared `release-package-under-test` artifact when package or Docker-facing stages need it. -| Stage | Workflow job name | Backing workflow or jobs | What it tests | Rerun handle | -| ------------------- | ------------------------------------------------------- | --------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | ----------------------------------------------------------- | -| Release target | `Resolve target ref` | none | Validates the selected ref, optional expected SHA, profile, rerun group, and focused live suite filter. | Rerun `release-checks`. | -| Package artifact | `Prepare release package artifact` | none | Packs or resolves one candidate tarball and uploads `release-package-under-test` for downstream package-facing checks. | Rerun the affected package, cross-OS, or live/E2E group. | -| Install smoke | `Run install smoke` | `Install Smoke` | Full install path with root Dockerfile smoke image reuse, QR package install, root and gateway Docker smokes, installer Docker tests, Bun global install image-provider smoke, and fast bundled-plugin Docker E2E. | `rerun_group=install-smoke` | -| Cross-OS | `cross_os_release_checks` | `OpenClaw Cross-OS Release Checks (Reusable)` | Fresh and upgrade lanes on Linux, Windows, and macOS for the selected provider and mode, using the candidate tarball plus a baseline package. | `rerun_group=cross-os` | -| Repo and live E2E | `Run repo/live E2E validation` | `OpenClaw Live And E2E Checks (Reusable)` | Repository E2E, live cache, OpenAI websocket streaming, native live provider and plugin shards, and Docker-backed live model/backend/gateway harnesses selected by `release_profile`. | `rerun_group=live-e2e`, optionally with `live_suite_filter` | -| Docker release path | `Run Docker release-path validation` | `OpenClaw Live And E2E Checks (Reusable)` | Release-path Docker chunks against the shared package artifact. | `rerun_group=live-e2e` | -| Package Acceptance | `Run package acceptance` | `Package Acceptance` | Artifact-native bundled-channel dependency compatibility, offline plugin package fixtures, and mock-OpenAI Telegram package acceptance against the same tarball. | `rerun_group=package` | -| QA parity | `Run QA Lab parity lane` and `Run QA Lab parity report` | direct jobs | Candidate and baseline agentic parity packs, then the parity report. | `rerun_group=qa-parity` or `rerun_group=qa` | -| QA live Matrix | `Run QA Lab live Matrix lane` | direct job | Fast live Matrix QA profile in the `qa-live-shared` environment. | `rerun_group=qa-live` or `rerun_group=qa` | -| QA live Telegram | `Run QA Lab live Telegram lane` | direct job | Live Telegram QA with Convex CI credential leases. | `rerun_group=qa-live` or `rerun_group=qa` | -| Release verifier | `Verify release checks` | none | Verifies required release-check jobs for the selected rerun group. | Rerun after focused child jobs pass. | +| Stage | Details | +| ------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | +| Release target | **Job:** `Resolve target ref`
**Backing workflow:** none
**Tests:** selected ref, optional expected SHA, profile, rerun group, and focused live suite filter.
**Rerun:** `rerun_group=release-checks`. | +| Package artifact | **Job:** `Prepare release package artifact`
**Backing workflow:** none
**Tests:** packs or resolves one candidate tarball and uploads `release-package-under-test` for downstream package-facing checks.
**Rerun:** the affected package, cross-OS, or live/E2E group. | +| Install smoke | **Job:** `Run install smoke`
**Backing workflow:** `Install Smoke`
**Tests:** full install path with root Dockerfile smoke image reuse, QR package install, root and gateway Docker smokes, installer Docker tests, Bun global install image-provider smoke, and fast bundled-plugin Docker E2E.
**Rerun:** `rerun_group=install-smoke`. | +| Cross-OS | **Job:** `cross_os_release_checks`
**Backing workflow:** `OpenClaw Cross-OS Release Checks (Reusable)`
**Tests:** fresh and upgrade lanes on Linux, Windows, and macOS for the selected provider and mode, using the candidate tarball plus a baseline package.
**Rerun:** `rerun_group=cross-os`. | +| Repo and live E2E | **Job:** `Run repo/live E2E validation`
**Backing workflow:** `OpenClaw Live And E2E Checks (Reusable)`
**Tests:** repository E2E, live cache, OpenAI websocket streaming, native live provider and plugin shards, and Docker-backed live model/backend/gateway harnesses selected by `release_profile`.
**Rerun:** `rerun_group=live-e2e`, optionally with `live_suite_filter`. | +| Docker release path | **Job:** `Run Docker release-path validation`
**Backing workflow:** `OpenClaw Live And E2E Checks (Reusable)`
**Tests:** release-path Docker chunks against the shared package artifact.
**Rerun:** `rerun_group=live-e2e`. | +| Package Acceptance | **Job:** `Run package acceptance`
**Backing workflow:** `Package Acceptance`
**Tests:** artifact-native bundled-channel dependency compatibility, offline plugin package fixtures, and mock-OpenAI Telegram package acceptance against the same tarball.
**Rerun:** `rerun_group=package`. | +| QA parity | **Job:** `Run QA Lab parity lane` and `Run QA Lab parity report`
**Backing workflow:** direct jobs
**Tests:** candidate and baseline agentic parity packs, then the parity report.
**Rerun:** `rerun_group=qa-parity` or `rerun_group=qa`. | +| QA live Matrix | **Job:** `Run QA Lab live Matrix lane`
**Backing workflow:** direct job
**Tests:** fast live Matrix QA profile in the `qa-live-shared` environment.
**Rerun:** `rerun_group=qa-live` or `rerun_group=qa`. | +| QA live Telegram | **Job:** `Run QA Lab live Telegram lane`
**Backing workflow:** direct job
**Tests:** live Telegram QA with Convex CI credential leases.
**Rerun:** `rerun_group=qa-live` or `rerun_group=qa`. | +| Release verifier | **Job:** `Verify release checks`
**Backing workflow:** none
**Tests:** required release-check jobs for the selected rerun group.
**Rerun:** rerun after focused child jobs pass. | ## Docker release-path chunks