Skip to content

Fix screenshot summary publication - #1289

Merged
danbarr merged 1 commit into
mainfrom
fix-snapshot-summaries
Oct 29, 2026
Merged

danbarr merged 1 commit into
mainfrom
fix-snapshot-summaries

Conversation

@danbarr

@danbarr danbarr commented Oct 28, 2026

Copy link
Copy Markdown
Collaborator

Description

After /update-snapshots pushes a bot commit, the follow-up screenshot-summary workflow may never start, leaving the PR description without the changed screenshots. Call the trusted summary workflow directly after baseline publication, including when regeneration produces no new commit, and skip description updates if the PR head or state has changed.

Upload a separate artifact containing only Playwright failure details so the failure-comment table remains available when the full report exceeds the download limit. The report from #1288 is 52 MB; its failure details are only 20 KB. Preserve the existing archive validation and the full-report fallback for older runs.

Validation: all 30 Python and Node helper tests pass, along with focused Prettier and ESLint checks, git diff --check, and the offline zizmor scan. Workflow syntax checks pass after normalizing the existing $/ self-repository syntax for the older local actionlint version. Replayed #1288's actual failure details through the parser and confirmed the expected summary table. The production site build passes. The direct GitHub workflow handoff requires verification after merge because /update-snapshots loads its workflow from main.

Type of change

  • Bug fix

Related issues/PRs

Submitter checklist

Content and formatting

  • I have reviewed the content for technical accuracy
  • I have reviewed the content for spelling, grammar, and style

Reviewer checklist

Content

  • I have reviewed the content for technical accuracy
  • I have reviewed the content for spelling, grammar, and style

@vercel

vercel Bot commented Oct 28, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
docs-website Ready Ready Preview Oct 28, 2026 7:56pm UTC

Request Review

Copilot AI balanced review requested due to automatic review settings October 28, 2026 19:54

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔵 Needs a closer look

The privileged reusable-workflow handoff requires post-merge GitHub Actions validation to confirm trusted revision selection, inherited permissions, and PR-description updates for both commit-producing and no-op snapshot runs.

No open issues 🎉

What changed in this PR

This PR fixes screenshot-summary publication after /update-snapshots and keeps visual failure details available when the full Playwright report exceeds the download limit, as encountered in #1288.

Changes:

  • Call the trusted summary workflow directly after baseline publication, even when no new commit is created.
  • Skip PR description updates when the head commit or PR state has changed.
  • Upload and consume compact failure details while preserving archive validation and the full-report fallback.
File Description
scripts/​update-pr-screenshot-summary.test.mjs Tests summary replacement and skipping advanced or closed PRs.
scripts/​update-pr-screenshot-summary.mjs Checks the current PR head and state before updating its description.
.github/​workflows/​update-visual-baselines.yaml Exposes the published head SHA and directly calls the summary workflow.
.github/​workflows/​pr-screenshot-summary.yaml Supports direct calls and prefers compact failure artifacts.
.github/​workflows/​_visual-regression.yaml Uploads failure details separately from the full report.
.github/​workflows/​_static-checks.yaml Runs the screenshot-summary updater tests in CI.
.github/​scripts/​update_visual_failure_comment.py Accepts compact artifact paths alongside full-report paths.
.github/​scripts/​test_update_visual_failure_comment.py Tests compact detail parsing and duplicate removal.

Review effort: Balanced

@danbarr
danbarr enabled auto-merge (squash) October 28, 2026 20:30
@danbarr
danbarr merged commit 251482f into main Oct 29, 2026
9 checks passed
@danbarr
danbarr deleted the fix-snapshot-summaries branch October 29, 2026 21:45

This branch was successfully deployed

1 active deployment
Preview — c266c412 Deployed Oct 28, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants