Skip to content

[Optional] Add offline storefront run reports - #4323

Draft
Ji-One1 wants to merge 1 commit into
jb/storefront-e2e-v2-15-clifrom
jb/storefront-e2e-v2-16-optional-reports
Draft

Ji-One1 wants to merge 1 commit into
jb/storefront-e2e-v2-15-clifrom
jb/storefront-e2e-v2-16-optional-reports

Conversation

@Ji-One1

@Ji-One1 Ji-One1 commented Nov 5, 2026 •

Copy link
Copy Markdown
Collaborator

Saved results, event traces, and screenshots are hard to inspect as separate files. This optional PR turns existing run artifacts into an offline HTML report; the buyer CLI does not need it.

What this changes

  • Add pnpm storefront-e2e:report, a bounded artifact loader, view model, renderer, styles, and client interactions.
  • Show the latest run for each storefront URL and scenario separately from history. Count only latest runs in totals.
  • Show saved verdicts, checkpoint details, actions, friction, Standard Events, final messages, and screenshot timelines. Reuse Hydrogen's SelectedOption type in the report model.
  • Read the current flat country/language context as configured, not browser-verified, with fallbacks for older artifact shapes.
  • Warn about invalid or missing artifacts and when the search-depth limit can hide runs. Refuse symlinked artifact files and directories, ignore paths stored in results, escape HTML text, and check links.
  • Write an HTML file without starting a browser, server, or model or changing source run artifacts.

Developer impact

Optional internal tooling only; no published Hydrogen changes or changeset. Saved verdicts are displayed, not recalculated.

Risk

Reports keep saved strings unchanged and are private owner data, not sanitized material for sharing. Linked screenshots and JSON files must remain available at their relative paths. Hidden model reasoning and analytics are not added.

How to Test

  1. Use Node 24 at the repository root with dependencies installed and saved CLI runs from the preceding PR.
  2. Run pnpm storefront-e2e:report --input /absolute/path/to/artifact-root.
  3. Open the printed file:// URL. Select runs, inspect history, filter the timeline, and open screenshots and artifact links. Compare the shown verdict and reason with result.json.

Stack: 15/15, optional. Previous: #4322. Not required by the runner.

@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-16-optional-reports branch from 29b8d7e to 9ec64f6 Compare November 5, 2026 16:23
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-15-cli branch from 52c8de4 to 4d09eaf Compare November 5, 2026 16:23
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-16-optional-reports branch from 9ec64f6 to f43517d Compare November 5, 2026 16:25
@Ji-One1 Ji-One1 changed the title Add offline storefront run reports [Optional] Add offline storefront run reports Nov 5, 2026
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-16-optional-reports branch from f43517d to a46647a Compare November 5, 2026 18:42
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-15-cli branch 2 times, most recently from 831fb41 to cb638e2 Compare November 6, 2026 00:01
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-16-optional-reports branch from a46647a to 4bc1e64 Compare November 6, 2026 00:01
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-15-cli branch from cb638e2 to 9100cc5 Compare November 6, 2026 01:36
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-16-optional-reports branch 2 times, most recently from 13729e9 to d6dcacd Compare November 6, 2026 01:45
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-15-cli branch from 9100cc5 to a4ebdf1 Compare November 6, 2026 01:45
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-16-optional-reports branch from d6dcacd to 7f89799 Compare November 6, 2026 14:27
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-15-cli branch from a4ebdf1 to 63550c2 Compare November 6, 2026 14:27
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-16-optional-reports branch from 7f89799 to bd69930 Compare November 6, 2026 15:08
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-15-cli branch 2 times, most recently from 276db42 to 4b8acdf Compare November 6, 2026 16:20
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-16-optional-reports branch from bd69930 to 3d5c5ee Compare November 6, 2026 16:20
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-15-cli branch from 4b8acdf to 7e435b8 Compare November 6, 2026 19:01
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-16-optional-reports branch 2 times, most recently from 1dfd998 to ba6dab9 Compare November 6, 2026 20:01
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-15-cli branch from 7e435b8 to 8f592db Compare November 6, 2026 20:01
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-16-optional-reports branch from ba6dab9 to a05c5e6 Compare November 6, 2026 20:32
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-15-cli branch 2 times, most recently from 8eea5c9 to bf9a568 Compare November 6, 2026 20:59
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-16-optional-reports branch 2 times, most recently from 3366e71 to efcdf3b Compare November 9, 2026 00:01
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-15-cli branch 2 times, most recently from 7ef7a2e to 9cce697 Compare November 9, 2026 00:37
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-16-optional-reports branch from efcdf3b to b1f6b3b Compare November 9, 2026 00:37
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-15-cli branch from 9cce697 to ea5026a Compare November 9, 2026 04:23
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-16-optional-reports branch from b1f6b3b to 38e3b5a Compare November 9, 2026 04:23
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-16-optional-reports branch from 38e3b5a to 634734e Compare November 9, 2026 06:55
@Ji-One1
Ji-One1 force-pushed the jb/storefront-e2e-v2-15-cli branch from ea5026a to 4cad020 Compare November 9, 2026 06:55

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant