nixmac E2E Report - product_surface_full_mac_smoke
0 passed
1 assertion failed
0 infra/not-run
1/1 selected scenarios produced reports
Product surface real-Mac smoke
product_surface_full_mac_smoke
full-mac on macos-e2e (full-mac)
Real-Mac companion - Attached to Settings and provider tabs, Feedback and issue reporting, History and settings navigation
- Commit
33f37e696bb5d5f1217b458e722d756ffb3d1c64- Duration
- 383s
- Replay
tests/e2e/run.sh product_surface_full_mac_smoke
Full-Mac lane: real macOS desktop automation with full-screen recording evidence.
What this checks
Runs the shipped app on a real Mac with Nix installed and records adjacent desktop proof for Settings, feedback, Report Issue, and History surfaces.
Coverage
- App launches from /Applications on the Mac runner
- Settings opens and the General, AI Models, API Keys, and Preferences surfaces render
- Header feedback opens the feedback dialog
- Footer Report Issue opens issue-report mode
- History opens and returns to the main surface
- Publishes a full-screen recording as adjacent real-desktop proof
Known gaps / not covered
- Adjacent real-Mac smoke only; it does not replay each hosted WDIO assertion or verify settings persistence on disk.
- Uses the nix-installed fixture so the app is past the Nix installation prerequisite, but it does not apply or rebuild a nix-darwin configuration.
Failure: Settings tab did not render expected text: AI Models
- What happened
- Settings tab did not render expected text: AI Models
- Next action
- Open the full report and workflow logs for the failing phase, then rerun the replay command after fixing the cause.
| Phase | Status | Duration | Summary |
|---|---|---|---|
| Nix installed (already present) | passed | 0s | |
| Product surface launched | passed | 0s | |
| Settings tab did not render expected text: AI Models | failed | 0s | Settings tab did not render expected text: AI Models |