nixmac E2E Report - macos_descriptor_prompt_smoke
0 passed
1 assertion failed
0 infra/not-run
1/1 selected scenarios produced reports
macOS descriptor prompt smoke
macos_descriptor_prompt_smoke
full-mac on macos-e2e (full-mac)
Full-Mac recording - Standalone real desktop evidence
- Commit
33f37e696bb5d5f1217b458e722d756ffb3d1c64- Duration
- 490s
- Replay
tests/e2e/run.sh macos_descriptor_prompt_smoke
Full-Mac lane: real macOS desktop automation with full-screen recording evidence.
What this checks
Launches the real macOS app, types one descriptor into the main prompt, and verifies the expected local provider-validation block with 30 fps video proof.
Coverage
- Exact-SHA app artifact launches on the real Mac runner
- Prompt input is reachable through stable accessibility metadata
- Descriptor text can be typed and observed in the real UI
- Submit affordance is reachable through stable accessibility metadata
- Local provider validation blocks submit without requiring a fragile mock provider
- Publishes a 30 fps full-screen recording as primary proof
Known gaps / not covered
- Intentionally stops at local provider validation; it does not call a live or mock AI provider yet.
- Requires the self-hosted Mac runner to already have Nix and darwin-rebuild available.
Failure: Typed descriptor was not visible in the prompt input
- What happened
- Typed descriptor was not visible in the prompt input
- Next action
- Open the full report and workflow logs for the failing phase, then rerun the replay command after fixing the cause.
| Phase | Status | Duration | Summary |
|---|---|---|---|
| Prepared config repo, mock system prerequisites, and local provider-validation settings | passed | 0s | |
| App launched | passed | 0s | |
| Descriptor prompt input reached | passed | 0s | |
| Typed descriptor was not visible in the prompt input | failed | 0s | Typed descriptor was not visible in the prompt input |