nixmac E2E Report - auto_evolve_basic_package

View all scenarios

1 passed, 0 failed, 1 total

Auto-evolve basic package

auto_evolve_basic_package

tauri-wdio on GitHub Actions 1000008272 (github-hosted)

passed
Commit
b13f39985b8718bb8c881755235f51bbb8d63a66
Duration
22s
Replay
bun run test:wdio:basic-prompts

What this checks

Submits a mocked AI prompt and verifies nixmac reaches review with a generated Nix diff.

Coverage
  • Main prompt input and send path
  • Mock provider response plumbing
  • Evolve review screen with non-empty diff
  • Generated diff includes the Darwin fonts module
Known gaps / not covered
  • Uses mocked model responses; it does not call live AI providers or apply/rebuild the generated config.

Visual timeline

5 meaningful frames from wdio source frames. Deterministic checks only; scripted assertions remain the gate.

Selected at 0.0s, label "start"; mostly blank or single-color frame; low-detail frame.
0.0s start
Change
0.000
Contrast
0.000
Detail
0.000
  • mostly blank or single-color frame
  • low-detail frame

Selected at 0.0s, label "start"; mostly blank or single-color frame; low-detail frame.

Selected at 1.3s, label "before-type-Prompt text"; stable visual state.
1.3s before-type-Prompt text
Change
0.039
Contrast
0.096
Detail
0.018
  • stable visual state

Selected at 1.3s, label "before-type-Prompt text"; stable visual state.

Selected at 1.8s, label "after-click-Send prompt"; stable visual state.
1.8s after-click-Send prompt
Change
0.153
Contrast
0.289
Detail
0.108
  • stable visual state

Selected at 1.8s, label "after-click-Send prompt"; stable visual state.

Selected at 2.5s, label "step"; stable visual state.
2.5s step
Change
0.149
Contrast
0.077
Detail
0.019
  • stable visual state

Selected at 2.5s, label "step"; stable visual state.

Selected at 2.9s, label "final-proof"; late-flow frame.
2.9s final-proof
Change
0.000
Contrast
0.075
Detail
0.018
  • late-flow frame

Selected at 2.9s, label "final-proof"; late-flow frame.

PhaseStatusDurationSummary
submits a basic prompt and reaches evolve review with diff passed 2s