Repository navigation
docs(testing): rewrite the UI test phases for the v1 UI - #3437
Merged
Merged
Conversation
The 28 click-through phases dated from January and none matched the product: they drove a Terminal tab that is hidden, an /agents page that is now a redirect, eight GitHub-template agents of which three exist, and several pages that are gone. Two of them deleted the fixture agents. - Rewrite the 23 surviving phases against current source. Every phase is now independent, uses only the three local fixture agents, restores what it changes, carries no credentials, and moves anything that needs a second user, a mailbox, an external repo or a fresh database under a Manual-only heading. - Retire phases 7, 8, 10, 14 and 16 as short stubs that say why and what covers them now. - Add phases 29-37 for surfaces that had no scenario: Workspace (chats; inbox, rooms, projects), Operations, Library, the newer agent tabs, Canvas and shared canvas links, Settings keys and retention, onboarding and app chrome, mobile admin. - Rewrite README.md and INDEX.md; drop references to a run_test_phases.py runner that never existed. Source-verified only: no phase has been run in a browser since the rewrite, and the index marks each one accordingly. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This was referenced Oct 9, 2026
vybe
pushed a commit
that referenced
this pull request
Oct 10, 2026
Conflicts: docs/testing/phases/PHASE_14_OPENTELEMETRY.md (kept dev's retired-phase rewrite from #3437, repointed its two mentions of the removed /api/observability routes at /api/ops/costs) and tests/registry.json (rebuilt from git stages: dev's file minus the entry this branch removed plus the entry it added). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Rewrites the click-through UI test phases in
docs/testing/phases/for the v1 UI. Docs only.README.mdandINDEX.mdrewritten. References to arun_test_phases.pyrunner are gone — it never existed.Why
The phases dated from January and none matched the product. They typed into a Terminal tab that is hidden, started at
/agents(now a redirect), assumed eight GitHub-template agents (three local fixtures exist), and tested pages that are gone (/credentials, the system-agent page, the dashboard graph, a Public Links tab). Phase 0 deleted the fixture agents by name and phase 12 was "delete all agents", so the set could not be run unattended.Rules every phase now follows
Independent of every other phase · only the three local fixture agents (plus one self-deleted
sweep-tmp-…throwaway where creation or deletion is the thing under test) · reads and restores anything it changes · no credentials or real addresses · steps needing a second user, a mailbox, an external repository, a fresh database or a fleet-wide action sit under aManual-onlyheading.How it was checked
/api/…path resolves to a backend route, and 813 of 879 quoted UI strings match source verbatim; the remainder are templated strings ("N shown"), test data, or quotes of the old flow.enterprise-docs-guard.ymlhas no hits.Not done
No phase has been run in a browser since the rewrite. The index marks every phase 🟡 or 🆕 for that reason. Expect the first run of each to need a few steps tightened.
🤖 Generated with Claude Code