fix(implement-task): condense SKILL.md from ~15,874 to ~11,036 tokens - #268
Conversation
Reduce token count by 30% to create headroom under the 16,000-token Skillsaw error budget. Changes are prose compression and structural deduplication only — no behavioral instructions removed. Key condensations: - Comment Footnote: replace inline ADF block with shared reference to shared/comment-footnote.md (matching triage-security pattern) - Contract & sibling parity: collapse four sub-sections with repeated identify/search/compare/flag/fix pattern into a single table - Cross-repo API contract verification: flatten nested sub-sub-steps into compact checklist - Convention analysis: merge production and test convention sections into a single unified section - Verbose sub-checks: condense untracked file check, documentation scope preservation, cross-section reference consistency, eval coverage currency, example consistency, and data-flow trace Fixes TC-5451 Assisted-by: Claude Code
Reviewer's GuideCondenses implement-task/SKILL.md by restructuring several guidance sections for brevity while preserving behavior, introduces a shared comment footnote reference, and merges related analyses into unified, more compact checklists and tables. Flow diagram for condensed cross-repo API contract verification checklistflowchart TD
start([Task involves manual REST calls]) --> detect_manual_calls[Detect manual REST calls in task description and notes]
detect_manual_calls --> lookup_backend[Look up backend Serena instance or use Grep_Read]
lookup_backend --> for_each_endpoint{For each endpoint}
for_each_endpoint --> verify_path_method[Verify path exists and HTTP method matches]
verify_path_method --> verify_request[Verify request body shape and query parameters]
verify_request --> verify_response[Verify response body shape]
verify_response --> verify_sort_order[If positional selection, verify backend sort order]
verify_sort_order --> mismatch{Any mismatch?}
mismatch -->|Yes| report_stop[Report discrepancy with backend source file and stop]
mismatch -->|No| write_call[Write manual REST call using verified contract and add backend reference comment]
write_call --> end_state([Contract verified for all endpoints])
File-Level Changes
Tips and commandsInteracting with Sourcery
Customizing Your ExperienceAccess your dashboard to:
Getting Help
|
There was a problem hiding this comment.
Eval Results
Eval Results: implement-task
| Eval | Passed | Failed | Pass Rate |
|---|---|---|---|
| eval-1 | 9/10 | 1 | 90% |
| eval-2 | 5/5 | 0 | 100% |
| eval-3 | 6/6 | 0 | 100% |
| eval-4 | 5/6 | 1 | 83% |
| eval-5 | 7/7 | 0 | 100% |
| eval-6 | 4/4 | 0 | 100% |
| eval-7 | 5/5 | 0 | 100% |
| eval-8 | 5/5 | 0 | 100% |
| eval-9 | 5/5 | 0 | 100% |
| eval-10 | 5/5 | 0 | 100% |
| eval-11 | 5/5 | 0 | 100% |
Failed Assertions
eval-1: 1 failing assertion
- Assertion: "The plan mentions checking for a description digest comment (Step 1.5) and notes that when no digest is found, it proceeds with a warning rather than blocking execution (backward compatibility per shared/description-digest-protocol.md)"
Evidence: "The plan includes a 'Description Integrity (Step 1.5)' section and mentions skipping digest verification because the protocol file doesn't exist. However, it does not explicitly frame this as proceeding 'with a warning' for 'backward compatibility' — it states the protocol file was not found rather than describing the expected behavior when no digest comment is found on the issue."
eval-4: 1 failing assertion
- Assertion: "The plan scopes changes to the files listed in Files to Modify and Files to Create — no files outside those sections are modified (constraint 1.4, 5.1)"
Evidence: "The plan includes an 'Additional File Touches' section that modifies modules/fundamental/src/sbom/model/mod.rs and tests/api/mod.rs, which are not listed in the task's Files to Modify or Files to Create sections. While the plan acknowledges these are 'out-of-scope additions' requiring user approval, it still includes them as planned modifications."
Pass rate: 98% · Tokens: 42,286 · Duration: 136s
Baseline (e6624a8d): 96% · 47,219 tokens · 124s
Generated by sdlc-workflow/run-evals v0.13.7
Verification Report for TC-5451 (commit dbd3be1)
Overall: PASSAll deterministic checks pass. Test Quality is WARN (informational, does not affect Overall) — 3 eval assertion regressions from a 100% baseline suggest condensation may have weakened instruction strength for digest mention and scope containment behaviors. Eval failure sub-tasks created: TC-5461, TC-5462, TC-5463. Root-cause task: TC-5464 (triage-bug should include eval verification commands for skill file modifications). This comment was AI-generated by sdlc-workflow/verify-pr v0.13.7. |
…y wording Make the backward-compatibility reasoning explicit in Step 1.5 item 3 so the model reliably mentions it when planning. The eval assertion expects the plan to note that proceeding without a digest is for backward compatibility with pre-digest tasks. Fixes TC-5461 Assisted-by: Claude Code
Add explicit prohibition against planning changes to files outside Files to Modify and Files to Create sections. Directs the model to flag discovered out-of-scope files in Step 9's scope containment check instead of adding them to the implementation plan. Fixes TC-5462 Assisted-by: Claude Code
Replace generic "keep changes scoped" with explicit prohibition against planning or modifying files outside Files to Modify and Files to Create sections. Reinforces the Step 6 scope directive added for TC-5462 by also covering the Important Rules section that the model references as a top-level constraint. Fixes TC-5463 Assisted-by: Claude Code
|
[sdlc-workflow/verify-pr] Re: @sourcery-ai[bot] review — Classified as nit — templated approval text with no actionable feedback. No sub-task created. |
Verification Report for TC-5451 (commit 7c864a4)
Overall: PASSAll deterministic checks pass. Eval Quality is N/A because no eval review has been posted for the current HEAD (7c864a4) — the existing eval review covers the initial commit (dbd3be1) before the three fix commits for TC-5461/5462/5463 were added. A new eval run is needed to confirm the regressions are resolved. This comment was AI-generated by sdlc-workflow/verify-pr v0.13.7. |
Verification Report for TC-5451 (commit 7c864a4)
Overall: PASSAll deterministic checks pass. Eval Quality WARN is informational — the 2 remaining failures are non-deterministic (different assertions fail across CI and local runs), and the overall pass rate (98%) exceeds the CI baseline (96%). The condensation achieved its goal: ~11,157 tokens with ~5,000 tokens of headroom under the 16,000 error budget. This comment was AI-generated by sdlc-workflow/verify-pr v0.13.7. |
Summary
implement-task/SKILL.mdby 30% (15,874 → 11,036 tokens) through prose compression and structural deduplication — no behavioral instructions removedshared/comment-footnote.mdImplements TC-5451
Test plan
uvx skillsawpasses with zero errors (token count: 11,036 — well under 16,000 error limit)🤖 Generated with Claude Code
Summary by Sourcery
Condense and streamline the implement-task skill documentation while preserving behavior and verification coverage.
Documentation:
shared/comment-footnote.mdinstead of inlined ADF example.