ProvarDX v1.5.1 Release

Highlights

Smaller, faster MCP handshake — opt into compact tool schemas and load only the tool groups you need. ~36% fewer handshake tokens with compact mode alone, up to ~57% when combined with group filtering.
Smarter validation loops — agents get tunable response detail, run-over-run diffs, and a single completeness signal that's safe to gate on.
Single-call test authoring — test-case generation is now a true one-shot construction, with a runtime guard so agents stop iterating in the wrong direction.
Reliable connection + environment resolution in .testproject files.

Tool-catalog footprint

Tokens sent to the LLM on tools/list (≈4 chars/token):

Configuration	Tools	~Tokens	Savings vs default
Standard (all groups, full descriptions)	41	18,355	—
Compact (all groups, compact descriptions)	41	11,758	−36%
Authoring profile (compact + 4 groups)	21	7,906	−57%

Per-tool savings are largest where they matter most — testcase_generate alone drops from ~2,070 tokens of description to a fraction of that in compact mode.

New

Compact schema mode and tool-group filtering for trimmed startup payloads.
detail, baseline_run_id, run_id, and completeness_score on validation tools.
fields parameter on inspect / list tools to scope responses to only what's needed.
Depth guard and token-attribution middleware across all tools.
Construct-vs-amend contract carried into test-case tool titles, descriptions, and a runtime check on empty steps.

Guidance & prompt improvements

Test-case authoring rewritten as a single-call construction contract — agents now produce a complete test case in one call instead of looping through construct → amend → re-amend cycles. End-to-end authoring of a multi-step Salesforce flow drops from typically 3–5 tool calls to 1.
Construct-vs-amend semantics surfaced at three layers (tool title, description, runtime guard) so agents that skim only the title still get the contract.
Validation tools now return a single completeness_score (0–100) so agents have one number to gate on, instead of inferring stop/continue from violation arrays.
Compact tool descriptions are tuned to keep the contract (when to call, prerequisites, common failure modes) while dropping prose — the signal agents actually use stays intact.

Fixed

Validation stop decisions now account for all violation levels (plan metadata, suite, best-practices) instead of stopping while issues remain.
Read-only validation diffs work without writing new results.
Validation baselines are now scoped to their original project context, so a baseline from one project can't silently diff against another.
Unknown tool-group names now warn instead of silently disabling everything.
Release builds now reliably fetch the latest NitroX schemas instead of falling back to a bundled copy.
Connection + environment resolution in .testproject files.
Various agent-loop and review-pass hardening for the test-case authoring path.

Upgrade notes

Non-breaking. All new parameters and env vars are opt-in.
Existing callers see no behavior change.

Assets 2

12 May 21:38

mrdailey99

v.1.5.0

0865983

v.1.5.0

Provar MCP v1.5.0

The first stable release of the Provar MCP server — a Model Context Protocol integration that lets AI agents drive Provar automation end-to-end.

What's New

Zero-install startup via npx @provartesting/provardx-cli mcp start — no Salesforce CLI required
Auto-update check at startup notifies when a newer version is available
Full path allowlist enforcement, shell injection prevention, and input validation across all tools
Tool names in underscore format (provar_automation_testrun, etc.) for broad MCP client compatibility

NitroX Component Authoring

provar_nitrox_discover, read, generate, patch, and validate tools for full FactComponent lifecycle
AJV JSON Schema validation (NX_SCHEMA_* issues) alongside semantic rules NX001–NX010
Component catalog and FactComponent/FactPackage schemas fetched from source at release time

Quality Hub Integrations

provar_qualityhub_connect, testrun, defect_create, testcase_retrieve, and examples_retrieve tools
Secure API key storage and validation
provar_qualityhub_display and provar_qualityhub_testrun_report for in-session results

Test Authoring & Execution Loop

provar_testcase_step_edit for targeted step-level edits
provar_testrun_rca for AI-driven root cause analysis on failures
provar_connection_list for discovering available Salesforce connections
provar_nitrox_validate with full XML correctness checking and local semantic rules

Guided AI Workflows

Built-in MCP prompts for onboarding, troubleshooting, orchestration, and test migration workflows
provar://docs/tool-guide resource for in-context tool selection guidance