Skip to content

Commit e32afdd

Browse files
committed
refactor(appkit): discover evals from server/agents to match folder-per-agent layout
Adapts the eval framework to #533's unified agent discovery: agents now live in server/agents/<id>/agent.{md,ts} (config/agents is a deprecated fallback), so evals move next to them. - discover.ts scans server/agents/<id>/evals/, reusing CODE_AGENTS_SOURCE_DIR and agentDirNames so eval discovery follows the same folder-selection policy (symlinked agent folders included) as the agents plugin. - Relocate the dev-playground example evals config/agents/query/evals -> server/agents/query/evals. - Update discover.test fixtures + doc strings. Signed-off-by: MarioCadenas <MarioCadenas@users.noreply.github.com>
1 parent 34f4c3f commit e32afdd

16 files changed

Lines changed: 42 additions & 38 deletions

File tree

apps/dev-playground/config/agents/query/evals/judge.eval.ts renamed to apps/dev-playground/server/agents/query/evals/judge.eval.ts

File renamed without changes.

apps/dev-playground/config/agents/query/evals/smoke.eval.ts renamed to apps/dev-playground/server/agents/query/evals/smoke.eval.ts

File renamed without changes.

apps/dev-playground/config/agents/query/evals/sum.eval.ts renamed to apps/dev-playground/server/agents/query/evals/sum.eval.ts

File renamed without changes.

apps/dev-playground/config/agents/query/evals/tool-call.eval.ts renamed to apps/dev-playground/server/agents/query/evals/tool-call.eval.ts

File renamed without changes.

‎docs/docs/api/appkit/Function.defineEval.md‎

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎docs/docs/api/appkit/Function.discoverEvalFiles.md‎

Lines changed: 4 additions & 3 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎docs/docs/api/appkit/Interface.DiscoveredEval.md‎

Lines changed: 2 additions & 2 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎docs/docs/api/appkit/Interface.EvalDefinition.md‎

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎docs/docs/api/appkit/Interface.RunEvalsOptions.md‎

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎docs/docs/api/appkit/index.md‎

Lines changed: 5 additions & 5 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)