Skip to content

[Harbor] Add a real Harbor 0.22.x Docker end-to-end smoke gate #350

Description

@reacher-z

Problem

The Harbor compatibility test is skipped when Harbor is not installed, and CI does not execute a real harbor run. The Harbor runtime Dockerfile is also outside the current harness image build scan. This leaves adapter, image, runtime readiness, verifier, and cleanup regressions undetected.

Required scope

  • Pin Harbor 0.22.x and Python 3.12 in a Linux Docker job.
  • Convert one real V2 task and validate it with Harbor's loader.
  • Run a single Harbor task smoke covering setup, runtime readiness, verifier, artifact collection, and cleanup.
  • Include src/clawbench/runtime/harbor/Dockerfile in the image build matrix.
  • Upload task/runtime/verifier logs on failure and record Harbor/schema/image versions.

Acceptance criteria

  • Adapter/runtime changes require the Harbor smoke job.
  • The job exercises successful interception, no interception, judge-inconclusive, and cleanup failure paths.
  • Harbor artifacts are available for debugging without exposing credentials.

This is HAR-001 in docs/codebase-evaluation-2026-09.md and is related to #331. @Perry2004 please review the support matrix and CI cost.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requesthelp wantedExtra attention is needed

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions