Skip to content

GKE Infrastructure Extensions - #6893

Open
george-kalisse-sada wants to merge 1 commit into
GoogleCloudPlatform:masterfrom
george-kalisse-sada:SADA_1a_gke_core_extensions
Open

GKE Infrastructure Extensions#6893
george-kalisse-sada wants to merge 1 commit into
GoogleCloudPlatform:masterfrom
george-kalisse-sada:SADA_1a_gke_core_extensions

Conversation

@george-kalisse-sada

Copy link
Copy Markdown
Collaborator

Files: 2 files modified (no new files)

  • perfkitbenchmarker/providers/gcp/flags.py — 3 new flags
  • perfkitbenchmarker/providers/gcp/google_kubernetes_engine.pyRemoteBuild() enhancement + GKE flag passthrough

Description: Extends PKB's GKE provider with three capabilities needed by downstream benchmarks:

  1. --gke_additional_flags / --gke_additional_nodepool_flags — pass arbitrary flags to gcloud container clusters create and node-pools create (e.g., --enable-pod-snapshots, --max-pods-per-node=250)
  2. --skip_container_image_build — skip RemoteBuild() when images are pre-built (needed for cross-architecture builds)
  3. RemoteBuild() support for --container_remote_build_config — uses gcloud builds submit --config <yaml> --substitutions _IMAGE=<tag> instead of --tag (needed for ARM64 cross-compilation via Cloud Build)

@roycaihw roycaihw left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM overall. I left one comment

cc @hubatish

[],
'Additional flags to pass to gcloud container node-pools create. '
'Example: --gke_additional_nodepool_flags=--max-pods-per-node=250',
)

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder what's @hubatish's take on these. How much effort it takes to support such flags natively in PKB, e.g. the --max-pods-per-node? Maybe we should create issues to track the longterm support of these flags.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We would generally add support for flags individually - but this broad flag certainly does allow for more powerful variations without input, which is also something valuable y'all have been asking for. So I'm ok with allowing them & expect them to be used by other contractors as well.

@roycaihw

Copy link
Copy Markdown

/lgtm

if self.enable_aam:
cmd.args.append('--auto-monitoring-scope=ALL')

# --- PKB Extension: additional cluster create flags ---

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

unnecessary comment here about "PKB extension". Obviously this is a PKB extension. Could add something about "add arbitrary additional flags" & perhaps a usage example.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

will modify.

Comment thread perfkitbenchmarker/providers/gcp/google_kubernetes_engine.py
@hubatish

Copy link
Copy Markdown
Collaborator

Please resolve merge conflicts

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants