Skip to content

Versioning / build issues vendoring quack (cutlass/cutedsl pin) for sonic-moe #718

Description

@sayakpaul

Context: sonic-moe now hard-requires quack (previously optional alongside its own GEMM backends), so we must vendor it — but that surfaces versioning/build problems.

Problem:

  • Current blocker is on the kernel-builder side: latest quack needs a newer cutlass than what's available.
  • quack → cutedsl → cutlass; the version is pinned in cute, and nixpkgs keeps resolving an older one (~4.5.0).
  • Naive bump is risky since cute/cutedsl frequently change internal APIs.
  • Open question: does the build sandbox need cutedsl/cutlass at build time? (cf. how Helion is handled in Add Helion as a supported Python dependency #706)

Ask: make a newer cutlass/cutedsl available to the builder without breaking existing kernels, decide a pin/bump strategy, and wire up build-time deps if needed (analogous to the python-depends mechanism from #706).

Cc: @IlyasMoutawwakil

Related to #715

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions