Skip to content

compile/action: start with a build using setscene only#2004

Draft
Jose Quaresma (quaresmajose) wants to merge 1 commit into
qualcomm-linux:masterfrom
quaresmajose:setscene-only
Draft

compile/action: start with a build using setscene only#2004
Jose Quaresma (quaresmajose) wants to merge 1 commit into
qualcomm-linux:masterfrom
quaresmajose:setscene-only

Conversation

@quaresmajose

Copy link
Copy Markdown
Contributor

Since the sstate-cache used in CI is hosted on a NFS server, this change will allow measuring its latency.

Performing an initial build at each subbuild step using only the bitbake setscene tasks, will allow us to measure the time of that task. Which basically consists of executing all the task that can be accelerated using the stored sstate-cache. These tasks make exhaustive use of the NFS filesystem to acquire the sstate-cache artifacts.

With this change, it will be easy to distinguish between the time required to acquire and unpack the sstate-cache artifacts and the time spent on the build itself.

@quaresmajose

Copy link
Copy Markdown
Contributor Author

Initial tests suggest that the NFS latency is negligible:

- nodistro: 1m 
- qcom-distro: 1m30s
  • build-pr / glymur-crd/nodistro
world: setscene
2026-04-20 14:43:47 - INFO     - Initialising tasks...Sstate summary: Wanted 6207 Local 6123 Mirrors 0 Missed 84 Current 0 (98% match, 0% complete)
2026-04-20 14:44:49 - INFO     - NOTE: Tasks Summary: Attempted 0 tasks of which 0 didn't need to be rerun and all succeeded.

world: 
2026-04-20 14:46:20 - INFO     - Initialising tasks...Sstate summary: Wanted 2721 Local 2637 Mirrors 0 Missed 84 Current 3486 (96% match, 98% complete)
2026-04-20 14:48:07 - INFO     - NOTE: Tasks Summary: Attempted 11284 tasks of which 10848 didn't need to be rerun and all succeeded.

distro: setscene
2026-04-20 14:48:55 - INFO     - Initialising tasks...Sstate summary: Wanted 1702 Local 1698 Mirrors 0 Missed 4 Current 1980 (99% match, 99% complete)
2026-04-20 14:48:58 - INFO     - NOTE: Tasks Summary: Attempted 0 tasks of which 0 didn't need to be rerun and all succeeded.

distro:
2026-04-20 14:49:17 - INFO     - Initialising tasks...Sstate summary: Wanted 1671 Local 1667 Mirrors 0 Missed 4 Current 2011 (99% match, 99% complete)
2026-04-20 14:50:08 - INFO     - NOTE: Tasks Summary: Attempted 6751 tasks of which 6739 didn't need to be rerun and all succeeded.
  • build-pr / glymur-crd/qcom-distro
world: setscene
2026-04-20 14:44:49 - INFO     - Initialising tasks...Sstate summary: Wanted 7628 Local 7546 Mirrors 0 Missed 82 Current 0 (98% match, 0% complete)
2026-04-20 14:46:20 - INFO     - NOTE: Tasks Summary: Attempted 0 tasks of which 0 didn't need to be rerun and all succeeded.

world: 
2026-04-20 14:48:55 - INFO     - Initialising tasks...Sstate summary: Wanted 3385 Local 3303 Mirrors 0 Missed 82 Current 4243 (97% match, 98% complete)
2026-04-20 14:51:18 - INFO     - NOTE: Tasks Summary: Attempted 13981 tasks of which 13537 didn't need to be rerun and all succeeded.

distro: setscene
2026-04-20 14:53:00 - INFO     - Initialising tasks...Sstate summary: Wanted 4752 Local 4742 Mirrors 0 Missed 10 Current 3069 (99% match, 99% complete)
2026-04-20 14:53:25 - INFO     - NOTE: Tasks Summary: Attempted 0 tasks of which 0 didn't need to be rerun and all succeeded.

distro:
2026-04-20 14:54:40 - INFO     - Initialising tasks...Sstate summary: Wanted 3418 Local 3408 Mirrors 0 Missed 10 Current 4403 (99% match, 99% complete)
2026-04-20 15:01:11 - INFO     - NOTE: Tasks Summary: Attempted 13908 tasks of which 13869 didn't need to be rerun and all succeeded.

@github-actions

Copy link
Copy Markdown

This pull request has been marked as stale due to 30 days of inactivity. To prevent automatic closure in 5 days, remove the stale label or add a comment. You can reopen a closed pull request at any time.

@github-actions github-actions Bot added the Stale label May 21, 2026
@quaresmajose

Copy link
Copy Markdown
Contributor Author

Revisit after #2195

@github-actions

Copy link
Copy Markdown

Test run workflow

Test jobs for commit d909a2f

nodistro
Pass: 9 | Fail: 0 | Total: 9
qcom-distro_linux-qcom-6.18
Pass: 198 | Fail: 0 | Total: 235
qcom-distro
Pass: 236 | Fail: 0 | Total: 282

@test-reporting-app

test-reporting-app Bot commented Jun 15, 2026

Copy link
Copy Markdown

Test Results

 25 files   -    41   25 suites   - 292   52m 25s ⏱️ - 2h 58m 27s
 11 tests  -   142   11 ✅  -   131  0 💤  -  2  0 ❌  -  9 
187 runs   - 2 801  187 ✅  - 2 757  0 💤  - 34  0 ❌  - 10 

Results for commit 71578f2. ± Comparison against base commit 93a30e0.

This pull request removes 142 tests.
0_AudioRecord_Config01 ‑ AudioRecord_Config01
0_BT_FW_KMD_Service ‑ BT_FW_KMD_Service
0_GStreamer_Video_Encode_h264_480p ‑ GStreamer_Video_Encode_h264_480p
0_Libcamera_cam ‑ Libcamera_cam
0_Weston_Runtime_Preflight ‑ Weston_Runtime_Preflight
0_hotplug ‑ hotplug
10_AudioRecord ‑ AudioRecord
10_Docker_Kernel_Config ‑ Docker_Kernel_Config
10_Kubernetes_Kernel_Config ‑ Kubernetes_Kernel_Config
11_DSP_AudioPD ‑ DSP_AudioPD
…

♻️ This comment has been updated with latest results.

@quaresmajose Jose Quaresma (quaresmajose) force-pushed the setscene-only branch 4 times, most recently from 57550af to 3428102 Compare July 6, 2026 14:31
Since the sstate-cache used in CI is hosted on a NFS server,
this change will allow measuring its latency.

Performing an initial build at each subbuild step using only the bitbake
setscene tasks, will allow us to measure the time of that task. Which
basically consists of executing all the task that can be accelerated
using the stored sstate-cache. These tasks make exhaustive use of
the NFS filesystem to acquire the sstate-cache artifacts.

With this change, it will be easy to distinguish between the time
required to acquire and unpack the sstate-cache artifacts and the
time spent on the build itself.

Signed-off-by: Jose Quaresma <jose.quaresma@oss.qualcomm.com>
@github-actions

github-actions Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test run workflow

Test jobs for commit 71578f2

nodistro
Pass: 9 | Fail: 0 | Total: 9
qcom-distro_linux-qcom-6.18
Pass: 7 | Fail: 0 | Total: 7
qcom-distro
Pass: 9 | Fail: 0 | Total: 9

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant