Skip to content

Run LDBC SNB with 2 queries per template, and without Comunica-HDT - #19

Merged
rubensworks merged 1 commit into
masterfrom
claude/lucid-meitner-jg4dy5-ldbc-scope
Nov 13, 2026
Merged

rubensworks merged 1 commit into
masterfrom
claude/lucid-meitner-jg4dy5-ldbc-scope

Conversation

@rubensworks

Copy link
Copy Markdown
Member

Up to SF3, an LDBC SNB run would take days. Comunica-HDT is the largest part of that. It is about 28 times slower than Comunica-Memory on LDBC SNB, so it times out on most complex queries from SF1 on. After every timeout it also restarts its worker, which warms up again before answering. This PR scopes LDBC SNB down:

  • Without Comunica-HDT: its combination is removed, so the 9 remaining ones are renumbered combination_0 to combination_8, and the stale combination_9 directory is deleted. generateHdt is now false, as only Comunica-HDT used the HDT file.
  • queryCount from 5 to 2: 2 instances per template, each still run 3 times after a warm-up round.
  • Plot labels: the labels in package.json listed 8 engines for what were 10 combinations. They now match the 9 remaining ones, including the in-memory Oxigraph and Jena.
Before After
Combinations 10 9
Query executions per engine 21 templates × 5 instances × 4 = 420 21 × 2 × 4 = 168
HDT generation in jbr prepare yes no

The combinations are regenerated, and jbr validate passes. Each regenerated combination points to the right Dockerfile and has queryCount 2 and generateHdt false.

Comunica-HDT stays in BSBM and WatDiv.


Generated by Claude Code

Up to SF3, an LDBC SNB run would take days. Comunica-HDT accounts for much
of that: it times out on most complex queries from SF1 on, and restarts its
worker after every timeout. This removes Comunica-HDT from LDBC SNB, along
with the HDT generation only it used, and lowers queryCount from 5 to 2.

The plot labels now match the 9 remaining combinations, including the
in-memory Oxigraph and Jena.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UNM2PDyzVijfquXVY2Av52
@rubensworks
rubensworks merged commit 64192e6 into master Nov 13, 2026
37 checks passed
@rubensworks
rubensworks deleted the claude/lucid-meitner-jg4dy5-ldbc-scope branch November 13, 2026 14:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants