Skip to content

Support batch_size>1 in native MHA decoder, incl. true sub-64 (head_dim>mlen)#55

Merged
booth-algo merged 2 commits into
mainfrom
feat/multibatch-decoder
Jun 2, 2026
Merged

Support batch_size>1 in native MHA decoder, incl. true sub-64 (head_dim>mlen)#55
booth-algo merged 2 commits into
mainfrom
feat/multibatch-decoder

Support head_dim > mlen in batched MHA kernel (true sub-64 multi-batch)

0f55571
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
Python syntax check
succeeded Jun 1, 2026 in 12s