SIGN IN SIGN UP

vulkan: MOE aware mat_mul_id tile selection (#29182)

mut_mul_id selected its matmul tile with total token count.
For MoE dispatch grid the true N per workgroup is per-expert rows.
At pp128 on Sarvam 30B that is 6, not 128, so the picker took the l-tile for ~6 live rows.
Most workers in each group had nothing to do.
This wasted time. The slow part was 55% of the whole job.
A
Ankit Khandelwal committed
94a0ae3e7298127b74d5b31370e83a1b4f143070
Parent: da89bb3
Committed by GitHub <noreply@github.com> on 9/29/2026, 5:38:59 PM