Fix high memory usage during gemma4 image prefill (#362)
* Fix Gemma 4 image prefill chunking * Simplify Gemma 4 image prefill invariants * Align Gemma 4 prefill to cache boundaries * Use image spans for Gemma 4 mask dispatch * Clarify Gemma 4 image-run chunking name * Clarify Gemma 4 image token terminology * Explain Gemma 4 text-slice token types * Remove unreachable Gemma 4 video check * Document Gemma 4 image prefill sections * Hoist Gemma 4 cache mask import * Document Gemma 4 mask patch source * Use token types for Gemma 4 image runs * Keep touching Gemma 4 image sections separate * Schedule Gemma 4 prefill by image runs * Validate Gemma 4 aligned prefill boundaries * Guard absent Gemma 4 sliding masks
N
Neil Mehta committed
3b6d6145ab48332e9a21f6acc0589a369ba8ea89
Parent: 39b8521
Committed by GitHub <noreply@github.com>
on 8/19/2026, 3:18:48 PM