Skip to content

Fix step-1 NaN: run gemma attention + DeepSeek sparse-indexer logits in fp32#4136

Closed
ecnal-cienet wants to merge 2 commits into
mainfrom
fix/attention-fp32-numerics
Closed

Fix step-1 NaN: run gemma attention + DeepSeek sparse-indexer logits in fp32#4136
ecnal-cienet wants to merge 2 commits into
mainfrom
fix/attention-fp32-numerics

Commits

Commits on Jun 10, 2026