vllm.models.deepseek_v41.nvidia.specialized_decode.attention
¶
Modules:
-
aux_projections–Low-batch GEMMs of the attention side projections.
-
candidate_topk–Candidate-block selection with
cooperative_topkfor decode rows. -
indexer–The sparse-attention indexers in a specialized decode step.
-
indexer_k_store–MXFP4 indexer key store for the FP32 output of the low-batch
wkGEMM. -
mxfp8–Low-batch MXFP8 attention projections.
-
sparse_mla–The FlashInfer sparse-MLA decode of a specialized decode step.
-
step–The attention of a specialized decode step.