Skip to content

vllm.models.deepseek_v41.nvidia.specialized_decode.runtime

Modules:

  • decode –

    The specialized decode executor.

  • metadata_graphs –

    CUDA graphs of the attention metadata builds of FULL decode steps.

  • model_state –

    The model state of the specialized decode.

  • warmup –

    Tuning and compiling the specialized decode's kernels.