Skip to content

vllm.config.watchdog_config

Classes:

WatchdogConfig

Configuration for the stack-dump watchdog.

The watchdog runs a background thread that periodically checks whether the main thread has fed it in time. If not, it dumps the stack traces of all threads to a dump file for debugging.

Attributes:

  • check_interval (int) –

    Interval in seconds at which the watchdog checks for feed timeouts.

  • dump_dir (str) –

    Directory to save stack dump files. Empty string disables the watchdog

  • timeout (int) –

    Timeout in seconds after which the watchdog considers the process to be

Source code in vllm/config/watchdog_config.py 
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
@config
class WatchdogConfig:
    """Configuration for the stack-dump watchdog.

    The watchdog runs a background thread that periodically checks whether the
    main thread has fed it in time. If not, it dumps the stack traces of all
    threads to a dump file for debugging.
    """

    timeout: int = Field(default=_DEFAULT_TIMEOUT, gt=0)
    """Timeout in seconds after which the watchdog considers the process to be
    stuck and dumps stack traces. Must be greater than 0."""

    check_interval: int = Field(default=_DEFAULT_CHECK_INTERVAL, gt=0)
    """Interval in seconds at which the watchdog checks for feed timeouts."""

    dump_dir: str = ""
    """Directory to save stack dump files. Empty string disables the watchdog
    feature."""

check_interval = Field(default=_DEFAULT_CHECK_INTERVAL, gt=0) class-attribute instance-attribute

Interval in seconds at which the watchdog checks for feed timeouts.

dump_dir = '' class-attribute instance-attribute

Directory to save stack dump files. Empty string disables the watchdog feature.

timeout = Field(default=_DEFAULT_TIMEOUT, gt=0) class-attribute instance-attribute

Timeout in seconds after which the watchdog considers the process to be stuck and dumps stack traces. Must be greater than 0.