Estimated Scan Duration

Condition

Scan for this query will not be completed for a long time. Usually there is no point in waiting. This warning indicates queries trying to process enormous amount of data relative to warehouse size.

How to fix

  • Check query text for mistakes and typos.

  • Process data in smaller chunks.

  • Increase warehouse size.

Example

    EstimatedScanDurationCondition(
        min_estimated_scan_duration=60 * 60 * 2,  # query scan is estimated to take longer than 2 hours
        warning_duration=60 * 10,  # warning after 10 minutes
        kill_duration=60 * 20,  # kill after 20 minutes
    ),

Specific arguments

  • min_estimated_scan_duration (int) - how long scan is expected to take based on current estimation, in seconds (recommended min value is at least 1 hour)

Last updated