A Geospatial Verification Method for Severe Convective Weather Warnings: Implications for Current and Future Warning Methods

Legacy National Weather Service verification techniques, when applied to current static severe convective warnings, exhibit limitations, particularly in accounting for the precise spatial and temporal aspects of warnings and severe convective events. Consequently, they are not particularly well-suited for application to some proposed future National Weather Service warning delivery methods considered under the Forecasting a Continuum of Environmental Threats (FACETs) initiative. These methods include Threats-In-Motion (TIM), wherein warning polygons move nearly continuously with convective hazards, and Probabilistic Hazard Information (PHI), a concept that involves augmenting warnings with rapidly updating probabilistic plumes. A new geospatial verification method was developed and evaluated, by which warnings and observations are placed on equivalent grids within a common reference frame, with each grid cell being represented as a hit, miss, false alarm, or correct null for each minute. New measures are computed, including false alarm area, and location-specific lead time, departure time, and false alarm time. Using the 27 April 2011 tornado event, we applied the TIM and PHI warning techniques to demonstrate the benefits of rapidly updating warning areas, showcase the application of the geospatial verification method within this novel warning framework, and highlight the impact of varying probabilistic warning thresholds on warning performance. Additionally, the geospatial verification method was tested on a storm-based warning dataset (2008-2022) to derive annual, monthly, and hourly statistics.