Validating Impact-Based Forecasts for Anticipatory Action
Anticipatory actions (AA) are pre-emptive measures taken to reduce disaster impacts based on forecasted hazards. Trigger models using impact-based forecasts (IBF) play a central role in deciding when these measures are activated, by combining hazard forecasts with information on exposure, vulnerability, and past impacts. The resulting impact predictions can cover a range of outputs such as number of people or infrastructures affected, crop losses, or area that is expected to be inundated. Loss predictions are typically given as percentages, such as of buildings destroyed within a given administrative unit, with some impact assessment models also considering crop phenology or specific building vulnerability information. This diversity in approaches, in itself linked to the often limited data availability for the loss estimation, creates further challenges for validation.
While the work on designing these trigger models is growing, systematic methods to validate their impact forecasts remain relatively under-explored. There are open questions on how well forecasted impacts align with observed damage, how performance of IBF varies across events, and how repeated events or different damaging mechanisms (e.g., wind, storm surge, landslide) influence the relationship between hazard and impact. Through this topic, these questions can be explored using one or more existing AA trigger models for floods or tropical cyclones.
The overall aim is to explore how – and how accurately – an existing impact-based forecast (used in an AA trigger model) represents observed impacts, and how this can guide the improvement of AA design and targeting.
The topic will include:
- Selecting a case study on AA trigger model (e.g., for floods or tropical storms in a given country or region) and mapping how it generates impact forecasts (inputs, thresholds, indicators).
- Identifying and integrating different impact data sources, such as Earth observation, disaster databases, governmental and institutional data and media reports.
- Comparing forecasted vs. observed impacts using statistical and spatial analyses, if applicable for different damage categories.
- Examining how performance changes across multiple events (e.g., when multiple events hit the same area, or when different damaging mechanisms are dominant in each case).
- Based on the validation, identifying areas for model improvement (e.g., adjusting impact thresholds, redefining the impact indicators or highlighting contexts where the model is less reliable).
Nikraftar, Z., Mbuvha, R., Sadegh, M., and Landman, W. A., 2024, Impact-Based Skill Evaluation of Seasonal Precipitation Forecasts: Earth's Future, v. 12, no. 11, p. e2024EF004936.
Potter, S. H., Kox, T., Mills, B., Taylor, A., Robbins, J., Cerrudo, C., Wyatt, F., Harrison, S., Golding, B., Lang, W., Harris, A. J. L., Kaltenberger, R., Kienberger, S., Brooks, H., and Tupper, A., 2025, Research gaps and challenges for impact-based forecasts and warnings: Results of international workshops for High Impact Weather in 2022: International Journal of Disaster Risk Reduction, v. 118, p. 105234.
Sedhain, S., van den Homberg, M., Teklesadik, A., van Aalst, M., and Kerle, N., 2025, Evaluating impact-based forecasting models for tropical cyclone anticipatory action: International Journal of Disaster Risk Reduction, v. 129, p. 105782.