kth.sePublications KTH
Change search
Link to record
Permanent link

Direct link
Publications (3 of 3) Show all publications
Zhang, Z., Ma, X., Engardt, M., Schlesinger, D. & Johansson, C. (2026). Interpretable long-horizon air pollution forecasting using a transformer-based framework. Expert Systems with Applications, 315, Article ID 131719.
Open this publication in new window or tab >>Interpretable long-horizon air pollution forecasting using a transformer-based framework
Show others...
2026 (English)In: Expert Systems with Applications, ISSN 0957-4174, Vol. 315, article id 131719Article in journal (Refereed) Published
Abstract [en]

Accurate and interpretable air pollution forecasting is essential for public health and proactive intervention. While deep learning models have achieved strong performance in long-horizon forecasting, they often require aligned historical sequences and provide limited interpretability. To address these limitations, we propose a novel Transformer-based framework that integrates historical observations with auxiliary forecasts to enhance predictive performance while providing built-in interpretability. The framework introduces two core components: a Structured Temporal Embedding Module (STEM) for preserving the semantic integrity of heterogeneous inputs, and an eXplainable Target-Oriented Cross-Attention (X2-Attention) mechanism that aligns future predictions with known inputs to yield fine-grained attribution for each forecasted timestep across both temporal and feature dimensions. Evaluated on diverse urban and suburban datasets in Stockholm, our model simultaneously delivers reliable interpretability and superior predictive accuracy. Compared to five baselines (TimeXer, Crossformer, iTransformer, Transformer and LSTM), it exhibits significantly lower Mean Squared Error (MSE) for NOX and competitive performance for PM10 across horizons up to 720 hours. Ablation studies reveal that incorporating auxiliary forecasts reduces MSE by 29 % for NOX and 15 % for PM10. Moreover, the X2-Attention mechanism generates plausible feature attribution validated through perturbation analysis. Its attributions are consistent with GradientSHAP while avoiding prohibitive computational overhead, thereby facilitating efficient air quality forecasting.

Place, publisher, year, edition, pages
Elsevier BV, 2026
Keywords
Air quality and health risk, Explainable AI, Meteorological forecast integration, Multi-horizon forecasting
National Category
Computer graphics and computer vision Computer Sciences Probability Theory and Statistics Bioinformatics (Computational Biology)
Identifiers
urn:nbn:se:kth:diva-380039 (URN)10.1016/j.eswa.2026.131719 (DOI)001707123300001 ()2-s2.0-105034518146 (Scopus ID)
Note

QC 20260424

Available from: 2026-04-24 Created: 2026-04-24 Last updated: 2026-04-30Bibliographically approved
Zhang, Z., Johansson, C., Engardt, M., Stafoggia, M. & Ma, X. (2024). Improving 3-day deterministic air pollution forecasts using machine learning algorithms. Atmospheric Chemistry And Physics, 24(2), 807-851
Open this publication in new window or tab >>Improving 3-day deterministic air pollution forecasts using machine learning algorithms
Show others...
2024 (English)In: Atmospheric Chemistry And Physics, ISSN 1680-7316, E-ISSN 1680-7324, Vol. 24, no 2, p. 807-851Article in journal (Refereed) Published
Abstract [en]

As air pollution is regarded as the single largest environmental health risk in Europe it is important that communication to the public is up to date and accurate and provides means to avoid exposure to high air pollution levels. Long- and short-term exposure to outdoor air pollution is associated with increased risks of mortality and morbidity. Up-to-date information on present and coming days' air quality helps people avoid exposure during episodes with high levels of air pollution. Air quality forecasts can be based on deterministic dispersion modelling, but to be accurate this requires detailed information on future emissions, meteorological conditions and process-oriented dispersion modelling. In this paper, we apply different machine learning (ML) algorithms - random forest (RF), extreme gradient boosting (XGB), and long short-term memory (LSTM) - to improve 1, 2, and 3d deterministic forecasts of PM10, NOx, and O3 at different sites in Greater Stockholm, Sweden. It is shown that the deterministic forecasts can be significantly improved using the ML models but that the degree of improvement of the deterministic forecasts depends more on pollutant and site than on what ML algorithm is applied. Also, four feature importance methods, namely the mean decrease in impurity (MDI) method, permutation method, gradient-based method, and Shapley additive explanations (SHAP) method, are utilized to identify significant features that are common and robust across all models and methods for a pollutant. Deterministic forecasts of PM10 are improved by the ML models through the input of lagged measurements and Julian day partly reflecting seasonal variations not properly parameterized in the deterministic forecasts. A systematic discrepancy by the deterministic forecasts in the diurnal cycle of NOx is removed by the ML models considering lagged measurements and calendar data like hour and weekday, reflecting the influence of local traffic emissions. For O3 at the urban background site, the local photochemistry is not properly accounted for by the relatively coarse Copernicus Atmosphere Monitoring Service ensemble model (CAMS) used here for forecasting O3 but is compensated for using the ML models by taking lagged measurements into account. Through multiple repetitions of the training process, the resulting ML models achieved improvements for all sites and pollutants. For NOx at street canyon sites, mean squared error (MSE) decreased by up to 60%, and seven metrics, such as R2 and mean absolute percentage error (MAPE), exhibited consistent results. The prediction of PM10 is improved significantly at the urban background site, whereas the ML models at street sites have difficulty capturing more information. The prediction accuracy of O3 also modestly increased, with differences between metrics. Further work is needed to reduce deviations between model results and measurements for short periods with relatively high concentrations (peaks) at the street canyon sites. Such peaks can be due to a combination of non-typical emissions and unfavourable meteorological conditions, which are rather difficult to forecast. Furthermore, we show that general models trained using data from selected street sites can improve the deterministic forecasts of NOx at the station not involved in model training. For PM10 this was only possible using more complex LSTM models. An important aspect to consider when choosing ML algorithms is the computational requirements for training the models in the deployment of the system. Tree-based models (RF and XGB) require fewer computational resources and yield comparable performance in comparison to LSTM. Therefore, tree-based models are now implemented operationally in the forecasts of air pollution and health risks in Stockholm. Nevertheless, there is big potential to develop generic models using advanced ML to take into account not only local temporal variation but also spatial variation at different stations.

Place, publisher, year, edition, pages
Copernicus GmbH, 2024
National Category
Meteorology and Atmospheric Sciences
Identifiers
urn:nbn:se:kth:diva-343475 (URN)10.5194/acp-24-807-2024 (DOI)001168773800001 ()2-s2.0-85184031704 (Scopus ID)
Note

QC 20240219

Available from: 2024-02-15 Created: 2024-02-15 Last updated: 2025-02-07Bibliographically approved
Zhang, Z., Ma, X., Johansson, C., Jin, J. & Engardt, M. (2023). A Meta-Graph Deep Learning Framework for Forecasting Air Pollutants in Stockholm. In: 2023 IEEE World Forum on Internet of Things: The Blue Planet. Paper presented at 9th IEEE World Forum on Internet of Things, WF-IoT 2023, Hybrid, Aveiro, Portugal, Oct 12 2023 - Oct 27 2023. Institute of Electrical and Electronics Engineers (IEEE)
Open this publication in new window or tab >>A Meta-Graph Deep Learning Framework for Forecasting Air Pollutants in Stockholm
Show others...
2023 (English)In: 2023 IEEE World Forum on Internet of Things: The Blue Planet, Institute of Electrical and Electronics Engineers (IEEE) , 2023Conference paper, Published paper (Refereed)
Abstract [en]

Forecasting air pollution is an important activity for developing sustainable and smart cities. Generated by various sources, air pollutants distribute in the atmospheric environment due to the complex dispersion processes. The emerging sensor and data technologies have promoted the development of data-driven approaches to replace conventional physical models in urban air pollution forecasting. Nevertheless, it is still challenging to capture the intricate spatial and temporal patterns of air pollutant concentrations measured by heterogeneous sensors, especially for long-term prediction of the multi-variate time series data. This paper proposes a deep learning framework for longer-term forecast of air pollutants concentrations using air pollution sensing data, based on a conceptual framework of meta-graph deep learning. The key modules in the framework include meta-graph units and fusion layers, which are designed to learn temporal and spatial correlations respectively. A detailed case was formulated for forecasting air pollutants in Stockholm using air quality sensing data, meteorological data and so on. Experiments were conducted to evaluate the performance of the proposed modelling framework. The computational results show that it outperforms the baseline models and conventional deterministic dispersion models, demonstrating the potential of the framework to be deployed for the real air quality information systems in Stockholm.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2023
National Category
Earth and Related Environmental Sciences
Identifiers
urn:nbn:se:kth:diva-348285 (URN)10.1109/WF-IoT58464.2023.10539442 (DOI)001241286500064 ()2-s2.0-85195410749 (Scopus ID)
Conference
9th IEEE World Forum on Internet of Things, WF-IoT 2023, Hybrid, Aveiro, Portugal, Oct 12 2023 - Oct 27 2023
Note

QC 20240525

Part of ISBN [9798350311617]

Available from: 2024-06-20 Created: 2024-06-20 Last updated: 2025-02-07Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0009-0001-1295-1917

Search in DiVA

Show all publications