7–11 Oct 2024
University of Nova Gorica, Lanthieri mansion, Vipava, Slovenia
Europe/Ljubljana timezone

Coarse reconstruction with iterative refinement network for sparse spatio-temporal satellite data

9 Oct 2024, 10:45
15m
University of Nova Gorica, Lanthieri mansion, Vipava, Slovenia

University of Nova Gorica, Lanthieri mansion, Vipava, Slovenia

Oral presentation Contributing talks

Speaker

Matjaž Zupančič Muc (Faculty of Computer and Information Science, University of Ljubljana, Ljubljana, Slovenia)

Description

Sea surface temperature (SST) is critical for weather forecasting and climate modeling, however remotely sensed SST data often suffer from incomplete coverage due to cloud obstruction and limited satellite swath width. While deep learning approaches have shown promise in reconstructing missing data, existing methods struggle to accurately recover fine-grained details, which, however are crucial for many down-stream geophysical processing and prediction problems. We propose CRITER (Coarse Reconstruction with Iterative Refinement network), a novel two-stage approach comprising: (i) a transformer-based Coarse Reconstruction Module (CRM) that estimates low-frequency SST components by leveraging global spatio-temporal correlations in available observations, and (ii) an Iterative Refinement Module (IRM) for recovering high-frequency details absent from the initial CRM estimate. Extensive experiments across Mediterranean, Adriatic, and Atlantic sea datasets reveal CRITER's superior performance over the state-of-the-art DINCAE2 model. CRITER achieves substantial reconstruction error reductions in both missing and observed regions: $20\%$ and $89\%$ for the Mediterranean, $44\%$ and $80\%$ for the Adriatic, and $1\%$ and $88\%$ for the Atlantic dataset, respectively. These results mark a significant advancement in the field of sparse geophysical data reconstruction.

Primary author

Matjaž Zupančič Muc (Faculty of Computer and Information Science, University of Ljubljana, Ljubljana, Slovenia)

Co-authors

Aida Alvera-Azcárate (GHER, University of Liège, Liège, Belgium) Alexander Barth (GHER, University of Liège, Liège, Belgium) Matej Kristan (Faculty of Computer and Information Science, University of Ljubljana, Ljubljana, Slovenia) Matjaž Ličer (Slovenian Environment Agency, Office for Meteorology, Hidrology and Oceanography, Ljubljana, Slovenia) Vitjan Zavrtanik (Faculty of Computer and Information Science, University of Ljubljana, Ljubljana, Slovenia)

Presentation materials