Cloud detection over landmarks from MSG SEVIRI images
Cloud detection over landmarks from MSG SEVIRI images

We cast the problem of cloud identification over landmarks on Meteosat Second Generation (MSG) SEVIRI data. This satellite mission constitutes a fundamental tool for weather forecasting, providing images of the full Earth disc every 15 minutes. Matching the landmarks accurately is of paramount importance in image navigation and registration (INR) models and geometric quality assessment (GQA) in the Level 1 instrument processing chain. Cloud contamination detection over landmarks is an essential step in the MSG processing chain, as undetected clouds are one of the most significant sources of error in landmark matching.

The landmark matching application requires only a binary detection. Furthermore, the cloud detection has to be carried out in real-time to be included in the landmark matching MSG processing chain, which implies efficient and robust detection schemes. Therefore, the proposed classification scheme is designed evaluating the complexity, the scalability, and parallelization of computations.

The dataset provided by EUMETSAT contains MSG/SEVIRI Level 1.5 acquisitions for 200 landmarks of variable size for a whole year, which are mainly located over the coastline, islands, or inland waters. A full Earth disk image is acquired every 15 minutes, which produces 96 images per day and results in 35040 images (or chips) per landmark in 2010. Additionally, Level 2 cloud products were provided for each landmark observation so the Level 2 cloud mask is used as the best available `ground truth’ to validate the results. Summarizing, in this problem, we have to deal with near 7 million MSG/SEVIRI multispectral images acquired during 2010.

The RKS method was used for cloud identification over landmarks. This was done in the context of a project titled Study on pattern recognition based cloud detection over landmarks in collaboration with EUMETSAT European Organisation for the Exploitation of Meteorological Satellites, 01/15 - 11/15. Below we show a set of illustrative videos where the best classifier results are show for particular landmarks. We show the L2 cloud mask and our classifier predictions, along with the cumulative accuracy per acquisition.

Randomized Kernels for Large Scale Earth Observation Applications
Randomized Kernels for Large Scale Earth Observation Applications

Current remote sensing applications for bio-geophysical parameter estimation and image classification handle unprecedented amounts of heterogeneous and complex data. New satellite sensors with higher time, space, and wavelength resolutions present computational challenges. Standard inversion techniques struggle to keep up with these new data sources, and classifying land cover from these new images requires substantial memory and processing power. Statistical learning has aided in developing models that can process large-scale Earth observation data.

Kernel methods are powerful machine learning algorithms widely used in remote sensing and geosciences. However, they are not broadly adopted due to high computational costs when applied to large-scale problems. This paper introduces an efficient kernel method for fast statistical retrieval of atmospheric and biophysical parameters, as well as for image classification. It uses projections on random Fourier features, approximating shift-invariant kernels, enabling large-scale data processing with kernel methods. The approach is computationally efficient, memory-conscious, and parallelizable.

We demonstrate the feasibility of kernel regression and classification on datasets with millions of samples. Examples include atmospheric parameter retrieval from IASI/Metop hyperspectral infrared sounders, large-scale inversion of the PROSAIL model on Sentinel-2 data, and cloud identification over landmarks in time series from MSG/Seviri images.

This webpage includes supplementary material to the paper Randomized Kernels for large scale Earth Observation applications by Pérez-Suay et al. in Remote Sensing of Environment, 2017. We include MATLAB illustrative code and videos showing operational performance of the proposed method in the particular case of cloud identification over landmarks. If you find the paper or provided MATLAB code below interesting and useful, please cite the work.

Kernel methods are powerful machine learning algorithms, widely used in remote sensing and geosciences. This paper introduces an efficient kernel method for fast statistical retrieval of atmospheric and biophysical parameters. The method approximates a kernel matrix with projections on random bases sampled from the Fourier domain.