Vision transformers to model land surface phenology
Good knowledge of Python programming language will be helpful for this MSc topic.
Staff Involved: Mahdi Farnaghi, Raul Zurita Milla, Mahdi Khodadadzadeh
To develop a model to estimate the timing of phenological events over large areas from time series of earth observation data using vision transformers, a fierce alternative to traditional deep learning approaches.
Keywords
Land surface phenology, Deep Learning, Convolutional Neural Networks, Vision Transformers (ViT), Earth Observation
Description
Climate change is modifying different aspects of life on the planet Earth. The continuous rise in global temperatures and weather patterns affects the distribution of plants and the timing of their main biological events (e.g., leafing and blooming). Phenology is the science that studies the timing of these events and their deriving forces in association with environmental phenomena. This project aims to exploit the power of state-of-the-art Deep Learning (DL) algorithms to facilitate the process of understanding phenological events from geospatial data gathered by Earth Observation (EO) satellites.
You will develop models to learn the relationships between phenological events and open-access EO data time series. Considering the complexity and diverse structure of phenological data, the direct adaptation of the existing DL models for analyzing such data is challenging. This topic aims at carefully selecting and modifying the state-of-the-art Vision Transformers (ViT) [1] and applying a suitable data representation. Your model will be checked against convolutional neural networks (CNNs) as the de-facto DL algorithm for EO-based information extraction [1]. You will also compare your model's output with the land surface phenology maps produced based on secondary EO products [2].
By estimating the timing of phenological events over large areas, you will contribute to a better understanding of (future) phenological changes and analyze the impact of climate change on plants.
Dataset
The following data sources will be used in this research
- EO data
- Phenological observations from http://www.pep725.eu/
Workflow
The workflow of the MSc thesis will be as follows.
- A literature review
- Dataset generation
- Model development, validation and tuning
- Evaluation
[1] Mai, G., Janowicz, K., Hu, Y., Gao, S., Yan, B., Zhu, R., Cai, L., and Lao, N. (2022). A review of location encoding for GeoAI: methods and applications. International Journal of Geographical Information Science, 36(4), 639-673.
[2] Tian, F., Cai, Z., Jin, H., Hufkens, K., Scheifinger, H., Tagesson, T., Smets, B., Van Hoolst, R., Bonte, K., Ivits, E., Tong, X., Ardö, J., and Eklundh, L. (2021). Calibrating vegetation phenology from Sentinel-2 using eddy covariance, PhenoCam, and PEP725 networks across Europe. Remote Sensing of Environment, 260, 112456.
[3] Kladny, K.-R., Milanta, M., Mraz, O., Hufkens, K., and Stocker, B. D. (2022). Deep learning for satellite image forecasting of vegetation greenness. Cold Spring Harbor Laboratory. Retrieved from https://dx.doi.org/10.1101/2022.08.16.504173
[4] Bakayov, V., Goncalves, R., Zurita-Milla, R., and Izquierdo-Verdiguier, E. A Spark-Based Platform to Extract Phenological Information from Satellite Images.