Gnn Baseline Model Results

Here are the latest results after running the baseline gnn model on the ssp245 test scenario.

Kaggle Score

Metric	Score
nNSE (↑)	-0.482060

Quantitative Results

Variable	R²
`tas` (Near-Surface Air Temperature)	0.545
`tasmax` (Daily Max Temperature)	0.514
`tasmin` (Daily Min Temperature)	0.534
`pr` (Precipitation)	-0.084
`huss` (Specific Humidity)	0.467
`psl` (Sea Level Pressure)	0.176
`sfcWind` (Surface Wind Speed)	0.121

Climate Extreme Indices Metrics:

Index	Description	Unit	RMSE	R2
FD	Frost Days	days	10.228 days	-4.46
SU	Summer Days (Tmax ≥ 25°C)	days	11.395 days	-0.563
ID	Ice Days (Tmax < 0°C)	days	8.987 days	-1.255
TR	Tropical Nights (Tmin ≥ 20°C)	days	9.308 days	-0.412
GSL	Growing Season Length	days	12.083 days	-0.382
TXX	Monthly Max of Daily Tmax	°C	4.157 °C	-0.481
TNN	Monthly Min of Daily Tmin	°C	4.195 °C	-0.327
WSDI	Warm Spell Duration Index	days	94.055 days	-56.336
CSDI	Cold Spell Duration Index	days	3.331 days	-0.129
RX5DAY	Max 5-day Precipitation	mm	34.589 mm	-2.17
CDD	Consecutive Dry Days	days	202.794 days	-916.76
CWD	Consecutive Wet Days	days	85.508 days	-609.721
R95P	Total Precip above 95th pct	mm	0.004 mm	-9.783
SDII	Simple Daily Intensity Index	mm day⁻¹	4.448 mm day⁻¹	-63.006
R10MM	Days with Precip ≥10mm	days	22.533 days	-11.731

Visual Results

The visualizations for spatial maps and time series comparisons are generated within the playground.ipynb notebook. Below are all visuals from gnn_visuals/.

Spatial Comparison Maps

result_map_huss_2015-02-20.png	result_map_pr_2015-02-20.png

result_map_psl_2015-02-20.png	result_map_sfcWind_2015-02-20.png

result_map_tas_2015-02-20.png	result_map_tasmax_2015-02-20.png

result_map_tasmin_2015-02-20.png

Time Series Comparisons

result_timeseries_huss_40.0_-95.0.png	result_timeseries_pr_40.0_-95.0.png

result_timeseries_psl_40.0_-95.0.png	result_timeseries_sfcWind_40.0_-95.0.png

result_timeseries_tas_40.0_-95.0.png	result_timeseries_tasmax_40.0_-95.0.png

result_timeseries_tasmin_40.0_-95.0.png

Scatter Plots

result_scatter_huss_2015-02-20.png	result_scatter_pr_2015-02-20.png

result_scatter_psl_2015-02-20.png	result_scatter_sfcWind_2015-02-20.png

result_scatter_tas_2015-02-20.png	result_scatter_tasmax_2015-02-20.png

result_scatter_tasmin_2015-02-20.png

Other Visualizations

index_map_CDD_2065-01-01.png	index_map_CSDI_2065-01-01.png

index_map_CWD_2065-01-01.png	index_map_FD_2065-01-01.png

index_map_GSL_2065-01-01.png	index_map_ID_2065-01-01.png

index_map_R10mm_2065-01-01.png	index_map_R95p_2065-01-01.png

index_map_Rx5day_2019-03-01.png	index_map_SDII_2065-01-01.png

index_map_SU_2065-01-01.png	index_map_TNn_2019-03-01.png

index_map_TR_2065-01-01.png	index_map_TXx_2019-03-01.png

index_map_WSDI_2065-01-01.png	index_timeseries_CDD_40.0_-95.0.png

index_timeseries_CSDI_40.0_-95.0.png	index_timeseries_CWD_40.0_-95.0.png

index_timeseries_FD_40.0_-95.0.png	index_timeseries_GSL_40.0_-95.0.png

index_timeseries_ID_40.0_-95.0.png	index_timeseries_R10mm_40.0_-95.0.png

index_timeseries_R95p_40.0_-95.0.png	index_timeseries_Rx5day_40.0_-95.0.png

index_timeseries_SDII_40.0_-95.0.png	index_timeseries_SU_40.0_-95.0.png

index_timeseries_TNn_40.0_-95.0.png	index_timeseries_TR_40.0_-95.0.png

index_timeseries_TXx_40.0_-95.0.png	index_timeseries_WSDI_40.0_-95.0.png