Commit 48fd739a authored by Aaron Spring's avatar Aaron Spring 🚼
Browse files

Merge branch 'AS_redo_renku_datasets' into 'master'

redo renku datasets

Closes #5, #3, and s2s-ai-challenge#22

See merge request aaron.spring/s2s-ai-challenge-template!14
parents 23e55e79 76645b2d
Pipeline #209119 passed with stage
in 17 seconds
......@@ -437,3 +437,91 @@ data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/0.0.8.0.0 f
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/0.0.7.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/0.0.3.0.0 filter=lfs diff=lfs merge=lfs -text
data/ecmwf_recalibrated_benchmark_2020_biweekly_terciled.nc filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/2.0.2.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/1.0.3.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/2.0.3.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/1.0.0.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/2.0.0.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/1.1.3.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/1.1.0.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/1.1.2.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/2.1.0.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/2.0.3.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/2.0.2.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/1.0.3.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/2.1.2.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/0.0.2.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/0.0.3.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/2.1.1.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/1.0.2.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/0.1.1.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/2.0.3.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/0.1.0.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/2.1.0.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/0.1.2.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/2.0.2.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/1.1.3.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/0.1.1.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/2.1.3.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/2.1.2.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/0.1.3.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/0.0.0.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/2.1.3.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/1.0.1.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/2.0.0.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/1.0.2.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/1.1.0.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/2.0.1.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/1.1.1.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/2.0.0.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/2.1.1.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/1.0.2.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/0.1.1.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/1.1.0.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/1.1.2.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/0.1.2.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/0.1.3.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/1.1.1.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/0.1.2.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/2.1.1.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/2.1.2.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/1.1.2.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/1.1.0.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/1.1.1.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/1.1.3.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/1.0.1.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/2.1.3.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/0.1.0.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/0.0.0.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/0.1.0.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/2.0.3.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/2.1.0.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/2.0.2.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/0.0.1.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/0.0.2.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/1.0.0.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/1.0.1.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/0.1.3.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/1.0.0.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/1.0.3.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/0.1.2.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/0.1.0.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/1.0.2.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/2.1.0.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/1.0.3.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/2.1.1.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/2.1.3.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/1.1.3.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/1.1.2.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/2.0.0.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/0.1.3.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/1.0.0.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/2.0.1.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/t2m/2.0.1.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/0.0.1.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/1.0.1.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/1.1.1.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/0.1.1.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/2.0.1.0.0 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/0.0.3.0.1 filter=lfs diff=lfs merge=lfs -text
data/hindcast-like-observations_2000-2019_biweekly_terciled.zarr/tp/2.1.2.0.1 filter=lfs diff=lfs merge=lfs -text
......@@ -2,7 +2,7 @@
'@type':
- http://schema.org/Project
- http://www.w3.org/ns/prov#Location
http://schema.org/agent: 0.15.1
http://schema.org/agent: 0.14.2
http://schema.org/creator:
'@id': mailto:aaron.spring@mpimet.mpg.de
'@type':
......
......@@ -2,10 +2,11 @@
### unreleased
- Recreate biweekly renku datasets with `float32` single precision and newly uploaded data to [`climetlab_s2s_ai_challenge`](https://github.com/ecmwf-lab/climetlab-s2s-ai-challenge/releases/tag/0.7.0). Before `lead_time` in `tp` had a one day shift. These new renku datasets will be used by the [`s2saichallengescorer`](https://renkulab.io/gitlab/tasko.olevski/s2s-ai-competition-scoring-image/-/merge_requests/3). (#7, !9, https://renkulab.io/gitlab/aaron.spring/s2s-ai-challenge/-/issues/22, [Aaron Spring](https://renkulab.io/gitlab/aaron.spring))
- Order of processing gridded `RPSS` to final score: (#7, !9, [s2s-ai-competition-scoring-image!2](https://renkulab.io/gitlab/tasko.olevski/s2s-ai-competition-scoring-image/-/merge_requests/2), [Aaron Spring](https://renkulab.io/gitlab/aaron.spring))
1. `RPSS`
2. penalize #7
3. `clip(-10,1)`
2. penalize where `NaN` submitted but value expected #7
3. `clip(-10,1)`: prevent too negative values
4. mean over `forecast_time`
5. spatially weighted mean [90N-60S]
6. mean over `lead_time` and `data_vars`
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment