Screening · Bias correction · September initialization · ONDJ and its months

Screening · September initialization · ONDJ and its months

✓ = screening pass within the method (Holm across its targets); ✓✓ = also passes with Holm across all methods and targets (national aggregate only). A pass is screening evidence, not an adoption decision. Bold: the operational method. Skill is against the CHIRPS training climatology (0 = no better than climatology).

Region for the result tables

All Ethiopia (national aggregate)

ONDJ season at a glance — All Ethiopia
MethodAmount CRPSS 1993–2016Amount CRPSS 2017–2024Tercile RPSS (no blend) 1993–2016Tercile RPSS (no blend) 2017–2024Mean bias (mm)MAE (mm)CorrelationSpread–errorReliability indexMembers ≤ 1 mm
Raw ECMWF (no correction)-0.180-0.116-0.149-0.109-14.869.60.430.540.370.0%
Linear Scaling+0.070+0.131+0.025+0.058-0.157.40.310.780.160.0%
Mean-Variance Scaling (operational)+0.070+0.178+0.035+0.065-0.557.60.270.960.091.8%
Variance Scaling (unbounded)+0.063+0.182+0.036+0.064-0.557.80.261.010.102.3%
Square-root-space Mean-Variance Scaling+0.080 ✓+0.189+0.038+0.073-0.657.40.280.940.070.1%
Power Transformation+0.071+0.188+0.036+0.065-0.957.90.261.010.050.0%
Delta Change+0.093+0.114+0.028+0.011-0.157.40.311.160.050.0%
Local Intensity Scaling+0.070+0.131+0.024+0.058-0.257.40.300.770.170.0%
Empirical Quantile Mapping+0.053+0.168+0.025+0.049-1.157.80.250.970.100.0%
Gamma Quantile Mapping+0.082 ✓+0.192+0.039+0.076-0.557.30.280.930.080.0%
Detrended Quantile Mapping+0.072+0.115+0.010+0.024-1.757.00.320.980.080.0%
Quantile Delta Mapping+0.075+0.118+0.009+0.020-0.157.40.311.040.090.0%
Scaled Distribution Mapping+0.061+0.108-0.005+0.010-5.256.90.300.860.180.4%
CDF-transform+0.074+0.118+0.011+0.029-3.856.80.320.830.120.0%
MVS with all-zero guard (variant)+0.070+0.178+0.035+0.065-0.557.60.270.960.091.8%
Amount skill (CRPSS) by target, leave-one-year-out 1993–2016
MethodOctNovDecJanONDJ
Raw ECMWF (no correction)-0.203-0.033-0.118-0.551-0.180
Linear Scaling-0.016+0.073-0.008-0.132+0.070
Mean-Variance Scaling (operational)-0.002+0.084+0.028-0.048+0.070
Variance Scaling (unbounded)-0.004+0.082+0.031-0.007 ✓+0.063
Square-root-space Mean-Variance Scaling+0.006+0.089+0.037 ✓+0.034 ✓✓+0.080 ✓
Power Transformation+0.001+0.082+0.020-0.025+0.071
Delta Change+0.021+0.085+0.026-0.047+0.093
Local Intensity Scaling-0.016+0.079+0.010-0.104+0.070
Empirical Quantile Mapping-0.012+0.075+0.033+0.010+0.053
Gamma Quantile Mapping+0.007+0.088+0.030+0.015 ✓✓+0.082 ✓
Detrended Quantile Mapping+0.005+0.075-0.001-0.065+0.072
Quantile Delta Mapping+0.010+0.076+0.014-0.027+0.075
Scaled Distribution Mapping-0.002+0.068-0.021-0.216+0.061
CDF-transform+0.002+0.073-0.019-0.108+0.074
MVS with all-zero guard (variant)-0.002+0.084+0.028-0.048+0.070
Tercile skill (RPSS of smoothed counts, no blend) by target, 1993–2016
MethodOctNovDecJanONDJ
Raw ECMWF (no correction)-0.165-0.043-0.175-0.516-0.149
Linear Scaling-0.033+0.035-0.080-0.144+0.025
Mean-Variance Scaling (operational)-0.009+0.044-0.068-0.213+0.035
Variance Scaling (unbounded)-0.009+0.045-0.060-0.176 ✓+0.036
Square-root-space Mean-Variance Scaling-0.005+0.060 ✓✓-0.030 ✓-0.017 ✓✓+0.038
Power Transformation-0.013+0.044-0.049-0.046 ✓✓+0.036
Delta Change-0.003+0.044-0.154-0.214+0.028
Local Intensity Scaling-0.028+0.047-0.109-0.153+0.024
Empirical Quantile Mapping-0.023+0.046-0.065-0.010 ✓+0.025
Gamma Quantile Mapping-0.006+0.052-0.111-0.038 ✓✓+0.039
Detrended Quantile Mapping-0.020+0.031-0.189-0.211+0.010
Quantile Delta Mapping-0.015+0.020-0.116-0.074+0.009
Scaled Distribution Mapping-0.025+0.018-0.192-0.321-0.005
CDF-transform-0.026+0.010-0.241-0.254+0.011
MVS with all-zero guard (variant)-0.009+0.044-0.068-0.213+0.035
More scores by target: test years, fair CRPS, bias, correlation, spread, reliability, coverage
Amount skill (CRPSS), fit 1993–2016, scored 2017–2024
MethodOctNovDecJanONDJ
Raw ECMWF (no correction)-0.120+0.031-0.183-0.573-0.116
Linear Scaling+0.054+0.125-0.114-0.182+0.131
Mean-Variance Scaling (operational)+0.059+0.158-0.033-0.078+0.178
Variance Scaling (unbounded)+0.056+0.159-0.032+0.007+0.182
Square-root-space Mean-Variance Scaling+0.060+0.162-0.026+0.093+0.189
Power Transformation+0.049+0.165-0.062+0.007+0.188
Delta Change+0.028+0.117-0.019-0.030+0.114
Local Intensity Scaling+0.052+0.134-0.079-0.115+0.131
Empirical Quantile Mapping+0.033+0.158-0.015+0.105+0.168
Gamma Quantile Mapping+0.059+0.165-0.037+0.053+0.192
Detrended Quantile Mapping+0.034+0.116-0.042-0.063+0.115
Quantile Delta Mapping+0.036+0.123-0.043+0.032+0.118
Scaled Distribution Mapping+0.025+0.103-0.055-0.184+0.108
CDF-transform+0.030+0.120-0.097-0.151+0.118
MVS with all-zero guard (variant)+0.059+0.158-0.033-0.078+0.178
Amount skill with the fair CRPS (diagnostic), 1993–2016
MethodOctNovDecJanONDJ
Raw ECMWF (no correction)-0.226-0.048-0.136-0.599-0.205
Linear Scaling-0.031+0.068-0.007-0.119+0.060
Mean-Variance Scaling (operational)-0.009+0.082+0.023-0.066+0.066
Variance Scaling (unbounded)-0.011+0.080+0.026-0.019 ✓✓+0.060
Square-root-space Mean-Variance Scaling-0.002+0.085+0.032 ✓+0.030 ✓✓+0.075 ✓
Power Transformation-0.006+0.079+0.016-0.029+0.067
Delta Change+0.022+0.089+0.027-0.049+0.097
Local Intensity Scaling-0.031+0.075+0.009-0.099+0.059
Empirical Quantile Mapping-0.020+0.071+0.027+0.004 ✓+0.046
Gamma Quantile Mapping-0.001+0.083+0.024+0.008 ✓✓+0.076
Detrended Quantile Mapping-0.002+0.072-0.007-0.073+0.066
Quantile Delta Mapping+0.005+0.074+0.010-0.030+0.071
Scaled Distribution Mapping-0.013+0.059-0.035-0.240+0.052
CDF-transform-0.009+0.067-0.026-0.117+0.065
MVS with all-zero guard (variant)-0.009+0.082+0.023-0.066+0.066
Tercile skill (RPSS, no blend), fit 1993–2016, scored 2017–2024
MethodOctNovDecJanONDJ
Raw ECMWF (no correction)-0.058-0.054-0.084-0.257-0.109
Linear Scaling+0.062+0.006-0.028-0.011+0.058
Mean-Variance Scaling (operational)+0.012+0.041-0.049-0.300+0.065
Variance Scaling (unbounded)+0.008+0.044-0.042-0.220+0.064
Square-root-space Mean-Variance Scaling+0.018+0.058-0.033+0.052+0.073
Power Transformation+0.007+0.050-0.026+0.013+0.065
Delta Change-0.023-0.026-0.061-0.053+0.011
Local Intensity Scaling+0.037-0.001-0.036-0.018+0.058
Empirical Quantile Mapping-0.041+0.022-0.014+0.092+0.049
Gamma Quantile Mapping-0.002+0.050-0.136-0.012+0.076
Detrended Quantile Mapping-0.028-0.021-0.086-0.051+0.024
Quantile Delta Mapping-0.018-0.012-0.026+0.083+0.020
Scaled Distribution Mapping-0.033-0.068-0.088-0.127+0.010
CDF-transform-0.014-0.009-0.119-0.027+0.029
MVS with all-zero guard (variant)+0.012+0.041-0.049-0.300+0.065
Ensemble-mean bias (mm), 1993–2016
MethodOctNovDecJanONDJ
Raw ECMWF (no correction)+4.4-5.4-4.8-9.0-14.8
Linear Scaling-0.0-0.1+0.0+0.1-0.1
Mean-Variance Scaling (operational)+0.4+0.2+0.1-0.0-0.5
Variance Scaling (unbounded)+0.4+0.3+0.1-0.0-0.5
Square-root-space Mean-Variance Scaling-0.1-0.1+0.0+0.0-0.6
Power Transformation-0.1-0.1+0.0-0.0-0.9
Delta Change-0.0-0.1+0.0+0.1-0.1
Local Intensity Scaling-0.0-0.1-0.3-0.9-0.2
Empirical Quantile Mapping-0.2-0.1-0.0-0.1-1.1
Gamma Quantile Mapping-0.1-0.1-0.1-0.1-0.5
Detrended Quantile Mapping-0.2-0.1+0.1+0.4-1.7
Quantile Delta Mapping+0.0+0.3+0.4+0.6-0.1
Scaled Distribution Mapping-4.5-3.9-3.4-5.3-5.2
CDF-transform-1.8-0.6+0.4+1.2-3.8
MVS with all-zero guard (variant)+0.4+0.2+0.1-0.0-0.5
Correlation of the ensemble mean with CHIRPS over years, 1993–2016
MethodOctNovDecJanONDJ
Raw ECMWF (no correction)+0.23+0.38+0.16+0.18+0.43
Linear Scaling+0.07+0.24+0.03+0.11+0.31
Mean-Variance Scaling (operational)+0.08+0.23+0.02+0.01+0.27
Variance Scaling (unbounded)+0.08+0.23+0.01-0.03+0.26
Square-root-space Mean-Variance Scaling+0.09+0.23+0.01+0.05+0.28
Power Transformation+0.08+0.23+0.02+0.02+0.26
Delta Change+0.07+0.24+0.03+0.08+0.31
Local Intensity Scaling+0.07+0.24+0.03+0.08+0.30
Empirical Quantile Mapping+0.07+0.22+0.00-0.01+0.25
Gamma Quantile Mapping+0.09+0.22+0.00-0.04+0.28
Detrended Quantile Mapping+0.09+0.24+0.02+0.11+0.32
Quantile Delta Mapping+0.07+0.24+0.02+0.05+0.31
Scaled Distribution Mapping+0.06+0.25+0.06+0.11+0.30
CDF-transform+0.06+0.24+0.04+0.16+0.32
MVS with all-zero guard (variant)+0.08+0.23+0.02+0.01+0.27
Spread–error ratio, 1993–2016 (1 = spread matches the error)
MethodOctNovDecJanONDJ
Raw ECMWF (no correction)0.610.680.630.390.54
Linear Scaling0.720.941.151.810.78
Mean-Variance Scaling (operational)0.901.010.960.830.96
Variance Scaling (unbounded)0.931.021.001.001.01
Square-root-space Mean-Variance Scaling0.900.970.951.070.94
Power Transformation0.951.041.010.981.01
Delta Change1.041.151.181.161.16
Local Intensity Scaling0.720.951.101.590.77
Empirical Quantile Mapping0.931.020.990.980.97
Gamma Quantile Mapping0.900.960.940.980.93
Detrended Quantile Mapping0.961.041.041.060.98
Quantile Delta Mapping0.991.071.081.201.04
Scaled Distribution Mapping0.810.870.810.750.86
CDF-transform0.830.961.031.130.83
MVS with all-zero guard (variant)0.901.010.960.830.96
Rank-histogram reliability index, 1993–2016 (0 = flat)
MethodOctNovDecJanONDJ
Raw ECMWF (no correction)0.450.140.381.020.37
Linear Scaling0.380.130.380.660.16
Mean-Variance Scaling (operational)0.100.110.220.680.09
Variance Scaling (unbounded)0.100.110.210.690.10
Square-root-space Mean-Variance Scaling0.150.150.260.110.07
Power Transformation0.180.110.280.260.05
Delta Change0.050.130.420.500.05
Local Intensity Scaling0.330.130.400.650.17
Empirical Quantile Mapping0.090.070.250.230.10
Gamma Quantile Mapping0.130.130.230.420.08
Detrended Quantile Mapping0.080.100.450.520.08
Quantile Delta Mapping0.090.080.330.270.09
Scaled Distribution Mapping0.170.150.530.780.18
CDF-transform0.220.190.530.590.12
MVS with all-zero guard (variant)0.100.110.220.680.09
Score coverage, mean per year, 1993–2016 (share of the region’s area)
TargetAmount cellsAmount areaProbability cellsProbability area
Oct1484100%1479100%
Nov1484100%1479100%
Dec1484100%137893%
Jan1484100%114977%
ONDJ1484100%1484100%
Dry months: shares of totals at exactly 0 mm and at ≤ 1 mm, CHIRPS and corrected
Area-weighted mean share over cells, pooled leave-one-year-out 1993–2024
Exactly 0 mm≤ 1 mm
Oct: CHIRPS0.4%2.3%
Raw ECMWF (no correction)0.0%0.8%
Linear Scaling0.0%0.9%
Mean-Variance Scaling (operational)4.3%5.0%
Variance Scaling (unbounded)4.4%5.2%
Square-root-space Mean-Variance Scaling0.9%2.7%
Power Transformation0.0%1.5%
Delta Change0.4%2.4%
Local Intensity Scaling2.3%2.3%
Empirical Quantile Mapping2.3%2.4%
Gamma Quantile Mapping2.5%3.2%
Detrended Quantile Mapping2.2%2.4%
Quantile Delta Mapping2.3%2.6%
Scaled Distribution Mapping3.6%3.7%
CDF-transform0.0%2.0%
MVS with all-zero guard (variant)4.3%5.0%
Nov: CHIRPS0.7%5.2%
Raw ECMWF (no correction)0.5%8.5%
Linear Scaling0.5%7.7%
Mean-Variance Scaling (operational)7.6%9.4%
Variance Scaling (unbounded)8.2%10.0%
Square-root-space Mean-Variance Scaling2.2%6.3%
Power Transformation0.5%6.5%
Delta Change0.7%5.7%
Local Intensity Scaling5.5%5.5%
Empirical Quantile Mapping5.2%5.3%
Gamma Quantile Mapping5.5%7.9%
Detrended Quantile Mapping4.9%5.6%
Quantile Delta Mapping5.2%6.1%
Scaled Distribution Mapping12.4%12.8%
CDF-transform0.3%4.9%
MVS with all-zero guard (variant)7.6%9.4%
Dec: CHIRPS0.6%18.9%
Raw ECMWF (no correction)6.5%32.5%
Linear Scaling6.5%32.2%
Mean-Variance Scaling (operational)12.0%22.2%
Variance Scaling (unbounded)8.9%21.3%
Square-root-space Mean-Variance Scaling2.7%19.6%
Power Transformation6.5%26.1%
Delta Change0.6%20.4%
Local Intensity Scaling21.5%21.5%
Empirical Quantile Mapping18.9%19.0%
Gamma Quantile Mapping18.2%23.4%
Detrended Quantile Mapping18.6%21.4%
Quantile Delta Mapping18.9%20.7%
Scaled Distribution Mapping36.0%39.8%
CDF-transform0.3%20.0%
MVS with all-zero guard (variant)12.0%22.2%
Jan: CHIRPS1.0%16.6%
Raw ECMWF (no correction)20.0%55.3%
Linear Scaling20.0%43.1%
Mean-Variance Scaling (operational)4.6%16.8%
Variance Scaling (unbounded)1.5%16.1%
Square-root-space Mean-Variance Scaling0.8%17.2%
Power Transformation20.0%27.2%
Delta Change1.0%20.6%
Local Intensity Scaling28.1%28.1%
Empirical Quantile Mapping16.6%16.7%
Gamma Quantile Mapping14.9%18.7%
Detrended Quantile Mapping16.5%21.6%
Quantile Delta Mapping16.6%17.2%
Scaled Distribution Mapping48.1%56.4%
CDF-transform0.2%19.3%
MVS with all-zero guard (variant)4.6%16.8%
ONDJ: CHIRPS0.0%0.0%
Raw ECMWF (no correction)0.0%0.0%
Linear Scaling0.0%0.0%
Mean-Variance Scaling (operational)1.5%1.6%
Variance Scaling (unbounded)2.0%2.1%
Square-root-space Mean-Variance Scaling0.0%0.1%
Power Transformation0.0%0.0%
Delta Change0.0%0.0%
Local Intensity Scaling0.0%0.0%
Empirical Quantile Mapping0.0%0.0%
Gamma Quantile Mapping0.0%0.0%
Detrended Quantile Mapping0.0%0.0%
Quantile Delta Mapping0.0%0.0%
Scaled Distribution Mapping0.7%0.7%
CDF-transform0.0%0.0%
MVS with all-zero guard (variant)1.5%1.6%
Distribution of the corrected members (mean, spread, 10th and 90th percentiles)
Mean of the corrected members / CHIRPS (area-weighted median of cell ratios, 1993–2024; 1 = same)
MethodOctNovDecJanONDJ
Raw ECMWF (no correction)0.980.790.820.340.86
Linear Scaling1.001.001.001.011.00
Mean-Variance Scaling (operational)1.001.001.001.001.00
Variance Scaling (unbounded)1.001.001.001.001.00
Square-root-space Mean-Variance Scaling1.001.001.001.001.00
Power Transformation1.001.001.001.001.00
Delta Change1.001.001.001.001.00
Local Intensity Scaling1.001.000.970.901.00
Empirical Quantile Mapping1.001.001.001.001.00
Gamma Quantile Mapping1.001.001.001.001.00
Detrended Quantile Mapping1.001.001.001.020.99
Quantile Delta Mapping1.001.011.031.041.00
Scaled Distribution Mapping0.940.880.720.510.97
CDF-transform0.990.991.041.110.98
MVS with all-zero guard (variant)1.001.001.001.001.00
Standard deviation of the corrected members / CHIRPS (area-weighted median of cell ratios, 1993–2024; 1 = same)
MethodOctNovDecJanONDJ
Raw ECMWF (no correction)0.790.771.050.960.69
Linear Scaling0.810.941.262.500.84
Mean-Variance Scaling (operational)1.000.991.011.020.99
Variance Scaling (unbounded)1.000.991.011.020.99
Square-root-space Mean-Variance Scaling0.980.940.931.110.94
Power Transformation1.001.001.011.001.00
Delta Change1.061.091.171.341.07
Local Intensity Scaling0.810.961.161.700.83
Empirical Quantile Mapping1.000.991.001.000.98
Gamma Quantile Mapping0.980.910.880.910.92
Detrended Quantile Mapping0.991.001.091.290.96
Quantile Delta Mapping1.011.031.161.370.99
Scaled Distribution Mapping0.880.850.870.970.86
CDF-transform0.930.981.131.530.89
MVS with all-zero guard (variant)1.000.991.011.020.99
10th percentile of the corrected members / CHIRPS (area-weighted median of cell ratios, 1993–2024; 1 = same)
MethodOctNovDecJanONDJ
Raw ECMWF (no correction)1.270.520.060.000.93
Linear Scaling1.250.730.070.001.03
Mean-Variance Scaling (operational)0.880.610.621.160.86
Variance Scaling (unbounded)0.850.580.711.160.82
Square-root-space Mean-Variance Scaling0.950.750.570.860.91
Power Transformation1.000.640.240.000.89
Delta Change0.920.860.710.620.91
Local Intensity Scaling1.200.650.260.001.04
Empirical Quantile Mapping0.960.970.980.990.97
Gamma Quantile Mapping0.970.780.590.700.94
Detrended Quantile Mapping0.950.870.690.610.96
Quantile Delta Mapping0.970.890.760.930.97
Scaled Distribution Mapping0.970.690.000.000.98
CDF-transform1.010.870.610.580.98
MVS with all-zero guard (variant)0.880.610.621.160.86
90th percentile of the corrected members / CHIRPS (area-weighted median of cell ratios, 1993–2024; 1 = same)
MethodOctNovDecJanONDJ
Raw ECMWF (no correction)0.920.811.100.470.81
Linear Scaling0.961.011.311.420.98
Mean-Variance Scaling (operational)1.031.011.110.921.04
Variance Scaling (unbounded)1.031.011.070.921.05
Square-root-space Mean-Variance Scaling1.030.991.091.061.02
Power Transformation1.031.011.121.111.04
Delta Change1.061.051.071.121.06
Local Intensity Scaling0.961.011.161.080.98
Empirical Quantile Mapping1.031.041.071.041.03
Gamma Quantile Mapping1.030.981.000.971.02
Detrended Quantile Mapping1.031.031.081.131.02
Quantile Delta Mapping1.041.041.111.081.04
Scaled Distribution Mapping0.960.890.830.710.97
CDF-transform1.011.031.151.301.01
MVS with all-zero guard (variant)1.031.011.110.921.04

Screening statistics

Every method, target and score (within-method and family-wide Holm)

Screening rule (docs/36 rule applied as a screen): a method passes for a target and score if, on the leave-one-year-out 1993-2016 per-year scores, its mean improvement over mvs has a one-sided sign-flip p-value below 0.05 after Holm adjustment, and its mean score over 2017-2024 (fits on 1993-2016) is not worse. 'screen_pass': Holm across the 5 targets of one method. 'screen_pass_family': Holm across every method and target of the benchmark for that score. A screening pass is not an operational adoption decision (see the confirmation run).

Screening statistics, CRPS (method minus Mean-Variance Scaling; negative favours the method)
MethodTargetΔ CRPS 1993–2016 (mm)95% intervalYears betterp (one-sided)Holm p (method)Holm p (all 60)Δ 2017–2024Screening
Linear ScalingOct+0.41-0.38 to +1.2811/240.81771.00001.0000+0.16—
Linear ScalingNov+0.22+0.02 to +0.406/240.98051.00001.0000+0.77—
Linear ScalingDec+0.27+0.12 to +0.417/240.99841.00001.0000+0.38—
Linear ScalingJan+0.49-0.08 to +1.009/240.94391.00001.0000+0.42—
Linear ScalingONDJ-0.01-1.28 to +1.2314/240.49181.00001.0000+2.36—
Variance Scaling (unbounded)Oct+0.07-0.04 to +0.178/240.89311.00001.0000+0.08—
Variance Scaling (unbounded)Nov+0.05+0.02 to +0.087/240.99731.00001.0000-0.02—
Variance Scaling (unbounded)Dec-0.02-0.06 to +0.0115/240.11100.44401.0000-0.00—
Variance Scaling (unbounded)Jan-0.24-0.37 to -0.1116/240.00120.00620.0722-0.34✓
Variance Scaling (unbounded)ONDJ+0.34+0.04 to +0.677/240.97891.00001.0000-0.19—
Square-root-space Mean-Variance ScalingOct-0.23-0.48 to +0.0315/240.04880.09761.0000-0.01—
Square-root-space Mean-Variance ScalingNov-0.09-0.22 to +0.0516/240.09550.09761.0000-0.10—
Square-root-space Mean-Variance ScalingDec-0.07-0.11 to -0.0220/240.00480.01910.2722-0.03✓
Square-root-space Mean-Variance ScalingJan-0.48-0.72 to -0.2518/240.00040.00180.0209-0.69✓✓
Square-root-space Mean-Variance ScalingONDJ-0.43-0.75 to -0.1318/240.00650.01940.3615-0.57✓
Power TransformationOct-0.09-0.51 to +0.3515/240.34691.00001.0000+0.30—
Power TransformationNov+0.05-0.13 to +0.2414/240.68411.00001.0000-0.16—
Power TransformationDec+0.06-0.03 to +0.146/240.91871.00001.0000+0.14—
Power TransformationJan-0.13-0.36 to +0.1012/240.13170.65871.0000-0.34—
Power TransformationONDJ-0.03-0.67 to +0.6515/240.46631.00001.0000-0.50—
Delta ChangeOct-0.68-1.60 to +0.1814/240.08110.37921.0000+0.94—
Delta ChangeNov-0.02-0.57 to +0.5011/240.47771.00001.0000+0.95—
Delta ChangeDec+0.02-0.17 to +0.2311/240.57281.00001.0000-0.07—
Delta ChangeJan-0.01-0.47 to +0.4110/240.48921.00001.0000-0.19—
Delta ChangeONDJ-1.04-2.38 to +0.3416/240.07580.37921.0000+3.22—
Local Intensity ScalingOct+0.42-0.39 to +1.2911/240.81661.00001.0000+0.23—
Local Intensity ScalingNov+0.10-0.07 to +0.269/240.86161.00001.0000+0.57—
Local Intensity ScalingDec+0.14-0.00 to +0.276/240.96461.00001.0000+0.22—
Local Intensity ScalingJan+0.32-0.20 to +0.829/240.87491.00001.0000+0.15—
Local Intensity ScalingONDJ+0.01-1.30 to +1.2914/240.50701.00001.0000+2.39—
Empirical Quantile MappingOct+0.32-0.20 to +0.8311/240.87821.00001.0000+0.81—
Empirical Quantile MappingNov+0.19-0.17 to +0.5713/240.82691.00001.0000-0.01—
Empirical Quantile MappingDec-0.03-0.18 to +0.1211/240.33581.00001.0000-0.09—
Empirical Quantile MappingJan-0.34-0.61 to -0.0813/240.01170.05830.6294-0.74—
Empirical Quantile MappingONDJ+0.78-0.35 to +2.0614/240.86651.00001.0000+0.49—
Gamma Quantile MappingOct-0.26-0.59 to +0.0615/240.06540.19611.0000-0.01—
Gamma Quantile MappingNov-0.06-0.23 to +0.1113/240.23700.47411.0000-0.16—
Gamma Quantile MappingDec-0.02-0.06 to +0.0315/240.27690.47411.0000+0.02—
Gamma Quantile MappingJan-0.36-0.54 to -0.2019/240.00010.00070.0084-0.53✓✓
Gamma Quantile MappingONDJ-0.52-0.92 to -0.1418/240.00740.02970.4087-0.71✓
Detrended Quantile MappingOct-0.20-0.89 to +0.4615/240.28441.00001.0000+0.75—
Detrended Quantile MappingNov+0.18-0.16 to +0.5412/240.83601.00001.0000+0.98—
Detrended Quantile MappingDec+0.22+0.04 to +0.418/240.98551.00001.0000+0.04—
Detrended Quantile MappingJan+0.10-0.52 to +0.649/240.61341.00001.0000-0.06—
Detrended Quantile MappingONDJ-0.09-1.12 to +1.0215/240.44021.00001.0000+3.18—
Quantile Delta MappingOct-0.36-1.09 to +0.3515/240.17960.89801.0000+0.70—
Quantile Delta MappingNov+0.15-0.14 to +0.4611/240.83141.00001.0000+0.81—
Quantile Delta MappingDec+0.11-0.08 to +0.329/240.80631.00001.0000+0.05—
Quantile Delta MappingJan-0.12-0.63 to +0.3510/240.32741.00001.0000-0.44—
Quantile Delta MappingONDJ-0.22-1.08 to +0.7416/240.33461.00001.0000+3.06—
Scaled Distribution MappingOct+0.00-1.17 to +1.2814/240.49891.00001.0000+1.03—
Scaled Distribution MappingNov+0.32-0.34 to +1.0714/240.79861.00001.0000+1.29—
Scaled Distribution MappingDec+0.36-0.12 to +0.8410/240.91651.00001.0000+0.10—
Scaled Distribution MappingJan+0.98+0.21 to +1.7311/240.98871.00001.0000+0.43—
Scaled Distribution MappingONDJ+0.40-1.01 to +2.0215/240.67681.00001.0000+3.53—
CDF-transformOct-0.10-0.87 to +0.6814/240.40511.00001.0000+0.87—
CDF-transformNov+0.23-0.06 to +0.5411/240.91631.00001.0000+0.89—
CDF-transformDec+0.35+0.13 to +0.596/240.99841.00001.0000+0.30—
CDF-transformJan+0.35-0.35 to +0.966/240.83471.00001.0000+0.30—
CDF-transformONDJ-0.18-1.16 to +0.8716/240.37361.00001.0000+3.04—
MVS with all-zero guard (variant)Oct+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
MVS with all-zero guard (variant)Nov+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
MVS with all-zero guard (variant)Dec+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
MVS with all-zero guard (variant)Jan+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
MVS with all-zero guard (variant)ONDJ+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
Screening statistics, fair CRPS (method minus Mean-Variance Scaling; negative favours the method)
MethodTargetΔ fair CRPS 1993–2016 (mm)95% intervalYears betterp (one-sided)Holm p (method)Holm p (all 60)Δ 2017–2024Screening
Linear ScalingOct+0.63-0.16 to +1.489/240.91871.00001.0000+0.26—
Linear ScalingNov+0.25+0.06 to +0.435/240.99061.00001.0000+0.79—
Linear ScalingDec+0.21+0.06 to +0.357/240.99121.00001.0000+0.36—
Linear ScalingJan+0.30-0.28 to +0.829/240.83561.00001.0000+0.34—
Linear ScalingONDJ+0.27-0.98 to +1.4913/240.65831.00001.0000+2.51—
Variance Scaling (unbounded)Oct+0.04-0.06 to +0.149/240.78811.00001.0000+0.07—
Variance Scaling (unbounded)Nov+0.04+0.01 to +0.079/240.99111.00001.0000-0.02—
Variance Scaling (unbounded)Dec-0.03-0.06 to +0.0115/240.07660.30641.0000-0.01—
Variance Scaling (unbounded)Jan-0.26-0.39 to -0.1418/240.00060.00290.0339-0.35✓✓
Variance Scaling (unbounded)ONDJ+0.27-0.02 to +0.607/240.95041.00001.0000-0.22—
Square-root-space Mean-Variance ScalingOct-0.21-0.46 to +0.0515/240.06890.13781.0000-0.00—
Square-root-space Mean-Variance ScalingNov-0.07-0.20 to +0.0716/240.16590.16591.0000-0.09—
Square-root-space Mean-Variance ScalingDec-0.07-0.11 to -0.0220/240.00550.02190.3063-0.03✓
Square-root-space Mean-Variance ScalingJan-0.54-0.78 to -0.3120/240.00010.00030.0029-0.72✓✓
Square-root-space Mean-Variance ScalingONDJ-0.37-0.69 to -0.0618/240.01630.04890.8962-0.54✓
Power TransformationOct-0.09-0.51 to +0.3515/240.35151.00001.0000+0.30—
Power TransformationNov+0.04-0.13 to +0.2314/240.66621.00001.0000-0.17—
Power TransformationDec+0.04-0.04 to +0.127/240.84351.00001.0000+0.13—
Power TransformationJan-0.20-0.43 to +0.0214/240.04680.23421.0000-0.38—
Power TransformationONDJ-0.04-0.67 to +0.6115/240.44551.00001.0000-0.51—
Delta ChangeOct-0.88-1.82 to -0.0214/240.03630.18071.0000+0.31—
Delta ChangeNov-0.13-0.69 to +0.3912/240.32660.97971.0000+0.52—
Delta ChangeDec-0.03-0.21 to +0.1713/240.38550.97971.0000-0.22—
Delta ChangeJan-0.09-0.56 to +0.3311/240.35140.97971.0000-0.33—
Delta ChangeONDJ-1.34-2.71 to +0.0616/240.03610.18071.0000+2.26—
Local Intensity ScalingOct+0.63-0.17 to +1.5011/240.91861.00001.0000+0.33—
Local Intensity ScalingNov+0.13-0.04 to +0.299/240.92661.00001.0000+0.58—
Local Intensity ScalingDec+0.10-0.04 to +0.237/240.90371.00001.0000+0.20—
Local Intensity ScalingJan+0.18-0.35 to +0.6811/240.74121.00001.0000+0.09—
Local Intensity ScalingONDJ+0.31-0.99 to +1.5613/240.67241.00001.0000+2.54—
Empirical Quantile MappingOct+0.33-0.20 to +0.8411/240.88361.00001.0000+0.82—
Empirical Quantile MappingNov+0.20-0.16 to +0.5813/240.84351.00001.0000-0.00—
Empirical Quantile MappingDec-0.03-0.17 to +0.1212/240.34401.00001.0000-0.09—
Empirical Quantile MappingJan-0.39-0.66 to -0.1314/240.00470.02370.2702-0.76✓
Empirical Quantile MappingONDJ+0.87-0.25 to +2.1612/240.89501.00001.0000+0.53—
Gamma Quantile MappingOct-0.24-0.57 to +0.0914/240.09110.27331.0000+0.01—
Gamma Quantile MappingNov-0.03-0.20 to +0.1412/240.35670.71331.0000-0.14—
Gamma Quantile MappingDec-0.01-0.05 to +0.0414/240.38420.71331.0000+0.02—
Gamma Quantile MappingJan-0.41-0.58 to -0.2521/240.00000.00010.0009-0.55✓✓
Gamma Quantile MappingONDJ-0.44-0.85 to -0.0518/240.02220.08891.0000-0.67—
Detrended Quantile MappingOct-0.21-0.90 to +0.4515/240.27421.00001.0000+0.75—
Detrended Quantile MappingNov+0.18-0.16 to +0.5412/240.83781.00001.0000+0.98—
Detrended Quantile MappingDec+0.21+0.04 to +0.408/240.98341.00001.0000+0.04—
Detrended Quantile MappingJan+0.04-0.59 to +0.589/240.54301.00001.0000-0.08—
Detrended Quantile MappingONDJ-0.01-1.05 to +1.1115/240.49331.00001.0000+3.22—
Quantile Delta MappingOct-0.40-1.14 to +0.3215/240.15340.76711.0000+0.70—
Quantile Delta MappingNov+0.14-0.15 to +0.4511/240.81091.00001.0000+0.81—
Quantile Delta MappingDec+0.09-0.10 to +0.3111/240.76251.00001.0000+0.05—
Quantile Delta MappingJan-0.20-0.72 to +0.2711/240.23260.93051.0000-0.47—
Quantile Delta MappingONDJ-0.22-1.09 to +0.7416/240.33230.99691.0000+3.08—
Scaled Distribution MappingOct+0.11-1.06 to +1.3913/240.56431.00001.0000+1.08—
Scaled Distribution MappingNov+0.43-0.24 to +1.1712/240.86331.00001.0000+1.33—
Scaled Distribution MappingDec+0.41-0.07 to +0.899/240.94051.00001.0000+0.12—
Scaled Distribution MappingJan+0.97+0.20 to +1.7211/240.98811.00001.0000+0.42—
Scaled Distribution MappingONDJ+0.62-0.78 to +2.2315/240.76201.00001.0000+3.62—
CDF-transformOct-0.01-0.78 to +0.7614/240.48781.00001.0000+0.90—
CDF-transformNov+0.27-0.03 to +0.5911/240.94331.00001.0000+0.90—
CDF-transformDec+0.34+0.13 to +0.597/240.99841.00001.0000+0.30—
CDF-transformJan+0.28-0.42 to +0.897/240.78091.00001.0000+0.27—
CDF-transformONDJ+0.04-0.93 to +1.1015/240.52771.00001.0000+3.13—
MVS with all-zero guard (variant)Oct+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
MVS with all-zero guard (variant)Nov+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
MVS with all-zero guard (variant)Dec+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
MVS with all-zero guard (variant)Jan+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
MVS with all-zero guard (variant)ONDJ+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
Screening statistics, RPS (no blend) (method minus Mean-Variance Scaling; negative favours the method)
MethodTargetΔ RPS (no blend) 1993–201695% intervalYears betterp (one-sided)Holm p (method)Holm p (all 60)Δ 2017–2024Screening
Linear ScalingOct+0.0109-0.0080 to +0.02899/240.86671.00001.0000-0.0219—
Linear ScalingNov+0.0043-0.0098 to +0.018310/240.71641.00001.0000+0.0150—
Linear ScalingDec+0.0056-0.0219 to +0.03189/240.65461.00001.0000-0.0096—
Linear ScalingJan-0.0315-0.1398 to +0.073110/240.29261.00001.0000-0.1296—
Linear ScalingONDJ+0.0048-0.0056 to +0.015612/240.80091.00001.0000+0.0033—
Variance Scaling (unbounded)Oct+0.0001-0.0013 to +0.00139/240.52940.93371.0000+0.0014—
Variance Scaling (unbounded)Nov-0.0006-0.0015 to +0.000313/240.10500.41991.0000-0.0013—
Variance Scaling (unbounded)Dec-0.0035-0.0087 to +0.001815/240.10940.41991.0000-0.0030—
Variance Scaling (unbounded)Jan-0.0168-0.0268 to -0.006616/240.00290.01430.1568-0.0356✓
Variance Scaling (unbounded)ONDJ-0.0001-0.0022 to +0.00198/240.46680.93371.0000+0.0005—
Square-root-space Mean-Variance ScalingOct-0.0015-0.0046 to +0.001512/240.17270.27181.0000-0.0028—
Square-root-space Mean-Variance ScalingNov-0.0071-0.0106 to -0.003919/240.00020.00090.0128-0.0077✓✓
Square-root-space Mean-Variance ScalingDec-0.0170-0.0313 to -0.003915/240.01210.03630.6531-0.0070✓
Square-root-space Mean-Variance ScalingJan-0.0890-0.1345 to -0.045918/240.00020.00080.0097-0.1581✓✓
Square-root-space Mean-Variance ScalingONDJ-0.0014-0.0037 to +0.001013/240.13590.27181.0000-0.0036—
Power TransformationOct+0.0022-0.0045 to +0.00869/240.73831.00001.0000+0.0020—
Power TransformationNov-0.0002-0.0047 to +0.004411/240.46971.00001.0000-0.0043—
Power TransformationDec-0.0086-0.0192 to +0.001314/240.06370.25461.0000-0.0106—
Power TransformationJan-0.0756-0.1179 to -0.035917/240.00040.00220.0254-0.1404✓✓
Power TransformationONDJ-0.0001-0.0080 to +0.008013/240.48711.00001.0000+0.0000—
Delta ChangeOct-0.0027-0.0215 to +0.015412/240.39061.00001.0000+0.0149—
Delta ChangeNov-0.0000-0.0222 to +0.021010/240.49791.00001.0000+0.0294—
Delta ChangeDec+0.0389+0.0008 to +0.07918/240.96611.00001.0000+0.0056—
Delta ChangeJan+0.0006-0.0759 to +0.07108/240.50581.00001.0000-0.1111—
Delta ChangeONDJ+0.0032-0.0143 to +0.020010/240.63661.00001.0000+0.0245—
Local Intensity ScalingOct+0.0088-0.0045 to +0.02159/240.89411.00001.0000-0.0110—
Local Intensity ScalingNov-0.0015-0.0125 to +0.009210/240.39791.00001.0000+0.0185—
Local Intensity ScalingDec+0.0185-0.0221 to +0.05699/240.80741.00001.0000-0.0057—
Local Intensity ScalingJan-0.0273-0.1362 to +0.079810/240.31911.00001.0000-0.1266—
Local Intensity ScalingONDJ+0.0050-0.0058 to +0.016212/240.80441.00001.0000+0.0033—
Empirical Quantile MappingOct+0.0065-0.0061 to +0.019212/240.83361.00001.0000+0.0226—
Empirical Quantile MappingNov-0.0007-0.0126 to +0.010611/240.45021.00001.0000+0.0080—
Empirical Quantile MappingDec-0.0011-0.0290 to +0.026510/240.47041.00001.0000-0.0160—
Empirical Quantile MappingJan-0.0920-0.1479 to -0.039316/240.00220.01090.1215-0.1762✓
Empirical Quantile MappingONDJ+0.0047-0.0048 to +0.014612/240.81961.00001.0000+0.0072—
Gamma Quantile MappingOct-0.0010-0.0071 to +0.004913/240.36970.73951.0000+0.0057—
Gamma Quantile MappingNov-0.0035-0.0107 to +0.003011/240.17150.68591.0000-0.0041—
Gamma Quantile MappingDec+0.0195+0.0047 to +0.03518/240.98940.98941.0000+0.0402—
Gamma Quantile MappingJan-0.0794-0.1078 to -0.052322/240.00000.00000.0000-0.1294✓✓
Gamma Quantile MappingONDJ-0.0014-0.0045 to +0.001713/240.19260.68591.0000-0.0049—
Detrended Quantile MappingOct+0.0050-0.0072 to +0.016912/240.78301.00001.0000+0.0171—
Detrended Quantile MappingNov+0.0060-0.0094 to +0.02149/240.76981.00001.0000+0.0271—
Detrended Quantile MappingDec+0.0548+0.0168 to +0.09176/240.99491.00001.0000+0.0172—
Detrended Quantile MappingJan-0.0011-0.0787 to +0.07058/240.48851.00001.0000-0.1118—
Detrended Quantile MappingONDJ+0.0113+0.0026 to +0.02049/240.98741.00001.0000+0.0187—
Quantile Delta MappingOct+0.0027-0.0099 to +0.015112/240.65961.00001.0000+0.0129—
Quantile Delta MappingNov+0.0109-0.0027 to +0.02427/240.93201.00001.0000+0.0231—
Quantile Delta MappingDec+0.0218-0.0128 to +0.05599/240.88121.00001.0000-0.0104—
Quantile Delta MappingJan-0.0632-0.1330 to +0.003812/240.04870.24341.0000-0.1719—
Quantile Delta MappingONDJ+0.0121+0.0034 to +0.02097/240.99311.00001.0000+0.0208—
Scaled Distribution MappingOct+0.0075-0.0090 to +0.024113/240.80351.00001.0000+0.0193—
Scaled Distribution MappingNov+0.0116-0.0137 to +0.03719/240.80781.00001.0000+0.0481—
Scaled Distribution MappingDec+0.0563-0.0121 to +0.12238/240.93861.00001.0000+0.0181—
Scaled Distribution MappingJan+0.0489-0.0850 to +0.18029/240.75431.00001.0000-0.0774—
Scaled Distribution MappingONDJ+0.0185+0.0070 to +0.03018/240.99731.00001.0000+0.0250—
CDF-transformOct+0.0078-0.0023 to +0.01798/240.92351.00001.0000+0.0110—
CDF-transformNov+0.0155+0.0032 to +0.02796/240.98831.00001.0000+0.0220—
CDF-transformDec+0.0786+0.0382 to +0.12167/240.99951.00001.0000+0.0325—
CDF-transformJan+0.0188-0.0635 to +0.09318/240.67451.00001.0000-0.1226—
CDF-transformONDJ+0.0110+0.0038 to +0.01836/240.99591.00001.0000+0.0165—
MVS with all-zero guard (variant)Oct+0.0000+0.0000 to +0.00000/241.00001.0000— (variant)+0.0000—
MVS with all-zero guard (variant)Nov+0.0000+0.0000 to +0.00000/241.00001.0000— (variant)+0.0000—
MVS with all-zero guard (variant)Dec+0.0000+0.0000 to +0.00000/241.00001.0000— (variant)+0.0000—
MVS with all-zero guard (variant)Jan+0.0000+0.0000 to +0.00000/241.00001.0000— (variant)+0.0000—
MVS with all-zero guard (variant)ONDJ+0.0000+0.0000 to +0.00000/241.00001.0000— (variant)+0.0000—

Diagnostics

How often limits, caps and fallbacks act
How often limits, caps and fallbacks act, leave-one-year-out 1993–2016 (mean over folds)
MethodTargetActivated (share of the corrected area, or of members / cells for events)
Linear ScalingDecmean fallback: 0.4% of the area
Linear ScalingJanmean fallback: 2.8% of the area
Mean-Variance Scaling (operational)Octratio lower limit: 0.9% of the area; ratio upper limit: 11.8% of the area; clipped at zero: 6.5%
Mean-Variance Scaling (operational)Novratio lower limit: 5.2% of the area; ratio upper limit: 9.4% of the area; clipped at zero: 8.0%
Mean-Variance Scaling (operational)Decsd fallback: 1.3% of the area; ratio lower limit: 17.3% of the area; ratio upper limit: 5.8% of the area; clipped at zero: 12.2%
Mean-Variance Scaling (operational)Jansd fallback: 3.9% of the area; ratio lower limit: 25.8% of the area; ratio upper limit: 28.2% of the area; clipped at zero: 4.5%
Mean-Variance Scaling (operational)ONDJratio lower limit: 2.2% of the area; ratio upper limit: 22.3% of the area; clipped at zero: 1.7%
Variance Scaling (unbounded)Octclipped at zero: 6.8%
Variance Scaling (unbounded)Novclipped at zero: 8.2%
Variance Scaling (unbounded)Decsd fallback: 1.3% of the area; clipped at zero: 8.9%
Variance Scaling (unbounded)Jansd fallback: 3.9% of the area; clipped at zero: 1.8%
Variance Scaling (unbounded)ONDJclipped at zero: 2.2%
Square-root-space Mean-Variance ScalingOctratio upper limit: 0.4% of the area; clipped at zero: 1.5%
Square-root-space Mean-Variance ScalingNovratio lower limit: 0.3% of the area; clipped at zero: 2.3%
Square-root-space Mean-Variance ScalingDecratio lower limit: 14.0% of the area; clipped at zero: 2.9%
Square-root-space Mean-Variance ScalingJanratio lower limit: 30.9% of the area; ratio upper limit: 0.3% of the area; clipped at zero: 1.0%
Square-root-space Mean-Variance ScalingONDJratio lower limit: 0.0% of the area; ratio upper limit: 1.8% of the area; clipped at zero: 0.0%
Power TransformationDecb at bound: 1.7% of the area
Power TransformationJanb at bound: 23.3% of the area
Delta ChangeDecmean fallback: 0.4% of the area; ratio capped: 0.1%
Delta ChangeJanmean fallback: 2.8% of the area; ratio capped: 1.1%
Local Intensity ScalingOctalways wet: 91.6% of the area
Local Intensity ScalingNovalways wet: 78.9% of the area
Local Intensity ScalingDecalways wet: 73.6% of the area; never wet: 2.9% of the area
Local Intensity ScalingJanalways wet: 80.2% of the area; never wet: 9.2% of the area
Local Intensity ScalingONDJalways wet: 100.0% of the area
Empirical Quantile MappingOctmodel has dry: 25.2% of the area; obs has dry: 8.4% of the area; extrapolated: 0.3%
Empirical Quantile MappingNovmodel has dry: 86.0% of the area; obs has dry: 21.1% of the area; extrapolated: 0.2%
Empirical Quantile MappingDecmodel has dry: 98.9% of the area; obs has dry: 26.4% of the area; extrapolated: 0.2%
Empirical Quantile MappingJanmodel has dry: 100.0% of the area; obs has dry: 19.8% of the area; extrapolated: 0.2%
Empirical Quantile MappingONDJmodel has dry: 1.6% of the area; extrapolated: 0.4%
Gamma Quantile MappingOctmodel has dry: 25.2% of the area; obs has dry: 8.4% of the area
Gamma Quantile MappingNovmodel has dry: 86.0% of the area; obs has dry: 21.1% of the area
Gamma Quantile MappingDecgamma fallback: 2.7% of the area; model has dry: 98.9% of the area; obs has dry: 26.4% of the area
Gamma Quantile MappingJangamma fallback: 4.5% of the area; model has dry: 100.0% of the area; obs has dry: 19.8% of the area
Gamma Quantile MappingONDJmodel has dry: 1.6% of the area
Detrended Quantile MappingOctmodel has dry: 25.2% of the area; obs has dry: 8.4% of the area; extrapolated: 0.2%
Detrended Quantile MappingNovmodel has dry: 86.0% of the area; obs has dry: 21.1% of the area; extrapolated: 0.1%
Detrended Quantile MappingDecmodel has dry: 98.9% of the area; obs has dry: 26.4% of the area; ratio capped: 0.1%; extrapolated: 0.1%
Detrended Quantile MappingJanmodel has dry: 100.0% of the area; obs has dry: 19.8% of the area; ratio capped: 1.1%; extrapolated: 0.1%
Detrended Quantile MappingONDJmodel has dry: 1.6% of the area; extrapolated: 0.2%
Quantile Delta MappingOctmodel has dry: 25.2% of the area; obs has dry: 8.4% of the area; low denominator: 0.6%; ratio capped: 0.0%
Quantile Delta MappingNovmodel has dry: 86.0% of the area; obs has dry: 21.1% of the area; low denominator: 7.9%; ratio capped: 0.3%
Quantile Delta MappingDecmodel has dry: 98.9% of the area; obs has dry: 26.4% of the area; low denominator: 31.5%; ratio capped: 0.4%
Quantile Delta MappingJanmodel has dry: 100.0% of the area; obs has dry: 19.8% of the area; low denominator: 54.4%; ratio capped: 0.2%
Quantile Delta MappingONDJmodel has dry: 1.6% of the area; ratio capped: 0.0%
Scaled Distribution MappingDecgamma fallback: 5.5% of the area; linear scaling fallback: 5.9%
Scaled Distribution MappingJangamma fallback: 13.7% of the area; linear scaling fallback: 23.4%
CDF-transformOctat forecast range edge: 13.9%
CDF-transformNovat forecast range edge: 7.1%
CDF-transformDecmean fallback: 0.4% of the area; at forecast range edge: 2.2%
CDF-transformJanmean fallback: 2.8% of the area; at forecast range edge: 0.6%
CDF-transformONDJat forecast range edge: 9.5%
MVS with all-zero guard (variant)Octratio lower limit: 0.9% of the area; ratio upper limit: 11.8% of the area; clipped at zero: 6.5%
MVS with all-zero guard (variant)Novratio lower limit: 5.2% of the area; ratio upper limit: 9.4% of the area; clipped at zero: 8.0%
MVS with all-zero guard (variant)Decsd fallback: 1.3% of the area; ratio lower limit: 17.3% of the area; ratio upper limit: 5.8% of the area; clipped at zero: 12.2%
MVS with all-zero guard (variant)Jansd fallback: 3.9% of the area; ratio lower limit: 25.8% of the area; ratio upper limit: 28.2% of the area; clipped at zero: 4.5%
MVS with all-zero guard (variant)ONDJratio lower limit: 2.2% of the area; ratio upper limit: 22.3% of the area; clipped at zero: 1.7%
Where the amount differences come from: cells grouped by their training-year climate

Each cell is grouped by its CHIRPS totals in the fold’s training years only: every year exactly 0 mm; every year ≤ 1 mm (not all 0); some years dry and some wet; never dry. Contributions are area-weighted CRPS differences from Mean-Variance Scaling (mm; negative favours the method) and add up to the national difference. Leave-one-year-out 1993–2016, All Ethiopia.

Oct: contributions to the CRPS difference from Mean-Variance Scaling (mm)
MethodTotal Δ CRPSall 0 mm
0.0% of area
all ≤ 1 mm
0.0% of area
mixed
8.4% of area
always wet
91.6% of area
Linear Scaling+0.415+0.000+0.000+0.034+0.381
Variance Scaling (unbounded)+0.067+0.000+0.000+0.000+0.067
Square-root-space Mean-Variance Scaling-0.227+0.000+0.000-0.014-0.213
Power Transformation-0.087+0.000+0.000+0.005-0.092
Delta Change-0.677+0.000+0.000-0.044-0.634
Local Intensity Scaling+0.417+0.000+0.000-0.010+0.427
Empirical Quantile Mapping+0.318+0.000+0.000+0.021+0.298
Gamma Quantile Mapping-0.263+0.000+0.000-0.010-0.253
Detrended Quantile Mapping-0.204+0.000+0.000-0.022-0.182
Quantile Delta Mapping-0.357+0.000+0.000-0.037-0.320
Scaled Distribution Mapping+0.001+0.000+0.000-0.023+0.024
CDF-transform-0.099+0.000+0.000-0.016-0.083
MVS with all-zero guard (variant)+0.000+0.000+0.000+0.000+0.000
Nov: contributions to the CRPS difference from Mean-Variance Scaling (mm)
MethodTotal Δ CRPSall 0 mm
0.0% of area
all ≤ 1 mm
0.0% of area
mixed
21.1% of area
always wet
78.9% of area
Linear Scaling+0.221+0.000+0.000+0.088+0.133
Variance Scaling (unbounded)+0.046+0.000+0.000+0.002+0.044
Square-root-space Mean-Variance Scaling-0.093+0.000+0.000-0.020-0.073
Power Transformation+0.047+0.000+0.000+0.026+0.021
Delta Change-0.016+0.000+0.000+0.061-0.077
Local Intensity Scaling+0.095+0.000+0.000-0.012+0.107
Empirical Quantile Mapping+0.186+0.000+0.000+0.039+0.146
Gamma Quantile Mapping-0.065+0.000+0.000-0.009-0.055
Detrended Quantile Mapping+0.182+0.000+0.000+0.069+0.113
Quantile Delta Mapping+0.154+0.000+0.000+0.062+0.091
Scaled Distribution Mapping+0.323+0.000+0.000+0.068+0.254
CDF-transform+0.228+0.000+0.000+0.069+0.159
MVS with all-zero guard (variant)+0.000+0.000+0.000+0.000+0.000
Dec: contributions to the CRPS difference from Mean-Variance Scaling (mm)
MethodTotal Δ CRPSall 0 mm
0.0% of area
all ≤ 1 mm
2.9% of area
mixed
23.6% of area
always wet
73.6% of area
Linear Scaling+0.266+0.000-0.001+0.002+0.264
Variance Scaling (unbounded)-0.022+0.000-0.001-0.004-0.017
Square-root-space Mean-Variance Scaling-0.065+0.000-0.001-0.014-0.051
Power Transformation+0.063+0.000-0.001-0.013+0.077
Delta Change+0.019+0.000-0.001-0.028+0.048
Local Intensity Scaling+0.136+0.000+0.001+0.005+0.130
Empirical Quantile Mapping-0.033+0.000+0.001+0.011-0.044
Gamma Quantile Mapping-0.015+0.000+0.001+0.010-0.026
Detrended Quantile Mapping+0.218+0.000+0.001+0.018+0.199
Quantile Delta Mapping+0.105+0.000+0.001+0.007+0.097
Scaled Distribution Mapping+0.360+0.000-0.001+0.006+0.354
CDF-transform+0.346+0.000-0.001-0.006+0.353
MVS with all-zero guard (variant)+0.000+0.000+0.000+0.000+0.000
Jan: contributions to the CRPS difference from Mean-Variance Scaling (mm)
MethodTotal Δ CRPSall 0 mm
0.0% of area
all ≤ 1 mm
9.2% of area
mixed
10.6% of area
always wet
80.2% of area
Linear Scaling+0.487+0.000+0.003+0.003+0.480
Variance Scaling (unbounded)-0.240+0.000-0.005-0.006-0.229
Square-root-space Mean-Variance Scaling-0.479+0.000-0.003-0.018-0.458
Power Transformation-0.134+0.000+0.001-0.004-0.131
Delta Change-0.005+0.000+0.001-0.006-0.001
Local Intensity Scaling+0.325+0.000+0.010+0.011+0.303
Empirical Quantile Mapping-0.337+0.000+0.010+0.011-0.359
Gamma Quantile Mapping-0.365+0.000+0.010+0.003-0.378
Detrended Quantile Mapping+0.100+0.000+0.010+0.011+0.079
Quantile Delta Mapping-0.121+0.000+0.010+0.012-0.144
Scaled Distribution Mapping+0.977+0.000+0.003+0.027+0.947
CDF-transform+0.350+0.000+0.004+0.003+0.343
MVS with all-zero guard (variant)+0.000+0.000+0.000+0.000+0.000
ONDJ: contributions to the CRPS difference from Mean-Variance Scaling (mm)
MethodTotal Δ CRPSall 0 mm
0.0% of area
all ≤ 1 mm
0.0% of area
mixed
0.0% of area
always wet
100.0% of area
Linear Scaling-0.012+0.000+0.000+0.000-0.012
Variance Scaling (unbounded)+0.336+0.000+0.000+0.000+0.336
Square-root-space Mean-Variance Scaling-0.432+0.000+0.000+0.000-0.432
Power Transformation-0.028+0.000+0.000+0.000-0.028
Delta Change-1.044+0.000+0.000+0.000-1.044
Local Intensity Scaling+0.014+0.000+0.000+0.000+0.014
Empirical Quantile Mapping+0.779+0.000+0.000+0.000+0.779
Gamma Quantile Mapping-0.524+0.000+0.000+0.000-0.524
Detrended Quantile Mapping-0.086+0.000+0.000+0.000-0.086
Quantile Delta Mapping-0.218+0.000+0.000+0.000-0.218
Scaled Distribution Mapping+0.402+0.000+0.000+0.000+0.402
CDF-transform-0.179+0.000+0.000+0.000-0.179
MVS with all-zero guard (variant)+0.000+0.000+0.000+0.000+0.000

← Data and methodsConfirmation →