Screening · Bias correction · May initialization · JJAS and its months

Screening · May initialization · JJAS and its months

✓ = screening pass within the method (Holm across its targets); ✓✓ = also passes with Holm across all methods and targets (national aggregate only). A pass is screening evidence, not an adoption decision. Bold: the operational method. Skill is against the CHIRPS training climatology (0 = no better than climatology).

Region for the result tables

All Ethiopia (national aggregate)

JJAS season at a glance — All Ethiopia
MethodAmount CRPSS 1993–2016Amount CRPSS 2017–2025Tercile RPSS (no blend) 1993–2016Tercile RPSS (no blend) 2017–2025Mean bias (mm)MAE (mm)CorrelationSpread–errorReliability indexMembers ≤ 1 mm
Raw ECMWF (no correction)-1.311-1.266-0.511-0.412+8.8134.50.180.390.660.0%
Linear Scaling-0.059-0.082-0.027-0.004+0.167.30.080.870.090.0%
Mean-Variance Scaling (operational)-0.028-0.018-0.017+0.003-0.066.20.080.830.090.5%
Variance Scaling (unbounded)-0.027-0.016-0.016+0.005-0.066.10.070.830.110.2%
Square-root-space Mean-Variance Scaling-0.025 ✓-0.014-0.017+0.004-0.066.00.080.820.120.0%
Power Transformation-0.027-0.016-0.017-0.000-0.066.10.070.830.120.0%
Delta Change-0.030-0.058-0.015-0.034+0.167.30.080.980.050.0%
Local Intensity Scaling-0.059-0.081-0.028-0.003+0.167.30.080.870.100.0%
Empirical Quantile Mapping-0.040-0.032-0.024-0.008+0.165.80.060.830.140.0%
Gamma Quantile Mapping-0.025-0.012-0.019+0.003-0.166.00.070.820.150.0%
Detrended Quantile Mapping-0.056-0.078-0.044-0.055-0.767.30.080.830.170.0%
Quantile Delta Mapping-0.062-0.097-0.062-0.062+1.267.60.080.840.210.0%
Scaled Distribution Mapping-0.078-0.110-0.080-0.079-4.267.40.090.810.320.7%
CDF-transform-0.061-0.081-0.061-0.059-0.167.40.080.780.210.0%
MVS with all-zero guard (variant)-0.028-0.018-0.017+0.003-0.066.20.080.830.090.5%
Amount skill (CRPSS) by target, leave-one-year-out 1993–2016
MethodJunJulAugSepJJAS
Raw ECMWF (no correction)-0.788-0.613-0.764-0.816-1.311
Linear Scaling-0.121-0.029-0.064-0.090-0.059
Mean-Variance Scaling (operational)-0.096-0.007-0.028-0.060-0.028
Variance Scaling (unbounded)-0.093-0.000 ✓✓-0.021 ✓✓-0.058 ✓-0.027
Square-root-space Mean-Variance Scaling-0.088 ✓-0.003 ✓-0.023 ✓✓-0.057 ✓-0.025 ✓
Power Transformation-0.091-0.001 ✓-0.022 ✓✓-0.060-0.027
Delta Change-0.105+0.001-0.043-0.067-0.030
Local Intensity Scaling-0.118-0.028-0.061-0.087-0.059
Empirical Quantile Mapping-0.100-0.017-0.035-0.067-0.040
Gamma Quantile Mapping-0.088 ✓-0.006-0.021 ✓✓-0.056 ✓-0.025
Detrended Quantile Mapping-0.134-0.026-0.064-0.090-0.056
Quantile Delta Mapping-0.145-0.025-0.071-0.098-0.062
Scaled Distribution Mapping-0.162-0.037-0.084-0.107-0.078
CDF-transform-0.138-0.026-0.065-0.098-0.061
MVS with all-zero guard (variant)-0.096-0.007-0.028-0.060-0.028
Tercile skill (RPSS of smoothed counts, no blend) by target, 1993–2016
MethodJunJulAugSepJJAS
Raw ECMWF (no correction)-0.450-0.394-0.405-0.383-0.511
Linear Scaling-0.118-0.046-0.040-0.072-0.027
Mean-Variance Scaling (operational)-0.113-0.029-0.031-0.064-0.017
Variance Scaling (unbounded)-0.109-0.024-0.026-0.058-0.016
Square-root-space Mean-Variance Scaling-0.101 ✓-0.026-0.027-0.058-0.017
Power Transformation-0.100 ✓-0.026-0.027-0.058-0.017
Delta Change-0.155-0.042-0.062-0.099-0.015
Local Intensity Scaling-0.127-0.045-0.039-0.072-0.028
Empirical Quantile Mapping-0.098-0.035-0.032-0.057-0.024
Gamma Quantile Mapping-0.108-0.027-0.026-0.057-0.019
Detrended Quantile Mapping-0.185-0.071-0.086-0.122-0.044
Quantile Delta Mapping-0.176-0.075-0.090-0.123-0.062
Scaled Distribution Mapping-0.213-0.091-0.114-0.144-0.080
CDF-transform-0.193-0.077-0.093-0.140-0.061
MVS with all-zero guard (variant)-0.113-0.029-0.031-0.064-0.017
More scores by target: test years, fair CRPS, bias, correlation, spread, reliability, coverage
Amount skill (CRPSS), fit 1993–2016, scored 2017–2025
MethodJunJulAugSepJJAS
Raw ECMWF (no correction)-0.550-0.566-0.610-0.641-1.266
Linear Scaling-0.065-0.035+0.019-0.086-0.082
Mean-Variance Scaling (operational)-0.030-0.000+0.055-0.034-0.018
Variance Scaling (unbounded)-0.026+0.006+0.059-0.031-0.016
Square-root-space Mean-Variance Scaling-0.021+0.003+0.058-0.031-0.014
Power Transformation-0.021+0.004+0.055-0.029-0.016
Delta Change-0.057-0.009+0.055-0.067-0.058
Local Intensity Scaling-0.063-0.034+0.020-0.083-0.081
Empirical Quantile Mapping-0.030-0.003+0.052-0.040-0.032
Gamma Quantile Mapping-0.021-0.001+0.057-0.029-0.012
Detrended Quantile Mapping-0.076-0.033+0.042-0.070-0.078
Quantile Delta Mapping-0.091-0.046+0.030-0.071-0.097
Scaled Distribution Mapping-0.102-0.057+0.021-0.079-0.110
CDF-transform-0.089-0.034+0.036-0.076-0.081
MVS with all-zero guard (variant)-0.030-0.000+0.055-0.034-0.018
Amount skill with the fair CRPS (diagnostic), 1993–2016
MethodJunJulAugSepJJAS
Raw ECMWF (no correction)-0.831-0.650-0.802-0.855-1.379
Linear Scaling-0.131-0.040-0.070-0.096-0.070
Mean-Variance Scaling (operational)-0.109-0.014-0.035-0.069-0.039
Variance Scaling (unbounded)-0.106-0.008 ✓✓-0.029 ✓✓-0.068 ✓-0.038
Square-root-space Mean-Variance Scaling-0.101 ✓-0.010 ✓-0.030 ✓✓-0.066 ✓-0.037 ✓
Power Transformation-0.104-0.008 ✓-0.029-0.069-0.038
Delta Change-0.109+0.001 ✓-0.045-0.069-0.031
Local Intensity Scaling-0.129-0.040-0.068-0.094-0.070
Empirical Quantile Mapping-0.114-0.025-0.044-0.077-0.052
Gamma Quantile Mapping-0.101 ✓-0.012-0.029 ✓✓-0.066 ✓-0.037
Detrended Quantile Mapping-0.148-0.034-0.074-0.100-0.068
Quantile Delta Mapping-0.160-0.033-0.080-0.108-0.074
Scaled Distribution Mapping-0.183-0.048-0.098-0.122-0.095
CDF-transform-0.154-0.037-0.076-0.110-0.075
MVS with all-zero guard (variant)-0.109-0.014-0.035-0.069-0.039
Tercile skill (RPSS, no blend), fit 1993–2016, scored 2017–2025
MethodJunJulAugSepJJAS
Raw ECMWF (no correction)-0.327-0.305-0.345-0.326-0.412
Linear Scaling-0.025+0.007+0.060-0.065-0.004
Mean-Variance Scaling (operational)-0.056+0.022+0.066-0.041+0.003
Variance Scaling (unbounded)-0.049+0.026+0.071-0.036+0.005
Square-root-space Mean-Variance Scaling-0.032+0.022+0.065-0.034+0.004
Power Transformation-0.033+0.018+0.061-0.029-0.000
Delta Change-0.088+0.022+0.034-0.086-0.034
Local Intensity Scaling-0.032+0.005+0.060-0.063-0.003
Empirical Quantile Mapping-0.022+0.015+0.068-0.039-0.008
Gamma Quantile Mapping-0.042+0.017+0.064-0.030+0.003
Detrended Quantile Mapping-0.106-0.015+0.017-0.099-0.055
Quantile Delta Mapping-0.083-0.028+0.006-0.097-0.062
Scaled Distribution Mapping-0.095-0.042-0.005-0.118-0.079
CDF-transform-0.129-0.017+0.009-0.101-0.059
MVS with all-zero guard (variant)-0.056+0.022+0.066-0.041+0.003
Ensemble-mean bias (mm), 1993–2016
MethodJunJulAugSepJJAS
Raw ECMWF (no correction)-0.4-0.3+1.1+8.4+8.8
Linear Scaling+0.1+0.1+0.1+0.1+0.1
Mean-Variance Scaling (operational)+0.1+0.3+0.1+0.1-0.0
Variance Scaling (unbounded)+0.1+0.1+0.0+0.0-0.0
Square-root-space Mean-Variance Scaling+0.0+0.1+0.1+0.1-0.0
Power Transformation+0.0+0.1+0.0+0.0-0.0
Delta Change+0.1+0.1+0.1+0.1+0.1
Local Intensity Scaling+0.1+0.0+0.0+0.1+0.1
Empirical Quantile Mapping+0.1+0.0+0.0+0.0+0.1
Gamma Quantile Mapping+0.0+0.1+0.0+0.0-0.1
Detrended Quantile Mapping+0.0+0.2+0.0+0.1-0.7
Quantile Delta Mapping+0.8+0.4+0.6+0.7+1.2
Scaled Distribution Mapping-1.3-3.4-1.9-1.8-4.2
CDF-transform+0.2+0.3+0.2+0.2-0.1
MVS with all-zero guard (variant)+0.1+0.3+0.1+0.1-0.0
Correlation of the ensemble mean with CHIRPS over years, 1993–2016
MethodJunJulAugSepJJAS
Raw ECMWF (no correction)+0.06+0.16+0.10+0.05+0.18
Linear Scaling-0.03+0.04-0.00-0.05+0.08
Mean-Variance Scaling (operational)-0.04+0.07+0.01-0.06+0.08
Variance Scaling (unbounded)-0.04+0.03-0.02-0.07+0.07
Square-root-space Mean-Variance Scaling-0.04+0.06+0.00-0.06+0.08
Power Transformation-0.04+0.04-0.02-0.06+0.07
Delta Change-0.03+0.04-0.00-0.05+0.08
Local Intensity Scaling-0.04+0.04-0.01-0.06+0.08
Empirical Quantile Mapping-0.05+0.04-0.02-0.07+0.06
Gamma Quantile Mapping-0.05+0.04-0.02-0.07+0.07
Detrended Quantile Mapping-0.03+0.04-0.00-0.06+0.08
Quantile Delta Mapping-0.03+0.03-0.01-0.05+0.08
Scaled Distribution Mapping-0.03+0.05-0.01-0.05+0.09
CDF-transform-0.02+0.04+0.00-0.05+0.08
MVS with all-zero guard (variant)-0.04+0.07+0.01-0.06+0.08
Spread–error ratio, 1993–2016 (1 = spread matches the error)
MethodJunJulAugSepJJAS
Raw ECMWF (no correction)0.540.530.560.570.39
Linear Scaling0.920.850.991.000.87
Mean-Variance Scaling (operational)0.820.920.930.890.83
Variance Scaling (unbounded)0.820.930.930.890.83
Square-root-space Mean-Variance Scaling0.810.930.930.880.82
Power Transformation0.820.940.930.890.83
Delta Change0.931.020.980.950.98
Local Intensity Scaling0.910.850.980.990.87
Empirical Quantile Mapping0.820.930.920.890.83
Gamma Quantile Mapping0.800.970.930.880.82
Detrended Quantile Mapping0.810.920.910.880.83
Quantile Delta Mapping0.810.960.920.900.84
Scaled Distribution Mapping0.710.930.850.810.81
CDF-transform0.790.830.870.860.78
MVS with all-zero guard (variant)0.820.920.930.890.83
Rank-histogram reliability index, 1993–2016 (0 = flat)
MethodJunJulAugSepJJAS
Raw ECMWF (no correction)0.520.610.470.350.66
Linear Scaling0.080.140.150.120.09
Mean-Variance Scaling (operational)0.200.160.120.090.09
Variance Scaling (unbounded)0.200.090.070.100.11
Square-root-space Mean-Variance Scaling0.180.100.080.070.12
Power Transformation0.140.070.090.080.12
Delta Change0.180.200.210.120.05
Local Intensity Scaling0.100.230.130.110.10
Empirical Quantile Mapping0.180.230.160.110.14
Gamma Quantile Mapping0.190.120.090.090.15
Detrended Quantile Mapping0.280.320.300.190.17
Quantile Delta Mapping0.240.300.250.170.21
Scaled Distribution Mapping0.350.290.320.290.32
CDF-transform0.310.320.320.210.21
MVS with all-zero guard (variant)0.200.160.120.090.09
Score coverage, mean per year, 1993–2016 (share of the region’s area)
TargetAmount cellsAmount areaProbability cellsProbability area
Jun1484100%1479100%
Jul1484100%122182%
Aug1484100%127386%
Sep1484100%1484100%
JJAS1484100%1484100%
Dry months: shares of totals at exactly 0 mm and at ≤ 1 mm, CHIRPS and corrected
Area-weighted mean share over cells, pooled leave-one-year-out 1993–2025
Exactly 0 mm≤ 1 mm
Jun: CHIRPS0.1%1.4%
Raw ECMWF (no correction)0.0%4.7%
Linear Scaling0.0%3.2%
Mean-Variance Scaling (operational)1.7%3.2%
Variance Scaling (unbounded)1.3%2.5%
Square-root-space Mean-Variance Scaling0.0%1.8%
Power Transformation0.0%2.4%
Delta Change0.1%1.9%
Local Intensity Scaling1.5%1.5%
Empirical Quantile Mapping1.5%1.5%
Gamma Quantile Mapping1.5%2.5%
Detrended Quantile Mapping1.3%1.8%
Quantile Delta Mapping1.5%1.8%
Scaled Distribution Mapping6.4%6.6%
CDF-transform0.0%1.6%
MVS with all-zero guard (variant)1.7%3.2%
Jul: CHIRPS0.0%9.1%
Raw ECMWF (no correction)0.0%1.1%
Linear Scaling0.0%11.3%
Mean-Variance Scaling (operational)9.9%12.3%
Variance Scaling (unbounded)1.3%9.3%
Square-root-space Mean-Variance Scaling2.0%9.5%
Power Transformation0.0%9.5%
Delta Change0.0%9.6%
Local Intensity Scaling9.1%9.1%
Empirical Quantile Mapping9.1%9.1%
Gamma Quantile Mapping6.9%9.5%
Detrended Quantile Mapping9.1%10.1%
Quantile Delta Mapping9.1%10.2%
Scaled Distribution Mapping5.5%11.1%
CDF-transform0.0%9.5%
MVS with all-zero guard (variant)9.9%12.3%
Aug: CHIRPS0.0%4.4%
Raw ECMWF (no correction)0.0%1.6%
Linear Scaling0.0%7.4%
Mean-Variance Scaling (operational)5.9%8.5%
Variance Scaling (unbounded)0.4%4.9%
Square-root-space Mean-Variance Scaling0.4%5.4%
Power Transformation0.0%5.0%
Delta Change0.0%4.8%
Local Intensity Scaling4.4%4.4%
Empirical Quantile Mapping4.4%4.4%
Gamma Quantile Mapping1.7%4.7%
Detrended Quantile Mapping4.4%5.2%
Quantile Delta Mapping4.3%5.2%
Scaled Distribution Mapping3.0%6.3%
CDF-transform0.0%4.7%
MVS with all-zero guard (variant)5.9%8.5%
Sep: CHIRPS0.1%0.2%
Raw ECMWF (no correction)0.0%0.6%
Linear Scaling0.0%1.2%
Mean-Variance Scaling (operational)1.1%1.7%
Variance Scaling (unbounded)0.5%0.8%
Square-root-space Mean-Variance Scaling0.0%0.4%
Power Transformation0.0%0.8%
Delta Change0.1%0.3%
Local Intensity Scaling0.2%0.2%
Empirical Quantile Mapping0.2%0.2%
Gamma Quantile Mapping0.2%0.5%
Detrended Quantile Mapping0.2%0.3%
Quantile Delta Mapping0.3%0.3%
Scaled Distribution Mapping1.8%1.8%
CDF-transform0.0%0.1%
MVS with all-zero guard (variant)1.1%1.7%
JJAS: CHIRPS0.0%0.0%
Raw ECMWF (no correction)0.0%0.0%
Linear Scaling0.0%0.0%
Mean-Variance Scaling (operational)0.3%0.5%
Variance Scaling (unbounded)0.1%0.2%
Square-root-space Mean-Variance Scaling0.0%0.0%
Power Transformation0.0%0.0%
Delta Change0.0%0.0%
Local Intensity Scaling0.0%0.0%
Empirical Quantile Mapping0.0%0.0%
Gamma Quantile Mapping0.0%0.0%
Detrended Quantile Mapping0.0%0.0%
Quantile Delta Mapping0.0%0.0%
Scaled Distribution Mapping1.0%1.0%
CDF-transform0.0%0.0%
MVS with all-zero guard (variant)0.3%0.5%
Distribution of the corrected members (mean, spread, 10th and 90th percentiles)
Mean of the corrected members / CHIRPS (area-weighted median of cell ratios, 1993–2025; 1 = same)
MethodJunJulAugSepJJAS
Raw ECMWF (no correction)0.921.161.121.031.07
Linear Scaling1.001.001.001.001.00
Mean-Variance Scaling (operational)1.001.001.001.001.00
Variance Scaling (unbounded)1.001.001.001.001.00
Square-root-space Mean-Variance Scaling1.001.001.001.001.00
Power Transformation1.001.001.001.001.00
Delta Change1.001.001.001.001.00
Local Intensity Scaling1.001.001.001.001.00
Empirical Quantile Mapping1.001.001.001.001.00
Gamma Quantile Mapping1.001.001.001.001.00
Detrended Quantile Mapping1.001.001.001.001.00
Quantile Delta Mapping1.011.001.001.011.00
Scaled Distribution Mapping0.970.980.980.980.98
CDF-transform1.001.001.001.011.00
MVS with all-zero guard (variant)1.001.001.001.001.00
Standard deviation of the corrected members / CHIRPS (area-weighted median of cell ratios, 1993–2025; 1 = same)
MethodJunJulAugSepJJAS
Raw ECMWF (no correction)0.961.131.141.161.10
Linear Scaling1.111.041.161.251.15
Mean-Variance Scaling (operational)1.011.011.011.011.01
Variance Scaling (unbounded)1.011.001.001.011.01
Square-root-space Mean-Variance Scaling0.991.031.011.001.00
Power Transformation1.011.001.001.011.01
Delta Change1.141.111.111.121.12
Local Intensity Scaling1.091.001.081.231.13
Empirical Quantile Mapping1.001.001.001.001.00
Gamma Quantile Mapping0.981.010.990.981.00
Detrended Quantile Mapping1.041.011.021.051.04
Quantile Delta Mapping1.061.041.051.081.06
Scaled Distribution Mapping0.941.011.010.971.02
CDF-transform1.051.011.051.091.07
MVS with all-zero guard (variant)1.011.011.011.011.01
10th percentile of the corrected members / CHIRPS (area-weighted median of cell ratios, 1993–2025; 1 = same)
MethodJunJulAugSepJJAS
Raw ECMWF (no correction)0.731.060.960.750.97
Linear Scaling0.790.890.830.800.92
Mean-Variance Scaling (operational)0.970.950.960.980.98
Variance Scaling (unbounded)0.970.970.970.990.98
Square-root-space Mean-Variance Scaling0.960.950.960.970.98
Power Transformation0.930.950.950.960.98
Delta Change0.860.910.910.910.94
Local Intensity Scaling0.840.910.890.800.92
Empirical Quantile Mapping0.980.980.990.980.99
Gamma Quantile Mapping0.950.950.960.960.98
Detrended Quantile Mapping0.910.950.940.950.96
Quantile Delta Mapping0.930.940.950.940.97
Scaled Distribution Mapping0.910.940.950.940.97
CDF-transform0.920.950.930.940.96
MVS with all-zero guard (variant)0.970.950.960.980.98
90th percentile of the corrected members / CHIRPS (area-weighted median of cell ratios, 1993–2025; 1 = same)
MethodJunJulAugSepJJAS
Raw ECMWF (no correction)0.991.161.131.111.09
Linear Scaling1.081.051.061.101.04
Mean-Variance Scaling (operational)1.011.031.021.021.01
Variance Scaling (unbounded)1.011.021.021.011.01
Square-root-space Mean-Variance Scaling1.021.031.021.021.01
Power Transformation1.021.021.021.021.01
Delta Change1.071.051.041.051.04
Local Intensity Scaling1.071.011.031.101.04
Empirical Quantile Mapping1.031.021.021.021.01
Gamma Quantile Mapping1.011.021.021.021.01
Detrended Quantile Mapping1.041.021.021.031.02
Quantile Delta Mapping1.041.021.021.041.02
Scaled Distribution Mapping0.980.990.990.990.99
CDF-transform1.041.021.031.041.02
MVS with all-zero guard (variant)1.011.031.021.021.01

Screening statistics

Every method, target and score (within-method and family-wide Holm)

Screening rule (docs/36 rule applied as a screen): a method passes for a target and score if, on the leave-one-year-out 1993-2016 per-year scores, its mean improvement over mvs has a one-sided sign-flip p-value below 0.05 after Holm adjustment, and its mean score over 2017-2025 (fits on 1993-2016) is not worse. 'screen_pass': Holm across the 5 targets of one method. 'screen_pass_family': Holm across every method and target of the benchmark for that score. A screening pass is not an operational adoption decision (see the confirmation run).

Screening statistics, CRPS (method minus Mean-Variance Scaling; negative favours the method)
MethodTargetΔ CRPS 1993–2016 (mm)95% intervalYears betterp (one-sided)Holm p (method)Holm p (all 60)Δ 2017–2025Screening
Linear ScalingJun+0.42+0.20 to +0.655/240.99931.00001.0000+0.67—
Linear ScalingJul+0.50+0.19 to +0.829/240.99651.00001.0000+0.77—
Linear ScalingAug+0.71+0.44 to +1.024/241.00001.00001.0000+0.80—
Linear ScalingSep+0.55+0.38 to +0.714/241.00001.00001.0000+1.04—
Linear ScalingJJAS+1.48+0.68 to +2.326/240.99931.00001.0000+2.90—
Variance Scaling (unbounded)Jun-0.04-0.08 to +0.0012/240.04730.09461.0000-0.07—
Variance Scaling (unbounded)Jul-0.14-0.17 to -0.1023/240.00000.00000.0000-0.14✓✓
Variance Scaling (unbounded)Aug-0.13-0.15 to -0.1124/240.00000.00000.0000-0.08✓✓
Variance Scaling (unbounded)Sep-0.03-0.05 to -0.0119/240.00300.00900.1557-0.05✓
Variance Scaling (unbounded)JJAS-0.04-0.08 to +0.0119/240.05310.09461.0000-0.09—
Square-root-space Mean-Variance ScalingJun-0.13-0.21 to -0.0418/240.00300.00900.1557-0.16✓
Square-root-space Mean-Variance ScalingJul-0.08-0.13 to -0.0217/240.00700.01390.3478-0.08✓
Square-root-space Mean-Variance ScalingAug-0.10-0.13 to -0.0722/240.00000.00000.0000-0.06✓✓
Square-root-space Mean-Variance ScalingSep-0.06-0.09 to -0.0318/240.00110.00450.0610-0.05✓
Square-root-space Mean-Variance ScalingJJAS-0.11-0.20 to -0.0216/240.01110.01390.5330-0.18✓
Power TransformationJun-0.07-0.14 to +0.0117/240.04200.12611.0000-0.17—
Power TransformationJul-0.12-0.19 to -0.0620/240.00090.00380.0517-0.09✓
Power TransformationAug-0.12-0.18 to -0.0720/240.00000.00020.0017-0.01✓✓
Power TransformationSep-0.01-0.07 to +0.0412/240.35960.58451.0000-0.10—
Power TransformationJJAS-0.02-0.11 to +0.0613/240.29230.58451.0000-0.07—
Delta ChangeJun+0.15-0.18 to +0.5213/240.78371.00001.0000+0.52—
Delta ChangeJul-0.16-0.40 to +0.0615/240.10760.53781.0000+0.19—
Delta ChangeAug+0.31+0.04 to +0.609/240.97721.00001.0000+0.01—
Delta ChangeSep+0.12-0.13 to +0.368/240.80971.00001.0000+0.66—
Delta ChangeJJAS+0.11-0.91 to +1.1512/240.57811.00001.0000+1.82—
Local Intensity ScalingJun+0.37+0.15 to +0.595/240.99821.00001.0000+0.63—
Local Intensity ScalingJul+0.48+0.18 to +0.819/240.99601.00001.0000+0.76—
Local Intensity ScalingAug+0.67+0.40 to +0.964/241.00001.00001.0000+0.78—
Local Intensity ScalingSep+0.49+0.34 to +0.654/241.00001.00001.0000+0.97—
Local Intensity ScalingJJAS+1.45+0.66 to +2.286/240.99931.00001.0000+2.86—
Empirical Quantile MappingJun+0.08-0.01 to +0.189/240.94071.00001.0000+0.01—
Empirical Quantile MappingJul+0.23+0.12 to +0.345/240.99971.00001.0000+0.06—
Empirical Quantile MappingAug+0.15+0.08 to +0.234/240.99981.00001.0000+0.07—
Empirical Quantile MappingSep+0.12+0.06 to +0.185/240.99991.00001.0000+0.13—
Empirical Quantile MappingJJAS+0.59+0.19 to +0.945/240.99691.00001.0000+0.64—
Gamma Quantile MappingJun-0.13-0.23 to -0.0318/240.00980.02930.4787-0.16✓
Gamma Quantile MappingJul-0.01-0.11 to +0.0911/240.43900.43901.0000+0.00—
Gamma Quantile MappingAug-0.13-0.17 to -0.0922/240.00000.00000.0003-0.05✓✓
Gamma Quantile MappingSep-0.07-0.11 to -0.0319/240.00180.00710.0941-0.09✓
Gamma Quantile MappingJJAS-0.12-0.25 to +0.0216/240.05180.10371.0000-0.25—
Detrended Quantile MappingJun+0.63+0.31 to +1.036/241.00001.00001.0000+0.89—
Detrended Quantile MappingJul+0.42+0.14 to +0.736/240.99671.00001.0000+0.73—
Detrended Quantile MappingAug+0.72+0.42 to +1.064/241.00001.00001.0000+0.30—
Detrended Quantile MappingSep+0.54+0.34 to +0.782/241.00001.00001.0000+0.71—
Detrended Quantile MappingJJAS+1.33+0.39 to +2.376/240.99231.00001.0000+2.74—
Quantile Delta MappingJun+0.82+0.40 to +1.344/241.00001.00001.0000+1.17—
Quantile Delta MappingJul+0.42+0.07 to +0.846/240.98561.00001.0000+1.03—
Quantile Delta MappingAug+0.86+0.48 to +1.322/241.00001.00001.0000+0.57—
Quantile Delta MappingSep+0.68+0.43 to +0.982/241.00001.00001.0000+0.73—
Quantile Delta MappingJJAS+1.62+0.57 to +2.885/240.99761.00001.0000+3.61—
Scaled Distribution MappingJun+1.11+0.64 to +1.643/241.00001.00001.0000+1.37—
Scaled Distribution MappingJul+0.67+0.30 to +1.105/240.99961.00001.0000+1.26—
Scaled Distribution MappingAug+1.13+0.69 to +1.622/241.00001.00001.0000+0.76—
Scaled Distribution MappingSep+0.86+0.57 to +1.201/241.00001.00001.0000+0.89—
Scaled Distribution MappingJJAS+2.39+1.35 to +3.613/241.00001.00001.0000+4.19—
CDF-transformJun+0.70+0.32 to +1.176/240.99981.00001.0000+1.14—
CDF-transformJul+0.42+0.12 to +0.767/240.99331.00001.0000+0.76—
CDF-transformAug+0.73+0.41 to +1.104/241.00001.00001.0000+0.43—
CDF-transformSep+0.69+0.45 to +0.991/241.00001.00001.0000+0.83—
CDF-transformJJAS+1.56+0.57 to +2.696/240.99791.00001.0000+2.86—
MVS with all-zero guard (variant)Jun+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
MVS with all-zero guard (variant)Jul+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
MVS with all-zero guard (variant)Aug+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
MVS with all-zero guard (variant)Sep+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
MVS with all-zero guard (variant)JJAS+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
Screening statistics, fair CRPS (method minus Mean-Variance Scaling; negative favours the method)
MethodTargetΔ fair CRPS 1993–2016 (mm)95% intervalYears betterp (one-sided)Holm p (method)Holm p (all 60)Δ 2017–2025Screening
Linear ScalingJun+0.36+0.14 to +0.596/240.99711.00001.0000+0.63—
Linear ScalingJul+0.57+0.26 to +0.907/240.99881.00001.0000+0.81—
Linear ScalingAug+0.68+0.40 to +0.994/241.00001.00001.0000+0.78—
Linear ScalingSep+0.47+0.31 to +0.644/241.00001.00001.0000+1.00—
Linear ScalingJJAS+1.43+0.62 to +2.276/240.99901.00001.0000+2.87—
Variance Scaling (unbounded)Jun-0.04-0.08 to -0.0012/240.03140.06271.0000-0.08—
Variance Scaling (unbounded)Jul-0.13-0.17 to -0.0922/240.00000.00000.0000-0.13✓✓
Variance Scaling (unbounded)Aug-0.12-0.14 to -0.0924/240.00000.00000.0000-0.08✓✓
Variance Scaling (unbounded)Sep-0.03-0.04 to -0.0018/240.01340.04030.6454-0.05✓
Variance Scaling (unbounded)JJAS-0.03-0.07 to +0.0216/240.13400.13401.0000-0.08—
Square-root-space Mean-Variance ScalingJun-0.13-0.21 to -0.0418/240.00310.00940.1654-0.16✓
Square-root-space Mean-Variance ScalingJul-0.08-0.14 to -0.0318/240.00490.00990.2514-0.08✓
Square-root-space Mean-Variance ScalingAug-0.09-0.12 to -0.0622/240.00000.00000.0000-0.06✓✓
Square-root-space Mean-Variance ScalingSep-0.06-0.09 to -0.0218/240.00140.00560.0756-0.05✓
Square-root-space Mean-Variance ScalingJJAS-0.09-0.17 to +0.0016/240.03620.03621.0000-0.16✓
Power TransformationJun-0.08-0.15 to +0.0018/240.02640.07911.0000-0.18—
Power TransformationJul-0.12-0.19 to -0.0520/240.00140.00540.0748-0.08✓
Power TransformationAug-0.11-0.17 to -0.0620/240.00030.00130.0146+0.00—
Power TransformationSep-0.01-0.07 to +0.0412/240.33280.66571.0000-0.10—
Power TransformationJJAS-0.02-0.10 to +0.0713/240.36810.66571.0000-0.06—
Delta ChangeJun+0.00-0.34 to +0.3813/240.50301.00001.0000+0.14—
Delta ChangeJul-0.31-0.56 to -0.0816/240.00770.03870.3875-0.35✓
Delta ChangeAug+0.19-0.08 to +0.5012/240.86781.00001.0000-0.47—
Delta ChangeSep+0.00-0.26 to +0.2613/240.50211.00001.0000+0.24—
Delta ChangeJJAS-0.33-1.36 to +0.7515/240.28281.00001.0000+0.62—
Local Intensity ScalingJun+0.31+0.10 to +0.546/240.99371.00001.0000+0.59—
Local Intensity ScalingJul+0.56+0.26 to +0.887/240.99871.00001.0000+0.79—
Local Intensity ScalingAug+0.64+0.37 to +0.944/241.00001.00001.0000+0.76—
Local Intensity ScalingSep+0.43+0.27 to +0.594/241.00001.00001.0000+0.94—
Local Intensity ScalingJJAS+1.40+0.61 to +2.246/240.99891.00001.0000+2.83—
Empirical Quantile MappingJun+0.08-0.01 to +0.189/240.94331.00001.0000+0.02—
Empirical Quantile MappingJul+0.25+0.14 to +0.365/240.99991.00001.0000+0.08—
Empirical Quantile MappingAug+0.17+0.10 to +0.254/240.99991.00001.0000+0.08—
Empirical Quantile MappingSep+0.13+0.07 to +0.193/241.00001.00001.0000+0.14—
Empirical Quantile MappingJJAS+0.63+0.25 to +0.965/240.99861.00001.0000+0.66—
Gamma Quantile MappingJun-0.12-0.22 to -0.0218/240.01310.03920.6397-0.16✓
Gamma Quantile MappingJul-0.03-0.13 to +0.0712/240.30150.30151.0000-0.00—
Gamma Quantile MappingAug-0.12-0.16 to -0.0722/240.00000.00000.0003-0.04✓✓
Gamma Quantile MappingSep-0.06-0.11 to -0.0219/240.00450.01810.2353-0.09✓
Gamma Quantile MappingJJAS-0.08-0.22 to +0.0613/240.13180.26361.0000-0.22—
Detrended Quantile MappingJun+0.62+0.30 to +1.036/240.99991.00001.0000+0.89—
Detrended Quantile MappingJul+0.44+0.16 to +0.746/240.99751.00001.0000+0.73—
Detrended Quantile MappingAug+0.74+0.43 to +1.084/241.00001.00001.0000+0.30—
Detrended Quantile MappingSep+0.55+0.34 to +0.782/241.00001.00001.0000+0.72—
Detrended Quantile MappingJJAS+1.33+0.38 to +2.376/240.99191.00001.0000+2.74—
Quantile Delta MappingJun+0.81+0.39 to +1.334/241.00001.00001.0000+1.17—
Quantile Delta MappingJul+0.41+0.06 to +0.847/240.98301.00001.0000+1.04—
Quantile Delta MappingAug+0.86+0.48 to +1.332/241.00001.00001.0000+0.58—
Quantile Delta MappingSep+0.68+0.42 to +0.972/241.00001.00001.0000+0.74—
Quantile Delta MappingJJAS+1.61+0.56 to +2.885/240.99741.00001.0000+3.63—
Scaled Distribution MappingJun+1.17+0.70 to +1.712/241.00001.00001.0000+1.39—
Scaled Distribution MappingJul+0.73+0.35 to +1.165/240.99981.00001.0000+1.31—
Scaled Distribution MappingAug+1.21+0.77 to +1.712/241.00001.00001.0000+0.81—
Scaled Distribution MappingSep+0.93+0.64 to +1.271/241.00001.00001.0000+0.92—
Scaled Distribution MappingJJAS+2.54+1.51 to +3.762/241.00001.00001.0000+4.28—
CDF-transformJun+0.71+0.33 to +1.176/240.99981.00001.0000+1.14—
CDF-transformJul+0.50+0.19 to +0.837/240.99791.00001.0000+0.79—
CDF-transformAug+0.78+0.45 to +1.153/241.00001.00001.0000+0.45—
CDF-transformSep+0.71+0.46 to +1.010/241.00001.00001.0000+0.84—
CDF-transformJJAS+1.63+0.63 to +2.774/240.99851.00001.0000+2.89—
MVS with all-zero guard (variant)Jun+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
MVS with all-zero guard (variant)Jul+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
MVS with all-zero guard (variant)Aug+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
MVS with all-zero guard (variant)Sep+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
MVS with all-zero guard (variant)JJAS+0.00+0.00 to +0.000/241.00001.0000— (variant)+0.00—
Screening statistics, RPS (no blend) (method minus Mean-Variance Scaling; negative favours the method)
MethodTargetΔ RPS (no blend) 1993–201695% intervalYears betterp (one-sided)Holm p (method)Holm p (all 60)Δ 2017–2025Screening
Linear ScalingJun+0.0023-0.0072 to +0.011410/240.67671.00001.0000-0.0146—
Linear ScalingJul+0.0077+0.0031 to +0.01226/240.99791.00001.0000+0.0069—
Linear ScalingAug+0.0039+0.0015 to +0.00637/240.99711.00001.0000+0.0028—
Linear ScalingSep+0.0039-0.0017 to +0.009812/240.89531.00001.0000+0.0110—
Linear ScalingJJAS+0.0047+0.0013 to +0.00826/240.99381.00001.0000+0.0031—
Variance Scaling (unbounded)Jun-0.0016-0.0046 to +0.001416/240.16490.33331.0000-0.0032—
Variance Scaling (unbounded)Jul-0.0024-0.0059 to +0.001215/240.11110.33331.0000-0.0016—
Variance Scaling (unbounded)Aug-0.0022-0.0048 to +0.000315/240.05720.23451.0000-0.0023—
Variance Scaling (unbounded)Sep-0.0026-0.0056 to +0.000214/240.04690.23451.0000-0.0026—
Variance Scaling (unbounded)JJAS-0.0002-0.0020 to +0.001613/240.40030.40031.0000-0.0012—
Square-root-space Mean-Variance ScalingJun-0.0051-0.0084 to -0.002117/240.00200.01020.1218-0.0112✓
Square-root-space Mean-Variance ScalingJul-0.0013-0.0054 to +0.003114/240.28540.58481.0000+0.0002—
Square-root-space Mean-Variance ScalingAug-0.0021-0.0060 to +0.001512/240.14620.58481.0000+0.0006—
Square-root-space Mean-Variance ScalingSep-0.0024-0.0076 to +0.002410/240.17820.58481.0000-0.0034—
Square-root-space Mean-Variance ScalingJJAS+0.0003-0.0030 to +0.003812/240.56980.58481.0000-0.0004—
Power TransformationJun-0.0056-0.0094 to -0.001817/240.00430.02130.2510-0.0110✓
Power TransformationJul-0.0012-0.0072 to +0.005015/240.35080.79531.0000+0.0020—
Power TransformationAug-0.0019-0.0074 to +0.003010/240.24410.79531.0000+0.0023—
Power TransformationSep-0.0026-0.0087 to +0.003112/240.19880.79531.0000-0.0057—
Power TransformationJJAS+0.0004-0.0030 to +0.003711/240.57880.79531.0000+0.0014—
Delta ChangeJun+0.0192-0.0046 to +0.042910/240.93101.00001.0000+0.0146—
Delta ChangeJul+0.0060-0.0013 to +0.013210/240.93391.00001.0000-0.0000—
Delta ChangeAug+0.0140+0.0051 to +0.02388/240.99651.00001.0000+0.0149—
Delta ChangeSep+0.0160+0.0031 to +0.02998/240.98291.00001.0000+0.0205—
Delta ChangeJJAS-0.0009-0.0133 to +0.010911/240.44261.00001.0000+0.0170—
Local Intensity ScalingJun+0.0067-0.0008 to +0.014110/240.95061.00001.0000-0.0112—
Local Intensity ScalingJul+0.0072+0.0032 to +0.01157/240.99861.00001.0000+0.0082—
Local Intensity ScalingAug+0.0035+0.0005 to +0.00659/240.98221.00001.0000+0.0028—
Local Intensity ScalingSep+0.0037-0.0008 to +0.008510/240.93021.00001.0000+0.0102—
Local Intensity ScalingJJAS+0.0052+0.0019 to +0.00874/240.99741.00001.0000+0.0028—
Empirical Quantile MappingJun-0.0067-0.0136 to +0.000816/240.04810.24071.0000-0.0160—
Empirical Quantile MappingJul+0.0028-0.0010 to +0.006913/240.90631.00001.0000+0.0031—
Empirical Quantile MappingAug+0.0004-0.0029 to +0.004013/240.59571.00001.0000-0.0009—
Empirical Quantile MappingSep-0.0032-0.0071 to +0.000516/240.05820.24071.0000-0.0010—
Empirical Quantile MappingJJAS+0.0034-0.0019 to +0.008610/240.88731.00001.0000+0.0048—
Gamma Quantile MappingJun-0.0019-0.0073 to +0.003513/240.25121.00001.0000-0.0065—
Gamma Quantile MappingJul-0.0007-0.0065 to +0.005215/240.40311.00001.0000+0.0025—
Gamma Quantile MappingAug-0.0026-0.0088 to +0.003311/240.21031.00001.0000+0.0012—
Gamma Quantile MappingSep-0.0031-0.0119 to +0.005010/240.24541.00001.0000-0.0049—
Gamma Quantile MappingJJAS+0.0010-0.0037 to +0.005911/240.64921.00001.0000-0.0003—
Detrended Quantile MappingJun+0.0328+0.0148 to +0.05256/240.99921.00001.0000+0.0231—
Detrended Quantile MappingJul+0.0189+0.0095 to +0.02977/240.99981.00001.0000+0.0175—
Detrended Quantile MappingAug+0.0248+0.0140 to +0.03585/240.99991.00001.0000+0.0226—
Detrended Quantile MappingSep+0.0262+0.0141 to +0.04007/240.99981.00001.0000+0.0265—
Detrended Quantile MappingJJAS+0.0124+0.0030 to +0.02177/240.99101.00001.0000+0.0263—
Quantile Delta MappingJun+0.0288+0.0174 to +0.04115/241.00001.00001.0000+0.0122—
Quantile Delta MappingJul+0.0207+0.0095 to +0.03366/240.99941.00001.0000+0.0235—
Quantile Delta MappingAug+0.0266+0.0161 to +0.03834/241.00001.00001.0000+0.0277—
Quantile Delta MappingSep+0.0270+0.0118 to +0.04295/240.99861.00001.0000+0.0260—
Quantile Delta MappingJJAS+0.0207+0.0101 to +0.03116/240.99961.00001.0000+0.0298—
Scaled Distribution MappingJun+0.0456+0.0278 to +0.06514/241.00001.00001.0000+0.0179—
Scaled Distribution MappingJul+0.0282+0.0170 to +0.04063/241.00001.00001.0000+0.0301—
Scaled Distribution MappingAug+0.0374+0.0246 to +0.05143/241.00001.00001.0000+0.0328—
Scaled Distribution MappingSep+0.0361+0.0207 to +0.05333/241.00001.00001.0000+0.0357—
Scaled Distribution MappingJJAS+0.0290+0.0171 to +0.04073/240.99991.00001.0000+0.0377—
CDF-transformJun+0.0366+0.0222 to +0.05234/241.00001.00001.0000+0.0337—
CDF-transformJul+0.0218+0.0112 to +0.03394/240.99981.00001.0000+0.0180—
CDF-transformAug+0.0279+0.0172 to +0.03894/241.00001.00001.0000+0.0263—
CDF-transformSep+0.0346+0.0190 to +0.05175/240.99981.00001.0000+0.0275—
CDF-transformJJAS+0.0200+0.0105 to +0.02955/240.99971.00001.0000+0.0283—
MVS with all-zero guard (variant)Jun+0.0000+0.0000 to +0.00000/241.00001.0000— (variant)+0.0000—
MVS with all-zero guard (variant)Jul+0.0000+0.0000 to +0.00000/241.00001.0000— (variant)+0.0000—
MVS with all-zero guard (variant)Aug+0.0000+0.0000 to +0.00000/241.00001.0000— (variant)+0.0000—
MVS with all-zero guard (variant)Sep+0.0000+0.0000 to +0.00000/241.00001.0000— (variant)+0.0000—
MVS with all-zero guard (variant)JJAS+0.0000+0.0000 to +0.00000/241.00001.0000— (variant)+0.0000—

Diagnostics

How often limits, caps and fallbacks act
How often limits, caps and fallbacks act, leave-one-year-out 1993–2016 (mean over folds)
MethodTargetActivated (share of the corrected area, or of members / cells for events)
Mean-Variance Scaling (operational)Junratio lower limit: 7.0% of the area; ratio upper limit: 7.9% of the area; clipped at zero: 1.9%
Mean-Variance Scaling (operational)Julratio lower limit: 31.8% of the area; ratio upper limit: 4.5% of the area; clipped at zero: 9.8%
Mean-Variance Scaling (operational)Augratio lower limit: 27.9% of the area; ratio upper limit: 1.5% of the area; clipped at zero: 6.0%
Mean-Variance Scaling (operational)Sepratio lower limit: 14.4% of the area; ratio upper limit: 0.8% of the area; clipped at zero: 1.3%
Mean-Variance Scaling (operational)JJASratio lower limit: 14.0% of the area; ratio upper limit: 0.8% of the area; clipped at zero: 0.3%
Variance Scaling (unbounded)Junclipped at zero: 1.4%
Variance Scaling (unbounded)Julclipped at zero: 1.2%
Variance Scaling (unbounded)Augclipped at zero: 0.2%
Variance Scaling (unbounded)Sepclipped at zero: 0.6%
Variance Scaling (unbounded)JJASclipped at zero: 0.2%
Square-root-space Mean-Variance ScalingJunratio lower limit: 2.3% of the area; ratio upper limit: 0.4% of the area; clipped at zero: 0.1%
Square-root-space Mean-Variance ScalingJulratio lower limit: 27.0% of the area; ratio upper limit: 5.2% of the area; clipped at zero: 2.0%
Square-root-space Mean-Variance ScalingAugratio lower limit: 24.3% of the area; ratio upper limit: 0.9% of the area; clipped at zero: 0.4%
Square-root-space Mean-Variance ScalingSepratio lower limit: 9.5% of the area; clipped at zero: 0.0%
Square-root-space Mean-Variance ScalingJJASratio lower limit: 8.7% of the area; ratio upper limit: 0.3% of the area; clipped at zero: 0.0%
Power TransformationJunb at bound: 0.2% of the area
Power TransformationJulb at bound: 0.9% of the area
Power TransformationAugb at bound: 2.8% of the area
Delta ChangeJunratio capped: 0.1%
Delta ChangeJulratio capped: 0.0%
Delta ChangeAugratio capped: 0.0%
Delta ChangeSepratio capped: 0.0%
Delta ChangeJJASratio capped: 0.0%
Local Intensity ScalingJunalways wet: 93.6% of the area
Local Intensity ScalingJulalways wet: 87.5% of the area; never wet: 3.7% of the area
Local Intensity ScalingAugalways wet: 94.7% of the area; never wet: 2.2% of the area
Local Intensity ScalingSepalways wet: 96.7% of the area
Local Intensity ScalingJJASalways wet: 100.0% of the area
Empirical Quantile MappingJunmodel has dry: 41.8% of the area; obs has dry: 6.4% of the area; extrapolated: 0.3%
Empirical Quantile MappingJulmodel has dry: 23.2% of the area; obs has dry: 12.5% of the area; extrapolated: 0.3%
Empirical Quantile MappingAugmodel has dry: 23.1% of the area; obs has dry: 5.3% of the area; extrapolated: 0.3%
Empirical Quantile MappingSepmodel has dry: 25.4% of the area; obs has dry: 3.3% of the area; extrapolated: 0.3%
Empirical Quantile MappingJJASextrapolated: 0.4%
Gamma Quantile MappingJunmodel has dry: 41.8% of the area; obs has dry: 6.4% of the area
Gamma Quantile MappingJulgamma fallback: 3.4% of the area; model has dry: 23.2% of the area; obs has dry: 12.5% of the area
Gamma Quantile MappingAuggamma fallback: 1.7% of the area; model has dry: 23.1% of the area; obs has dry: 5.3% of the area
Gamma Quantile MappingSepmodel has dry: 25.4% of the area; obs has dry: 3.3% of the area
Detrended Quantile MappingJunmodel has dry: 41.8% of the area; obs has dry: 6.4% of the area; ratio capped: 0.1%; extrapolated: 0.1%
Detrended Quantile MappingJulmodel has dry: 23.2% of the area; obs has dry: 12.5% of the area; ratio capped: 0.0%; extrapolated: 0.2%
Detrended Quantile MappingAugmodel has dry: 23.1% of the area; obs has dry: 5.3% of the area; ratio capped: 0.0%; extrapolated: 0.2%
Detrended Quantile MappingSepmodel has dry: 25.4% of the area; obs has dry: 3.3% of the area; ratio capped: 0.0%; extrapolated: 0.2%
Detrended Quantile MappingJJASratio capped: 0.0%; extrapolated: 0.2%
Quantile Delta MappingJunmodel has dry: 41.8% of the area; obs has dry: 6.4% of the area; low denominator: 4.3%; ratio capped: 0.1%
Quantile Delta MappingJulmodel has dry: 23.2% of the area; obs has dry: 12.5% of the area; low denominator: 1.0%; ratio capped: 0.1%
Quantile Delta MappingAugmodel has dry: 23.1% of the area; obs has dry: 5.3% of the area; low denominator: 1.7%; ratio capped: 0.0%
Quantile Delta MappingSepmodel has dry: 25.4% of the area; obs has dry: 3.3% of the area; low denominator: 0.5%; ratio capped: 0.0%
Quantile Delta MappingJJASratio capped: 0.0%
Scaled Distribution MappingJulgamma fallback: 7.1% of the area; linear scaling fallback: 7.1%
Scaled Distribution MappingAuggamma fallback: 4.0% of the area; linear scaling fallback: 3.9%
CDF-transformJunat forecast range edge: 4.1%
CDF-transformJulat forecast range edge: 7.7%
CDF-transformAugat forecast range edge: 5.2%
CDF-transformSepat forecast range edge: 4.7%
CDF-transformJJASat forecast range edge: 6.0%
MVS with all-zero guard (variant)Junratio lower limit: 7.0% of the area; ratio upper limit: 7.9% of the area; clipped at zero: 1.9%
MVS with all-zero guard (variant)Julratio lower limit: 31.8% of the area; ratio upper limit: 4.5% of the area; clipped at zero: 9.8%
MVS with all-zero guard (variant)Augratio lower limit: 27.9% of the area; ratio upper limit: 1.5% of the area; clipped at zero: 6.0%
MVS with all-zero guard (variant)Sepratio lower limit: 14.4% of the area; ratio upper limit: 0.8% of the area; clipped at zero: 1.3%
MVS with all-zero guard (variant)JJASratio lower limit: 14.0% of the area; ratio upper limit: 0.8% of the area; clipped at zero: 0.3%
Where the amount differences come from: cells grouped by their training-year climate

Each cell is grouped by its CHIRPS totals in the fold’s training years only: every year exactly 0 mm; every year ≤ 1 mm (not all 0); some years dry and some wet; never dry. Contributions are area-weighted CRPS differences from Mean-Variance Scaling (mm; negative favours the method) and add up to the national difference. Leave-one-year-out 1993–2016, All Ethiopia.

Jun: contributions to the CRPS difference from Mean-Variance Scaling (mm)
MethodTotal Δ CRPSall 0 mm
0.0% of area
all ≤ 1 mm
0.0% of area
mixed
6.4% of area
always wet
93.6% of area
Linear Scaling+0.423+0.000+0.000-0.003+0.427
Variance Scaling (unbounded)-0.038+0.000+0.000-0.000-0.038
Square-root-space Mean-Variance Scaling-0.127+0.000+0.000-0.002-0.125
Power Transformation-0.068+0.000+0.000-0.005-0.063
Delta Change+0.151+0.000+0.000-0.011+0.162
Local Intensity Scaling+0.369+0.000+0.000+0.003+0.366
Empirical Quantile Mapping+0.081+0.000+0.000-0.001+0.082
Gamma Quantile Mapping-0.131+0.000+0.000-0.001-0.130
Detrended Quantile Mapping+0.632+0.000+0.000+0.005+0.627
Quantile Delta Mapping+0.815+0.000+0.000+0.004+0.811
Scaled Distribution Mapping+1.105+0.000+0.000+0.001+1.104
CDF-transform+0.703+0.000+0.000+0.003+0.701
MVS with all-zero guard (variant)+0.000+0.000+0.000+0.000+0.000
Jul: contributions to the CRPS difference from Mean-Variance Scaling (mm)
MethodTotal Δ CRPSall 0 mm
0.0% of area
all ≤ 1 mm
3.7% of area
mixed
8.8% of area
always wet
87.5% of area
Linear Scaling+0.497+0.000-0.013-0.037+0.546
Variance Scaling (unbounded)-0.139+0.000-0.014-0.042-0.083
Square-root-space Mean-Variance Scaling-0.075+0.000-0.010-0.030-0.036
Power Transformation-0.125+0.000-0.014-0.042-0.069
Delta Change-0.159+0.000-0.013-0.043-0.104
Local Intensity Scaling+0.482+0.000-0.009-0.014+0.506
Empirical Quantile Mapping+0.228+0.000-0.009-0.020+0.257
Gamma Quantile Mapping-0.008+0.000-0.009-0.032+0.033
Detrended Quantile Mapping+0.425+0.000-0.009-0.019+0.453
Quantile Delta Mapping+0.417+0.000-0.009-0.019+0.445
Scaled Distribution Mapping+0.673+0.000-0.013-0.028+0.714
CDF-transform+0.424+0.000-0.013-0.035+0.472
MVS with all-zero guard (variant)+0.000+0.000+0.000+0.000+0.000
Aug: contributions to the CRPS difference from Mean-Variance Scaling (mm)
MethodTotal Δ CRPSall 0 mm
0.0% of area
all ≤ 1 mm
2.2% of area
mixed
3.1% of area
always wet
94.7% of area
Linear Scaling+0.713+0.000-0.006-0.014+0.733
Variance Scaling (unbounded)-0.129+0.000-0.008-0.018-0.103
Square-root-space Mean-Variance Scaling-0.096+0.000-0.004-0.012-0.079
Power Transformation-0.124+0.000-0.008-0.017-0.099
Delta Change+0.305+0.000-0.006-0.015+0.327
Local Intensity Scaling+0.665+0.000+0.000-0.006+0.672
Empirical Quantile Mapping+0.151+0.000+0.000-0.006+0.157
Gamma Quantile Mapping-0.128+0.000+0.000-0.012-0.116
Detrended Quantile Mapping+0.722+0.000+0.000-0.005+0.727
Quantile Delta Mapping+0.858+0.000+0.000-0.005+0.864
Scaled Distribution Mapping+1.128+0.000-0.006-0.011+1.146
CDF-transform+0.735+0.000-0.006-0.013+0.754
MVS with all-zero guard (variant)+0.000+0.000+0.000+0.000+0.000
Sep: contributions to the CRPS difference from Mean-Variance Scaling (mm)
MethodTotal Δ CRPSall 0 mm
0.0% of area
all ≤ 1 mm
0.0% of area
mixed
3.3% of area
always wet
96.7% of area
Linear Scaling+0.546+0.000+0.000-0.002+0.548
Variance Scaling (unbounded)-0.032+0.000+0.000-0.007-0.025
Square-root-space Mean-Variance Scaling-0.058+0.000+0.000+0.000-0.058
Power Transformation-0.011+0.000+0.000-0.009-0.002
Delta Change+0.115+0.000+0.000-0.004+0.120
Local Intensity Scaling+0.495+0.000+0.000+0.012+0.483
Empirical Quantile Mapping+0.118+0.000+0.000-0.008+0.125
Gamma Quantile Mapping-0.072+0.000+0.000-0.005-0.067
Detrended Quantile Mapping+0.540+0.000+0.000-0.000+0.541
Quantile Delta Mapping+0.682+0.000+0.000-0.000+0.682
Scaled Distribution Mapping+0.857+0.000+0.000+0.002+0.856
CDF-transform+0.694+0.000+0.000-0.002+0.696
MVS with all-zero guard (variant)+0.000+0.000+0.000+0.000+0.000
JJAS: contributions to the CRPS difference from Mean-Variance Scaling (mm)
MethodTotal Δ CRPSall 0 mm
0.0% of area
all ≤ 1 mm
0.0% of area
mixed
0.0% of area
always wet
100.0% of area
Linear Scaling+1.482+0.000+0.000+0.000+1.482
Variance Scaling (unbounded)-0.040+0.000+0.000+0.000-0.040
Square-root-space Mean-Variance Scaling-0.111+0.000+0.000+0.000-0.111
Power Transformation-0.024+0.000+0.000+0.000-0.024
Delta Change+0.108+0.000+0.000+0.000+0.108
Local Intensity Scaling+1.452+0.000+0.000+0.000+1.452
Empirical Quantile Mapping+0.588+0.000+0.000+0.000+0.588
Gamma Quantile Mapping-0.117+0.000+0.000+0.000-0.117
Detrended Quantile Mapping+1.334+0.000+0.000+0.000+1.334
Quantile Delta Mapping+1.620+0.000+0.000+0.000+1.620
Scaled Distribution Mapping+2.389+0.000+0.000+0.000+2.389
CDF-transform+1.555+0.000+0.000+0.000+1.555
MVS with all-zero guard (variant)+0.000+0.000+0.000+0.000+0.000

← Data and methodsConfirmation →