HUMANITYVECTOR

Forecast lab

Scorecard

How every model family performs out of sample, by horizon and by target, and every production forecast that missed its interval. Misses stay visible; a model that fails should show it.

Modeled

Families by horizon

mean skill versus last value across targets (1 - MAE / MAE of last value), mean 80 percent coverage, and how many (target, horizon) cells the family is champion of
Familyh = 1h = 2h = 3h = 5h = 6h = 12
Last value0.0%
cov 82% · champion 2/9
0.0%
cov 80% · champion 0/4
0.0%
cov 84% · champion 2/5
0.0%
cov 71% · champion 0/4
0.0%
cov 79% · champion 2/5
0.0%
cov 89% · champion 2/5
Seasonal naive-300.1%
cov 83% · champion 1/5
n/a-85.9%
cov 84% · champion 1/5
n/a-22.6%
cov 85% · champion 1/5
0.0%
cov 89% · champion 0/5
Drift19.9%
cov 74% · champion 0/9
37.2%
cov 58% · champion 0/4
9.8%
cov 79% · champion 1/5
34.5%
cov 38% · champion 0/4
-0.1%
cov 77% · champion 2/5
-10.8%
cov 83% · champion 2/5
Linear trend-54.3%
cov 69% · champion 0/9
54.6%
cov 55% · champion 0/4
-53.6%
cov 75% · champion 0/5
60.5%
cov 50% · champion 0/4
-51.4%
cov 74% · champion 0/5
-99.7%
cov 73% · champion 0/5
Holt (exponential smoothing with additive trend)26.5%
cov 74% · champion 4/9
54.0%
cov 58% · champion 2/4
-7.9%
cov 81% · champion 0/5
66.6%
cov 35% · champion 3/4
-30.1%
cov 85% · champion 0/5
-72.3%
cov 85% · champion 0/5
Ridge regression on lags and drivers24.7%
cov 73% · champion 2/8
53.9%
cov 56% · champion 2/3
14.5%
cov 79% · champion 1/5
59.8%
cov 31% · champion 1/3
13.3%
cov 77% · champion 0/5
16.4%
cov 84% · champion 1/5

Every registered model

177 rows; a champion is promoted only by beating last value by at least 5 percent over the minimum cutoffs
TargetHModelStatusCutoffsMAERMSEDirection80% coverageSkill vs last valueLive evaluations
cereal-yield:WLD1Holt (exponential smoothing with additive trend)
models_v1.targets_v1
champion1662.36100.175%81%13.1%none realised yet
cereal-yield:WLD1Drift
models_v1.targets_v1
challenger1674.25110.975%81%-3.5%none realised yet
cereal-yield:WLD1Last value
models_v1.targets_v1
baseline1671.77102.20%81%0.0%none realised yet
cereal-yield:WLD1Linear trend
models_v1.targets_v1
challenger1675.01106.163%75%-4.5%none realised yet
cereal-yield:WLD1Ridge regression on lags and drivers
models_v1.targets_v1
challenger1665.110375%81%9.3%none realised yet
cereal-yield:WLD2Ridge regression on lags and drivers
models_v1.targets_v1
champion1572.74111.393%87%29.3%none realised yet
cereal-yield:WLD2Drift
models_v1.targets_v1
challenger1599.2213193%80%3.6%none realised yet
cereal-yield:WLD2Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger1581.85112.993%80%20.5%none realised yet
cereal-yield:WLD2Last value
models_v1.targets_v1
baseline15102.91270%87%0.0%none realised yet
cereal-yield:WLD2Linear trend
models_v1.targets_v1
challenger1590.98121.987%67%11.6%none realised yet
cereal-yield:WLD5Ridge regression on lags and drivers
models_v1.targets_v1
champion12142.218292%42%44.4%none realised yet
cereal-yield:WLD5Drift
models_v1.targets_v1
challenger12170.1225.292%42%33.5%none realised yet
cereal-yield:WLD5Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger12154.3197.192%42%39.6%none realised yet
cereal-yield:WLD5Last value
models_v1.targets_v1
baseline12255.7274.30%83%0.0%none realised yet
cereal-yield:WLD5Linear trend
models_v1.targets_v1
challenger12158.3217.492%50%38.1%none realised yet
co2-global-annual-mean:WLD1Holt (exponential smoothing with additive trend)
models_v1.targets_v1
champion160.31390.4881100%75%87.2%none realised yet
co2-global-annual-mean:WLD1Drift
models_v1.targets_v1
challenger160.66520.7877100%81%72.8%none realised yet
co2-global-annual-mean:WLD1Last value
models_v1.targets_v1
baseline162.452.490%81%0.0%none realised yet
co2-global-annual-mean:WLD1Linear trend
models_v1.targets_v1
challenger160.55950.7006100%50%77.1%none realised yet
co2-global-annual-mean:WLD2Holt (exponential smoothing with additive trend)
models_v1.targets_v1
champion150.56320.7726100%67%88.5%none realised yet
co2-global-annual-mean:WLD2Drift
models_v1.targets_v1
challenger151.341.46100%67%72.6%none realised yet
co2-global-annual-mean:WLD2Last value
models_v1.targets_v1
baseline154.884.920%60%0.0%none realised yet
co2-global-annual-mean:WLD2Linear trend
models_v1.targets_v1
challenger150.79330.9657100%53%83.7%none realised yet
co2-global-annual-mean:WLD5Holt (exponential smoothing with additive trend)
models_v1.targets_v1
champion121.411.62100%42%88.4%none realised yet
co2-global-annual-mean:WLD5Drift
models_v1.targets_v1
challenger123.43.46100%50%72.0%none realised yet
co2-global-annual-mean:WLD5Last value
models_v1.targets_v1
baseline1212.1412.160%17%0.0%none realised yet
co2-global-annual-mean:WLD5Linear trend
models_v1.targets_v1
challenger121.661.96100%83%86.4%none realised yet
copper-price:WLD1Last value
models_v1.targets_v1
champion47317.9411.50%83%0.0%none realised yet
copper-price:WLD1Drift
models_v1.targets_v1
challenger47316.6401.953%81%0.4%none realised yet
copper-price:WLD1Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger47373.7440.345%79%-17.5%none realised yet
copper-price:WLD1Linear trend
models_v1.targets_v1
challenger471,0391,31047%81%-226.8%none realised yet
copper-price:WLD1Ridge regression on lags and drivers
models_v1.targets_v1
challenger47318.3411.753%81%-0.1%none realised yet
copper-price:WLD1Seasonal naive
models_v1.targets_v1
challenger471,3391,74951%74%-321.3%none realised yet
copper-price:WLD3Drift
models_v1.targets_v1
champion45566.1779.771%84%7.0%none realised yet
copper-price:WLD3Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger45785.3999.149%87%-29.0%none realised yet
copper-price:WLD3Last value
models_v1.targets_v1
baseline45608.7825.80%84%0.0%none realised yet
copper-price:WLD3Linear trend
models_v1.targets_v1
challenger451,2601,51142%87%-107.0%none realised yet
copper-price:WLD3Ridge regression on lags and drivers
models_v1.targets_v1
challenger45620.5838.929%84%-1.9%none realised yet
copper-price:WLD3Seasonal naive
models_v1.targets_v1
challenger451,3151,74151%76%-116.1%none realised yet
copper-price:WLD6Drift
models_v1.targets_v1
champion42895.61,18174%83%7.9%none realised yet
copper-price:WLD6Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger421,3821,74750%86%-42.1%none realised yet
copper-price:WLD6Last value
models_v1.targets_v1
baseline42972.31,2880%83%0.0%none realised yet
copper-price:WLD6Linear trend
models_v1.targets_v1
challenger421,6661,89043%79%-71.4%none realised yet
copper-price:WLD6Ridge regression on lags and drivers
models_v1.targets_v1
challenger421,0041,32826%83%-3.2%none realised yet
copper-price:WLD6Seasonal naive
models_v1.targets_v1
challenger421,3231,77055%76%-36.1%none realised yet
copper-price:WLD12Drift
models_v1.targets_v1
champion361,1371,61586%75%16.5%none realised yet
copper-price:WLD12Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger362,2022,82442%83%-61.6%none realised yet
copper-price:WLD12Last value
models_v1.targets_v1
baseline361,3631,8580%75%0.0%none realised yet
copper-price:WLD12Linear trend
models_v1.targets_v1
challenger362,2732,65753%61%-66.8%none realised yet
copper-price:WLD12Ridge regression on lags and drivers
models_v1.targets_v1
challenger361,4281,92814%75%-4.8%none realised yet
copper-price:WLD12Seasonal naive
models_v1.targets_v1
challenger361,3631,8580%75%0.0%none realised yet
life-expectancy:WLD1Ridge regression on lags and drivers
models_v1.targets_v1
champion160.27490.559388%56%35.2%none realised yet
life-expectancy:WLD1Drift
models_v1.targets_v1
challenger160.33760.566188%63%20.4%none realised yet
life-expectancy:WLD1Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger160.31590.716588%50%25.5%none realised yet
life-expectancy:WLD1Last value
models_v1.targets_v1
baseline160.42410.58160%69%0.0%none realised yet
life-expectancy:WLD1Linear trend
models_v1.targets_v1
challenger160.34750.57775%31%18.1%none realised yet
life-expectancy:WLD2Ridge regression on lags and drivers
models_v1.targets_v1
champion150.41830.788287%40%41.1%none realised yet
life-expectancy:WLD2Drift
models_v1.targets_v1
challenger150.53130.820987%47%25.2%none realised yet
life-expectancy:WLD2Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger150.62151.2373%60%12.5%none realised yet
life-expectancy:WLD2Last value
models_v1.targets_v1
baseline150.71050.85640%73%0.0%none realised yet
life-expectancy:WLD2Linear trend
models_v1.targets_v1
challenger150.42070.698180%33%40.8%none realised yet
life-expectancy:WLD5Holt (exponential smoothing with additive trend)
models_v1.targets_v1
champion120.52160.716492%8%47.0%none realised yet
life-expectancy:WLD5Drift
models_v1.targets_v1
challenger121.111.2792%25%-12.3%none realised yet
life-expectancy:WLD5Last value
models_v1.targets_v1
baseline120.98491.050%83%0.0%none realised yet
life-expectancy:WLD5Linear trend
models_v1.targets_v1
challenger120.64840.902192%8%34.2%none realised yet
life-expectancy:WLD5Ridge regression on lags and drivers
models_v1.targets_v1
challenger120.55060.815892%8%44.1%none realised yet
us-cpi-all-items:USA1Ridge regression on lags and drivers
models_v1.targets_v1
champion460.46380.656596%85%48.3%2 scored, MAE 1.03, coverage 50% (1 miss)
us-cpi-all-items:USA1Drift
models_v1.targets_v1
challenger460.4640.646796%83%48.3%none realised yet
us-cpi-all-items:USA1Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger460.49190.721296%91%45.2%none realised yet
us-cpi-all-items:USA1Last value
models_v1.targets_v1
baseline460.89781.050%89%0.0%none realised yet
us-cpi-all-items:USA1Linear trend
models_v1.targets_v1
challenger463.213.8883%65%-258.0%none realised yet
us-cpi-all-items:USA1Seasonal naive
models_v1.targets_v1
challenger4610.9311.554%96%-1117.7%none realised yet
us-cpi-all-items:USA3Ridge regression on lags and drivers
models_v1.targets_v1
champion440.92211.27100%64%61.6%none realised yet
us-cpi-all-items:USA3Drift
models_v1.targets_v1
challenger440.94241.27100%66%60.7%none realised yet
us-cpi-all-items:USA3Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger441.321.72100%77%44.9%none realised yet
us-cpi-all-items:USA3Last value
models_v1.targets_v1
baseline442.42.690%93%0.0%none realised yet
us-cpi-all-items:USA3Linear trend
models_v1.targets_v1
challenger444.144.9291%55%-72.4%none realised yet
us-cpi-all-items:USA3Seasonal naive
models_v1.targets_v1
challenger4410.4510.860%98%-335.4%none realised yet
us-cpi-all-items:USA6Drift
models_v1.targets_v1
champion411.031.33100%66%78.5%none realised yet
us-cpi-all-items:USA6Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger411.531.94100%90%68.1%none realised yet
us-cpi-all-items:USA6Last value
models_v1.targets_v1
baseline414.794.930%88%0.0%none realised yet
us-cpi-all-items:USA6Linear trend
models_v1.targets_v1
challenger415.666.71100%51%-18.0%none realised yet
us-cpi-all-items:USA6Ridge regression on lags and drivers
models_v1.targets_v1
challenger411.091.39100%73%77.2%none realised yet
us-cpi-all-items:USA6Seasonal naive
models_v1.targets_v1
challenger419.759.960%100%-103.3%none realised yet
us-cpi-all-items:USA12Ridge regression on lags and drivers
models_v1.targets_v1
champion361.72.19100%81%81.8%none realised yet
us-cpi-all-items:USA12Drift
models_v1.targets_v1
challenger361.822.13100%61%80.5%none realised yet
us-cpi-all-items:USA12Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger362.883.55100%78%69.1%none realised yet
us-cpi-all-items:USA12Last value
models_v1.targets_v1
baseline369.329.430%100%0.0%none realised yet
us-cpi-all-items:USA12Linear trend
models_v1.targets_v1
challenger369.3111.04100%44%0.1%none realised yet
us-cpi-all-items:USA12Seasonal naive
models_v1.targets_v1
challenger369.329.430%100%0.0%none realised yet
us-electricity-net-generation:USA1Seasonal naive
models_v1.targets_v1
champion4710,85113,49896%87%65.0%2 scored, MAE 6,386, coverage 100%
us-electricity-net-generation:USA1Drift
models_v1.targets_v1
challenger4731,09036,29647%72%-0.3%none realised yet
us-electricity-net-generation:USA1Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger4732,18637,62426%74%-3.8%none realised yet
us-electricity-net-generation:USA1Last value
models_v1.targets_v1
baseline4731,00536,2310%72%0.0%none realised yet
us-electricity-net-generation:USA1Linear trend
models_v1.targets_v1
challenger4734,92942,09357%77%-12.7%none realised yet
us-electricity-net-generation:USA1Ridge regression on lags and drivers
models_v1.targets_v1
challenger4727,25932,61568%72%12.1%none realised yet
us-electricity-net-generation:USA3Seasonal naive
models_v1.targets_v1
champion4510,93113,54984%89%79.2%none realised yet
us-electricity-net-generation:USA3Drift
models_v1.targets_v1
challenger4552,65065,26053%82%-0.3%none realised yet
us-electricity-net-generation:USA3Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger4556,06969,66920%80%-6.9%none realised yet
us-electricity-net-generation:USA3Last value
models_v1.targets_v1
baseline4552,47264,8530%82%0.0%none realised yet
us-electricity-net-generation:USA3Linear trend
models_v1.targets_v1
challenger4535,31042,59287%78%32.7%none realised yet
us-electricity-net-generation:USA3Ridge regression on lags and drivers
models_v1.targets_v1
challenger4545,60757,40356%87%13.1%none realised yet
us-electricity-net-generation:USA6Seasonal naive
models_v1.targets_v1
champion4211,29213,93195%86%70.6%none realised yet
us-electricity-net-generation:USA6Drift
models_v1.targets_v1
challenger4239,21349,20343%79%-2.1%none realised yet
us-electricity-net-generation:USA6Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger4245,61657,76526%79%-18.7%none realised yet
us-electricity-net-generation:USA6Last value
models_v1.targets_v1
baseline4238,42548,5780%79%0.0%none realised yet
us-electricity-net-generation:USA6Linear trend
models_v1.targets_v1
challenger4232,66138,80067%79%15.0%none realised yet
us-electricity-net-generation:USA6Ridge regression on lags and drivers
models_v1.targets_v1
challenger4236,31246,83562%79%5.5%none realised yet
us-electricity-net-generation:USA12Drift
models_v1.targets_v1
champion369,31211,45278%89%13.6%none realised yet
us-electricity-net-generation:USA12Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger3624,56528,64642%89%-128.0%none realised yet
us-electricity-net-generation:USA12Last value
models_v1.targets_v1
baseline3610,77613,4340%89%0.0%none realised yet
us-electricity-net-generation:USA12Linear trend
models_v1.targets_v1
challenger3630,89136,40967%83%-186.7%none realised yet
us-electricity-net-generation:USA12Ridge regression on lags and drivers
models_v1.targets_v1
challenger369,81712,32378%89%8.9%none realised yet
us-electricity-net-generation:USA12Seasonal naive
models_v1.targets_v1
challenger3610,77613,4340%89%0.0%none realised yet
us-housing-starts:USA1Holt (exponential smoothing with additive trend)
models_v1.targets_v1
champion4778.47103.574%77%16.2%1 scored, MAE 5.61, coverage 100%
us-housing-starts:USA1Drift
models_v1.targets_v1
challenger4793.71118.151%77%-0.1%none realised yet
us-housing-starts:USA1Last value
models_v1.targets_v1
baseline4793.66118.10%77%0.0%none realised yet
us-housing-starts:USA1Linear trend
models_v1.targets_v1
challenger4798.12129.768%79%-4.8%none realised yet
us-housing-starts:USA1Ridge regression on lags and drivers
models_v1.targets_v1
challenger4792.36117.151%77%1.4%none realised yet
us-housing-starts:USA1Seasonal naive
models_v1.targets_v1
challenger47126168.364%81%-34.5%none realised yet
us-housing-starts:USA3Last value
models_v1.targets_v1
champion4595.91119.20%78%0.0%none realised yet
us-housing-starts:USA3Drift
models_v1.targets_v1
challenger4596.18119.444%78%-0.3%none realised yet
us-housing-starts:USA3Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger4591.94113.256%73%4.1%none realised yet
us-housing-starts:USA3Linear trend
models_v1.targets_v1
challenger45104140.364%78%-8.5%none realised yet
us-housing-starts:USA3Ridge regression on lags and drivers
models_v1.targets_v1
challenger4596.2117.944%76%-0.3%none realised yet
us-housing-starts:USA3Seasonal naive
models_v1.targets_v1
challenger45122.4165.862%84%-27.6%none realised yet
us-housing-starts:USA6Last value
models_v1.targets_v1
champion4291.12110.10%83%0.0%none realised yet
us-housing-starts:USA6Drift
models_v1.targets_v1
challenger4291.19110.457%83%-0.1%none realised yet
us-housing-starts:USA6Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger4289.87109.957%86%1.4%none realised yet
us-housing-starts:USA6Linear trend
models_v1.targets_v1
challenger42106.2143.476%76%-16.5%none realised yet
us-housing-starts:USA6Ridge regression on lags and drivers
models_v1.targets_v1
challenger4290.04110.157%83%1.2%none realised yet
us-housing-starts:USA6Seasonal naive
models_v1.targets_v1
challenger42105.3141.569%90%-15.5%none realised yet
us-housing-starts:USA12Last value
models_v1.targets_v1
champion3687110.60%97%0.0%none realised yet
us-housing-starts:USA12Drift
models_v1.targets_v1
challenger3686.89110.658%94%0.1%none realised yet
us-housing-starts:USA12Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger3693.62116.756%89%-7.6%none realised yet
us-housing-starts:USA12Linear trend
models_v1.targets_v1
challenger36140.2172.561%75%-61.1%none realised yet
us-housing-starts:USA12Ridge regression on lags and drivers
models_v1.targets_v1
challenger3687.02110.158%94%-0.0%none realised yet
us-housing-starts:USA12Seasonal naive
models_v1.targets_v1
challenger3687110.60%97%0.0%none realised yet
us-industrial-production:USA1Last value
models_v1.targets_v1
champion470.43530.55270%83%0.0%2 scored, MAE 0.4783, coverage 50% (1 miss)
us-industrial-production:USA1Drift
models_v1.targets_v1
challenger470.46740.586553%83%-7.4%none realised yet
us-industrial-production:USA1Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger470.53480.684947%87%-22.9%none realised yet
us-industrial-production:USA1Linear trend
models_v1.targets_v1
challenger471.111.3547%94%-154.2%none realised yet
us-industrial-production:USA1Ridge regression on lags and drivers
models_v1.targets_v1
challenger470.43520.55453%81%0.0%none realised yet
us-industrial-production:USA1Seasonal naive
models_v1.targets_v1
challenger470.83640.984157%74%-92.1%none realised yet
us-industrial-production:USA3Last value
models_v1.targets_v1
champion450.65530.77380%84%0.0%none realised yet
us-industrial-production:USA3Drift
models_v1.targets_v1
challenger450.7730.975853%84%-18.0%none realised yet
us-industrial-production:USA3Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger4511.349%89%-52.6%none realised yet
us-industrial-production:USA3Linear trend
models_v1.targets_v1
challenger451.41.6644%78%-113.1%none realised yet
us-industrial-production:USA3Ridge regression on lags and drivers
models_v1.targets_v1
challenger450.65440.785353%82%0.1%none realised yet
us-industrial-production:USA3Seasonal naive
models_v1.targets_v1
challenger450.84790.99358%73%-29.4%none realised yet
us-industrial-production:USA6Last value
models_v1.targets_v1
champion420.68280.90710%62%0.0%none realised yet
us-industrial-production:USA6Drift
models_v1.targets_v1
challenger421.261.4767%74%-84.7%none realised yet
us-industrial-production:USA6Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger421.772.2248%83%-159.3%none realised yet
us-industrial-production:USA6Linear trend
models_v1.targets_v1
challenger421.822.1145%86%-165.9%none realised yet
us-industrial-production:USA6Ridge regression on lags and drivers
models_v1.targets_v1
challenger420.7810.942567%67%-14.4%none realised yet
us-industrial-production:USA6Seasonal naive
models_v1.targets_v1
challenger420.87771.0243%74%-28.6%none realised yet
us-industrial-production:USA12Last value
models_v1.targets_v1
champion360.95641.080%83%0.0%none realised yet
us-industrial-production:USA12Drift
models_v1.targets_v1
challenger362.532.7361%97%-164.5%none realised yet
us-industrial-production:USA12Holt (exponential smoothing with additive trend)
models_v1.targets_v1
challenger363.194.0347%86%-233.3%none realised yet
us-industrial-production:USA12Linear trend
models_v1.targets_v1
challenger362.723.2631%100%-184.0%none realised yet
us-industrial-production:USA12Ridge regression on lags and drivers
models_v1.targets_v1
challenger360.99531.2461%83%-4.1%none realised yet
us-industrial-production:USA12Seasonal naive
models_v1.targets_v1
challenger360.95641.080%83%0.0%none realised yet
world-population:WLD1Holt (exponential smoothing with additive trend)
models_v1.targets_v1
champion163,458,2494,396,719100%50%95.7%none realised yet
world-population:WLD1Drift
models_v1.targets_v1
challenger1642,147,91243,232,101100%50%48.1%none realised yet
world-population:WLD1Last value
models_v1.targets_v1
baseline1681,203,54481,519,3440%100%0.0%none realised yet
world-population:WLD1Linear trend
models_v1.targets_v1
challenger1618,330,38122,564,954100%69%77.4%none realised yet
world-population:WLD1Ridge regression on lags and drivers
models_v1.targets_v1
challenger167,231,8649,955,672100%50%91.1%none realised yet
world-population:WLD2Holt (exponential smoothing with additive trend)
models_v1.targets_v1
champion158,984,99410,834,692100%27%94.5%none realised yet
world-population:WLD2Drift
models_v1.targets_v1
challenger1585,607,97787,696,122100%40%47.4%none realised yet
world-population:WLD2Last value
models_v1.targets_v1
baseline15162,619,610163,220,5960%100%0.0%none realised yet
world-population:WLD2Linear trend
models_v1.targets_v1
challenger1528,681,36234,741,889100%67%82.4%none realised yet
world-population:WLD2Ridge regression on lags and drivers
models_v1.targets_v1
challenger1514,464,12219,964,410100%40%91.1%none realised yet
world-population:WLD5Holt (exponential smoothing with additive trend)
models_v1.targets_v1
champion1235,742,30041,925,467100%50%91.2%none realised yet
world-population:WLD5Drift
models_v1.targets_v1
challenger12225,271,426229,591,978100%33%44.6%none realised yet
world-population:WLD5Last value
models_v1.targets_v1
baseline12406,812,060408,023,9010%100%0.0%none realised yet
world-population:WLD5Linear trend
models_v1.targets_v1
challenger1267,857,26578,527,034100%58%83.3%none realised yet
world-population:WLD5Ridge regression on lags and drivers
models_v1.targets_v1
challenger1237,327,11045,684,477100%42%90.8%none realised yet

Interval misses

2 production forecasts whose realised value fell outside the 80 percent interval
us-cpi-all-items:USA:1 · 2026-09Ridge regression on lags and drivers · evaluated 2026-10-19 00:22 UTC

forecast 334.8 [334.3, 335.5], realised 336.3, absolute error 1.45

Interval miss: realised 336.3 index 1982-1984=100 is above the upper bound 335.5 index 1982-1984=100 by 0.7627 index 1982-1984=100. Model ridge; error 1.45 index 1982-1984=100 (0.43 percent of the origin value). The surprise came from the target itself moving outside the range of its recent lagged-driver errors; a structural break after the cutoff is possible and is not ruled out by the record. Assumption "no structural break between cutoff and target" is the first suspect.

us-industrial-production:USA:1 · 2026-09Last value · evaluated 2026-10-19 00:22 UTC

forecast 103.1 [102.6, 103.9], realised 104, absolute error 0.8824

Interval miss: realised 104 index 2017=100 is above the upper bound 103.9 index 2017=100 by 0.0126 index 2017=100. Model last_value; error 0.8824 index 2017=100 (0.86 percent of the origin value). The surprise came from the target itself moving outside the range of its recent own-history errors; a structural break after the cutoff is possible and is not ruled out by the record. Assumption "no structural break between cutoff and target" is the first suspect.

Backtest history

one row per model per backtest window, newest first
Model keyWindowCutoffsMAESkillComputed
co2-global-annual-mean:WLD:1:holt:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)160.313987.2%2026-10-01 00:03 UTC
co2-global-annual-mean:WLD:5:linear_trend:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)121.6686.4%2026-10-01 00:03 UTC
co2-global-annual-mean:WLD:2:linear_trend:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)150.793383.7%2026-10-01 00:03 UTC
co2-global-annual-mean:WLD:1:linear_trend:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)160.559577.1%2026-10-01 00:03 UTC
co2-global-annual-mean:WLD:5:drift:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)123.472.0%2026-10-01 00:03 UTC
co2-global-annual-mean:WLD:2:drift:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)151.3472.6%2026-10-01 00:03 UTC
co2-global-annual-mean:WLD:1:drift:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)160.665272.8%2026-10-01 00:03 UTC
co2-global-annual-mean:WLD:5:last_value:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)1212.140.0%2026-10-01 00:03 UTC
co2-global-annual-mean:WLD:2:last_value:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)154.880.0%2026-10-01 00:03 UTC
co2-global-annual-mean:WLD:1:last_value:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)162.450.0%2026-10-01 00:03 UTC
co2-global-annual-mean:WLD:5:holt:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)121.4188.4%2026-10-01 00:03 UTC
co2-global-annual-mean:WLD:2:holt:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)150.563288.5%2026-10-01 00:03 UTC
cereal-yield:WLD:1:drift:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)1674.25-3.5%2026-10-01 00:03 UTC
cereal-yield:WLD:5:last_value:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)12255.70.0%2026-10-01 00:03 UTC
cereal-yield:WLD:1:last_value:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)1671.770.0%2026-10-01 00:03 UTC
cereal-yield:WLD:2:last_value:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)15102.90.0%2026-10-01 00:03 UTC
cereal-yield:WLD:5:ridge:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)12142.244.4%2026-10-01 00:03 UTC
cereal-yield:WLD:2:ridge:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)1572.7429.3%2026-10-01 00:03 UTC
cereal-yield:WLD:1:ridge:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)1665.19.3%2026-10-01 00:03 UTC
cereal-yield:WLD:5:holt:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)12154.339.6%2026-10-01 00:03 UTC
cereal-yield:WLD:2:holt:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)1581.8520.5%2026-10-01 00:03 UTC
cereal-yield:WLD:1:holt:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)1662.3613.1%2026-10-01 00:03 UTC
cereal-yield:WLD:5:linear_trend:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)12158.338.1%2026-10-01 00:03 UTC
cereal-yield:WLD:2:linear_trend:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)1590.9811.6%2026-10-01 00:03 UTC
cereal-yield:WLD:1:linear_trend:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)1675.01-4.5%2026-10-01 00:03 UTC
cereal-yield:WLD:5:drift:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)12170.133.5%2026-10-01 00:03 UTC
cereal-yield:WLD:2:drift:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)1599.223.6%2026-10-01 00:03 UTC
life-expectancy:WLD:2:linear_trend:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)150.420740.8%2026-10-01 00:03 UTC
life-expectancy:WLD:5:ridge:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)120.550644.1%2026-10-01 00:03 UTC
life-expectancy:WLD:2:ridge:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)150.418341.1%2026-10-01 00:03 UTC
life-expectancy:WLD:1:ridge:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)160.274935.2%2026-10-01 00:03 UTC
life-expectancy:WLD:5:holt:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)120.521647.0%2026-10-01 00:03 UTC
life-expectancy:WLD:2:holt:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)150.621512.5%2026-10-01 00:03 UTC
life-expectancy:WLD:1:holt:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)160.315925.5%2026-10-01 00:03 UTC
life-expectancy:WLD:5:linear_trend:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)120.648434.2%2026-10-01 00:03 UTC
life-expectancy:WLD:1:linear_trend:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)160.347518.1%2026-10-01 00:03 UTC
life-expectancy:WLD:5:drift:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)121.11-12.3%2026-10-01 00:03 UTC
life-expectancy:WLD:2:drift:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)150.531325.2%2026-10-01 00:03 UTC
life-expectancy:WLD:1:drift:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)160.337620.4%2026-10-01 00:03 UTC
life-expectancy:WLD:5:last_value:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)120.98490.0%2026-10-01 00:03 UTC
life-expectancy:WLD:2:last_value:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)150.71050.0%2026-10-01 00:03 UTC
life-expectancy:WLD:1:last_value:models_v1.targets_v12008-01-01..2023-01-01 (first_ingested)160.42410.0%2026-10-01 00:03 UTC
world-population:WLD:2:last_value:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)15162,619,6100.0%2026-10-01 00:03 UTC
world-population:WLD:5:ridge:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)1237,327,11090.8%2026-10-01 00:03 UTC
world-population:WLD:2:ridge:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)1514,464,12291.1%2026-10-01 00:03 UTC
world-population:WLD:1:ridge:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)167,231,86491.1%2026-10-01 00:03 UTC
world-population:WLD:5:holt:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)1235,742,30091.2%2026-10-01 00:03 UTC
world-population:WLD:2:holt:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)158,984,99494.5%2026-10-01 00:03 UTC
world-population:WLD:1:holt:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)163,458,24995.7%2026-10-01 00:03 UTC
world-population:WLD:5:linear_trend:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)1267,857,26583.3%2026-10-01 00:03 UTC
world-population:WLD:1:last_value:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)1681,203,5440.0%2026-10-01 00:03 UTC
world-population:WLD:2:linear_trend:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)1528,681,36282.4%2026-10-01 00:03 UTC
world-population:WLD:1:linear_trend:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)1618,330,38177.4%2026-10-01 00:03 UTC
world-population:WLD:5:drift:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)12225,271,42644.6%2026-10-01 00:03 UTC
world-population:WLD:2:drift:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)1585,607,97747.4%2026-10-01 00:03 UTC
world-population:WLD:1:drift:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)1642,147,91248.1%2026-10-01 00:03 UTC
world-population:WLD:5:last_value:models_v1.targets_v12009-01-01..2024-01-01 (first_ingested)12406,812,0600.0%2026-10-01 00:03 UTC
us-cpi-all-items:USA:3:seasonal_naive:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)4410.45-335.4%2026-10-01 00:03 UTC
us-cpi-all-items:USA:12:ridge:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)361.781.8%2026-10-01 00:03 UTC
us-cpi-all-items:USA:6:ridge:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)411.0977.2%2026-10-01 00:03 UTC
us-cpi-all-items:USA:3:ridge:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)440.922161.6%2026-10-01 00:03 UTC
us-cpi-all-items:USA:1:ridge:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)460.463848.3%2026-10-01 00:03 UTC
us-cpi-all-items:USA:12:holt:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)362.8869.1%2026-10-01 00:03 UTC
us-cpi-all-items:USA:6:holt:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)411.5368.1%2026-10-01 00:03 UTC
us-cpi-all-items:USA:3:holt:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)441.3244.9%2026-10-01 00:03 UTC
us-cpi-all-items:USA:1:holt:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)460.491945.2%2026-10-01 00:03 UTC
us-cpi-all-items:USA:12:linear_trend:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)369.310.1%2026-10-01 00:03 UTC
us-cpi-all-items:USA:6:linear_trend:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)415.66-18.0%2026-10-01 00:03 UTC
us-cpi-all-items:USA:3:linear_trend:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)444.14-72.4%2026-10-01 00:03 UTC
us-cpi-all-items:USA:1:linear_trend:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)463.21-258.0%2026-10-01 00:03 UTC
us-cpi-all-items:USA:12:drift:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)361.8280.5%2026-10-01 00:03 UTC
us-cpi-all-items:USA:6:drift:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)411.0378.5%2026-10-01 00:03 UTC
us-cpi-all-items:USA:3:drift:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)440.942460.7%2026-10-01 00:03 UTC
us-cpi-all-items:USA:1:drift:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)460.46448.3%2026-10-01 00:03 UTC
us-cpi-all-items:USA:12:seasonal_naive:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)369.320.0%2026-10-01 00:03 UTC
us-cpi-all-items:USA:6:seasonal_naive:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)419.75-103.3%2026-10-01 00:03 UTC
us-cpi-all-items:USA:1:seasonal_naive:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)4610.93-1117.7%2026-10-01 00:03 UTC
us-cpi-all-items:USA:12:last_value:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)369.320.0%2026-10-01 00:03 UTC
us-cpi-all-items:USA:6:last_value:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)414.790.0%2026-10-01 00:03 UTC
us-cpi-all-items:USA:3:last_value:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)442.40.0%2026-10-01 00:03 UTC
us-cpi-all-items:USA:1:last_value:models_v1.targets_v12022-08-01..2026-07-01 (first_ingested)460.89780.0%2026-10-01 00:03 UTC
copper-price:WLD:1:last_value:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)47317.90.0%2026-10-01 00:02 UTC
copper-price:WLD:12:ridge:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)361,428-4.8%2026-10-01 00:02 UTC
copper-price:WLD:6:ridge:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)421,004-3.2%2026-10-01 00:02 UTC
copper-price:WLD:3:ridge:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)45620.5-1.9%2026-10-01 00:02 UTC
copper-price:WLD:1:ridge:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)47318.3-0.1%2026-10-01 00:02 UTC
copper-price:WLD:12:holt:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)362,202-61.6%2026-10-01 00:02 UTC
copper-price:WLD:6:holt:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)421,382-42.1%2026-10-01 00:02 UTC
copper-price:WLD:3:holt:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)45785.3-29.0%2026-10-01 00:02 UTC
copper-price:WLD:1:holt:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)47373.7-17.5%2026-10-01 00:02 UTC
copper-price:WLD:12:linear_trend:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)362,273-66.8%2026-10-01 00:02 UTC
copper-price:WLD:6:linear_trend:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)421,666-71.4%2026-10-01 00:02 UTC
copper-price:WLD:3:linear_trend:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)451,260-107.0%2026-10-01 00:02 UTC
copper-price:WLD:1:linear_trend:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)471,039-226.8%2026-10-01 00:02 UTC
copper-price:WLD:12:drift:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)361,13716.5%2026-10-01 00:02 UTC
copper-price:WLD:6:drift:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)42895.67.9%2026-10-01 00:02 UTC
copper-price:WLD:3:drift:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)45566.17.0%2026-10-01 00:02 UTC
copper-price:WLD:1:drift:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)47316.60.4%2026-10-01 00:02 UTC
copper-price:WLD:12:seasonal_naive:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)361,3630.0%2026-10-01 00:02 UTC
copper-price:WLD:6:seasonal_naive:models_v1.targets_v12022-08-01..2026-06-01 (first_ingested)421,323-36.1%2026-10-01 00:02 UTC