mirror of
https://github.com/amazon-science/chronos-forecasting
synced 2026-05-24 10:08:33 +00:00
*Description of changes:* This PR adds configs and a script to evaluate Chronos models in the same way as described in the paper. By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice. Co-authored-by: Abdul Fatir Ansari <ansarnd@amazon.de>
1.8 KiB
1.8 KiB
| 1 | dataset | model | MASE | WQL |
|---|---|---|---|---|
| 2 | ETTh | seasonal-naive | 0.9316203114697056 | 0.1220896585205886 |
| 3 | ETTm | seasonal-naive | 1.1693053852270578 | 0.1413480385734046 |
| 4 | dominick | seasonal-naive | 0.8706150115348875 | 0.4529164093744346 |
| 5 | ercot | seasonal-naive | 0.7613354813741452 | 0.0366036447606282 |
| 6 | exchange_rate | seasonal-naive | 1.7401824286954128 | 0.0129841406759913 |
| 7 | m4_quarterly | seasonal-naive | 1.6022471766126911 | 0.1186484661559648 |
| 8 | m4_yearly | seasonal-naive | 3.974360261259571 | 0.1614389663357925 |
| 9 | m5 | seasonal-naive | 1.399206213076729 | 1.0240883478068443 |
| 10 | monash_australian_electricity | seasonal-naive | 1.2533189641227642 | 0.0836951323308387 |
| 11 | monash_car_parts | seasonal-naive | 1.2014638390969912 | 1.5999522140809177 |
| 12 | monash_cif_2016 | seasonal-naive | 1.289290577415544 | 0.0150830409089921 |
| 13 | monash_covid_deaths | seasonal-naive | 46.91239825526407 | 0.1330848762571827 |
| 14 | monash_fred_md | seasonal-naive | 1.1008000463101226 | 0.1222237702571737 |
| 15 | monash_hospital | seasonal-naive | 0.9205278266364826 | 0.0726263373268254 |
| 16 | monash_m1_monthly | seasonal-naive | 1.3144614957646543 | 0.1914632595030148 |
| 17 | monash_m1_quarterly | seasonal-naive | 2.077536550805995 | 0.1495022062865622 |
| 18 | monash_m1_yearly | seasonal-naive | 4.894322225232431 | 0.2092955931101782 |
| 19 | monash_m3_monthly | seasonal-naive | 1.1462045758327934 | 0.1485446007554992 |
| 20 | monash_m3_quarterly | seasonal-naive | 1.425343793700714 | 0.1012520529806161 |
| 21 | monash_m3_yearly | seasonal-naive | 3.1717102364409517 | 0.1665329650420048 |
| 22 | monash_nn5_weekly | seasonal-naive | 1.0628482559107015 | 0.1226908962169196 |
| 23 | monash_tourism_monthly | seasonal-naive | 1.630939994944413 | 0.1041824322151567 |
| 24 | monash_tourism_quarterly | seasonal-naive | 1.6989892627474672 | 0.1193750169177449 |
| 25 | monash_tourism_yearly | seasonal-naive | 3.5520097206480883 | 0.2091826587673241 |
| 26 | monash_traffic | seasonal-naive | 1.0767397173107436 | 0.3618532196990004 |
| 27 | monash_weather | seasonal-naive | 1.0038475713182748 | 0.2165947349654047 |
| 28 | nn5 | seasonal-naive | 1.2917285866431214 | 0.4246208074843067 |