chronos-forecasting/scripts/evaluation/results/chronos-bolt-mini-zero-shot.csv
Abdul Fatir 72ab64166c
Add support for Chronos-Bolt models (#204)
*Issue #, if available:* N/A

*Description of changes:* This PR adds support for Chronos-Bolt models.

TODOs:

- [x] Update evaluation script
- [x] Fix and add tests for Bolt
- [x] Update docstrings
- [x] Update README example and mention Chronos-Bolt
- [x] Update results bar plot in README
- [x] Add versions for libraries in `pyproject.toml`
- [x] Check that the training and eval scripts work
- [x] Change `autogluon` -> `amazon` in model names

Post Merge:
- [ ] Update Citation style in README, both Github and HuggingFace repos
- [ ] Remove note about AutoGluon
- [ ] Update READMEs of original Chronos models to refer to Chronos-Bolt

NOTE: To be merged after Chronos-Bolt models are available under the
`amazon` namespace on HF.

By submitting this pull request, I confirm that you can use, modify,
copy, and redistribute this contribution, under the terms of your
choice.

---------

Co-authored-by: Abdul Fatir Ansari <ansarnd@amazon.de>
Co-authored-by: Caner Turkmen <turkmen.ac@gmail.com>
Co-authored-by: Lorenzo Stella <stellalo@amazon.com>
2024-11-26 17:47:14 +01:00

28 lines
2.1 KiB
Text

dataset,model,MASE,WQL
ETTh,amazon/chronos-bolt-mini,0.8057126710113404,0.07740387596411452
ETTm,amazon/chronos-bolt-mini,0.6100793941108849,0.05129333450944573
dominick,amazon/chronos-bolt-mini,0.8664152477208024,0.3499696999160997
ercot,amazon/chronos-bolt-mini,0.6871250728215426,0.02448804863744021
exchange_rate,amazon/chronos-bolt-mini,1.3520551553333662,0.00934663373172766
m4_quarterly,amazon/chronos-bolt-mini,1.2569644266281508,0.07833787023275976
m4_yearly,amazon/chronos-bolt-mini,3.7611003052413796,0.12931927951165456
m5,amazon/chronos-bolt-mini,0.9188876472137485,0.5661303206519673
monash_australian_electricity,amazon/chronos-bolt-mini,0.8823559450287066,0.04493688824488474
monash_car_parts,amazon/chronos-bolt-mini,0.8604081423647779,1.0041876404811494
monash_cif_2016,amazon/chronos-bolt-mini,1.0762361363763873,0.017641893717784202
monash_covid_deaths,amazon/chronos-bolt-mini,38.83915011538576,0.06098317835750057
monash_fred_md,amazon/chronos-bolt-mini,0.6169859211923081,0.03256236965040934
monash_hospital,amazon/chronos-bolt-mini,0.6924431064606051,0.05766349075348645
monash_m1_monthly,amazon/chronos-bolt-mini,1.147893030263777,0.13270222658510553
monash_m1_quarterly,amazon/chronos-bolt-mini,1.8662100001165818,0.09846363409254102
monash_m1_yearly,amazon/chronos-bolt-mini,5.319154632748303,0.16167328827180308
monash_m3_monthly,amazon/chronos-bolt-mini,0.8758452776118432,0.09493431248614057
monash_m3_quarterly,amazon/chronos-bolt-mini,1.3555175243802005,0.07808062465932723
monash_m3_yearly,amazon/chronos-bolt-mini,3.605769430055575,0.15711010456482008
monash_nn5_weekly,amazon/chronos-bolt-mini,0.9347141924977239,0.08522899825844342
monash_tourism_monthly,amazon/chronos-bolt-mini,1.649587479665881,0.0979648261309891
monash_tourism_quarterly,amazon/chronos-bolt-mini,1.8471553663088986,0.06501077791766902
monash_tourism_yearly,amazon/chronos-bolt-mini,3.9932920493826245,0.1743539122097316
monash_traffic,amazon/chronos-bolt-mini,0.8355442361271347,0.24351051123330386
monash_weather,amazon/chronos-bolt-mini,0.800013628350165,0.13041050756802045
nn5,amazon/chronos-bolt-mini,0.611917632501032,0.1570111102680171