chronos-forecasting/scripts/evaluation/results/chronos-bolt-tiny-zero-shot.csv
Abdul Fatir 72ab64166c
Add support for Chronos-Bolt models (#204)
*Issue #, if available:* N/A

*Description of changes:* This PR adds support for Chronos-Bolt models.

TODOs:

- [x] Update evaluation script
- [x] Fix and add tests for Bolt
- [x] Update docstrings
- [x] Update README example and mention Chronos-Bolt
- [x] Update results bar plot in README
- [x] Add versions for libraries in `pyproject.toml`
- [x] Check that the training and eval scripts work
- [x] Change `autogluon` -> `amazon` in model names

Post Merge:
- [ ] Update Citation style in README, both Github and HuggingFace repos
- [ ] Remove note about AutoGluon
- [ ] Update READMEs of original Chronos models to refer to Chronos-Bolt

NOTE: To be merged after Chronos-Bolt models are available under the
`amazon` namespace on HF.

By submitting this pull request, I confirm that you can use, modify,
copy, and redistribute this contribution, under the terms of your
choice.

---------

Co-authored-by: Abdul Fatir Ansari <ansarnd@amazon.de>
Co-authored-by: Caner Turkmen <turkmen.ac@gmail.com>
Co-authored-by: Lorenzo Stella <stellalo@amazon.com>
2024-11-26 17:47:14 +01:00

28 lines
2.1 KiB
Text

dataset,model,MASE,WQL
ETTh,amazon/chronos-bolt-tiny,0.7941225847155844,0.07480860969990633
ETTm,amazon/chronos-bolt-tiny,0.6508270995240056,0.05440068825429993
dominick,amazon/chronos-bolt-tiny,0.876060127216559,0.35175949052933253
ercot,amazon/chronos-bolt-tiny,0.7309134980173839,0.02468604544464515
exchange_rate,amazon/chronos-bolt-tiny,1.6857262567077134,0.011477224264784112
m4_quarterly,amazon/chronos-bolt-tiny,1.2605908919338378,0.0789049420017836
m4_yearly,amazon/chronos-bolt-tiny,3.7118394116161757,0.1286932555969197
m5,amazon/chronos-bolt-tiny,0.9195469670062033,0.5634881835998845
monash_australian_electricity,amazon/chronos-bolt-tiny,0.8419304693259403,0.042040993880313904
monash_car_parts,amazon/chronos-bolt-tiny,0.8625579150452282,1.0009987800801836
monash_cif_2016,amazon/chronos-bolt-tiny,1.095219642027011,0.017550336784241796
monash_covid_deaths,amazon/chronos-bolt-tiny,40.674057986280744,0.06723714516685976
monash_fred_md,amazon/chronos-bolt-tiny,0.6127387450520702,0.04747523852271518
monash_hospital,amazon/chronos-bolt-tiny,0.6980246281225624,0.05864223243167421
monash_m1_monthly,amazon/chronos-bolt-tiny,1.1625495971731141,0.13142237467151166
monash_m1_quarterly,amazon/chronos-bolt-tiny,1.8941765599193754,0.09972207844232561
monash_m1_yearly,amazon/chronos-bolt-tiny,5.136332694531757,0.160331813128038
monash_m3_monthly,amazon/chronos-bolt-tiny,0.8744553726704598,0.09435519378597752
monash_m3_quarterly,amazon/chronos-bolt-tiny,1.364563776692303,0.07875066385737857
monash_m3_yearly,amazon/chronos-bolt-tiny,3.3685961410254928,0.15158076519486274
monash_nn5_weekly,amazon/chronos-bolt-tiny,0.9324436794013877,0.0847385189968909
monash_tourism_monthly,amazon/chronos-bolt-tiny,1.7895936775088157,0.1058167042693116
monash_tourism_quarterly,amazon/chronos-bolt-tiny,2.095262637810499,0.0710732570354461
monash_tourism_yearly,amazon/chronos-bolt-tiny,4.042821441327848,0.172613367251472
monash_traffic,amazon/chronos-bolt-tiny,0.8836032533767518,0.2574297134210491
monash_weather,amazon/chronos-bolt-tiny,0.8005348255663177,0.13111355494466076
nn5,amazon/chronos-bolt-tiny,0.7228248498869763,0.1816913098894226