mirror of
https://github.com/amazon-science/chronos-forecasting
synced 2026-05-23 09:39:35 +00:00
*Issue #, if available:* N/A *Description of changes:* This PR adds support for Chronos-Bolt models. TODOs: - [x] Update evaluation script - [x] Fix and add tests for Bolt - [x] Update docstrings - [x] Update README example and mention Chronos-Bolt - [x] Update results bar plot in README - [x] Add versions for libraries in `pyproject.toml` - [x] Check that the training and eval scripts work - [x] Change `autogluon` -> `amazon` in model names Post Merge: - [ ] Update Citation style in README, both Github and HuggingFace repos - [ ] Remove note about AutoGluon - [ ] Update READMEs of original Chronos models to refer to Chronos-Bolt NOTE: To be merged after Chronos-Bolt models are available under the `amazon` namespace on HF. By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice. --------- Co-authored-by: Abdul Fatir Ansari <ansarnd@amazon.de> Co-authored-by: Caner Turkmen <turkmen.ac@gmail.com> Co-authored-by: Lorenzo Stella <stellalo@amazon.com>
2.1 KiB
2.1 KiB
| 1 | dataset | model | MASE | WQL |
|---|---|---|---|---|
| 2 | ETTh | amazon/chronos-bolt-mini | 0.8057126710113404 | 0.07740387596411452 |
| 3 | ETTm | amazon/chronos-bolt-mini | 0.6100793941108849 | 0.05129333450944573 |
| 4 | dominick | amazon/chronos-bolt-mini | 0.8664152477208024 | 0.3499696999160997 |
| 5 | ercot | amazon/chronos-bolt-mini | 0.6871250728215426 | 0.02448804863744021 |
| 6 | exchange_rate | amazon/chronos-bolt-mini | 1.3520551553333662 | 0.00934663373172766 |
| 7 | m4_quarterly | amazon/chronos-bolt-mini | 1.2569644266281508 | 0.07833787023275976 |
| 8 | m4_yearly | amazon/chronos-bolt-mini | 3.7611003052413796 | 0.12931927951165456 |
| 9 | m5 | amazon/chronos-bolt-mini | 0.9188876472137485 | 0.5661303206519673 |
| 10 | monash_australian_electricity | amazon/chronos-bolt-mini | 0.8823559450287066 | 0.04493688824488474 |
| 11 | monash_car_parts | amazon/chronos-bolt-mini | 0.8604081423647779 | 1.0041876404811494 |
| 12 | monash_cif_2016 | amazon/chronos-bolt-mini | 1.0762361363763873 | 0.017641893717784202 |
| 13 | monash_covid_deaths | amazon/chronos-bolt-mini | 38.83915011538576 | 0.06098317835750057 |
| 14 | monash_fred_md | amazon/chronos-bolt-mini | 0.6169859211923081 | 0.03256236965040934 |
| 15 | monash_hospital | amazon/chronos-bolt-mini | 0.6924431064606051 | 0.05766349075348645 |
| 16 | monash_m1_monthly | amazon/chronos-bolt-mini | 1.147893030263777 | 0.13270222658510553 |
| 17 | monash_m1_quarterly | amazon/chronos-bolt-mini | 1.8662100001165818 | 0.09846363409254102 |
| 18 | monash_m1_yearly | amazon/chronos-bolt-mini | 5.319154632748303 | 0.16167328827180308 |
| 19 | monash_m3_monthly | amazon/chronos-bolt-mini | 0.8758452776118432 | 0.09493431248614057 |
| 20 | monash_m3_quarterly | amazon/chronos-bolt-mini | 1.3555175243802005 | 0.07808062465932723 |
| 21 | monash_m3_yearly | amazon/chronos-bolt-mini | 3.605769430055575 | 0.15711010456482008 |
| 22 | monash_nn5_weekly | amazon/chronos-bolt-mini | 0.9347141924977239 | 0.08522899825844342 |
| 23 | monash_tourism_monthly | amazon/chronos-bolt-mini | 1.649587479665881 | 0.0979648261309891 |
| 24 | monash_tourism_quarterly | amazon/chronos-bolt-mini | 1.8471553663088986 | 0.06501077791766902 |
| 25 | monash_tourism_yearly | amazon/chronos-bolt-mini | 3.9932920493826245 | 0.1743539122097316 |
| 26 | monash_traffic | amazon/chronos-bolt-mini | 0.8355442361271347 | 0.24351051123330386 |
| 27 | monash_weather | amazon/chronos-bolt-mini | 0.800013628350165 | 0.13041050756802045 |
| 28 | nn5 | amazon/chronos-bolt-mini | 0.611917632501032 | 0.1570111102680171 |