chronos-forecasting/scripts/evaluation/results/chronos-t5-large-zero-shot.csv
Abdul Fatir 72ab64166c
Add support for Chronos-Bolt models (#204)
*Issue #, if available:* N/A

*Description of changes:* This PR adds support for Chronos-Bolt models.

TODOs:

- [x] Update evaluation script
- [x] Fix and add tests for Bolt
- [x] Update docstrings
- [x] Update README example and mention Chronos-Bolt
- [x] Update results bar plot in README
- [x] Add versions for libraries in `pyproject.toml`
- [x] Check that the training and eval scripts work
- [x] Change `autogluon` -> `amazon` in model names

Post Merge:
- [ ] Update Citation style in README, both Github and HuggingFace repos
- [ ] Remove note about AutoGluon
- [ ] Update READMEs of original Chronos models to refer to Chronos-Bolt

NOTE: To be merged after Chronos-Bolt models are available under the
`amazon` namespace on HF.

By submitting this pull request, I confirm that you can use, modify,
copy, and redistribute this contribution, under the terms of your
choice.

---------

Co-authored-by: Abdul Fatir Ansari <ansarnd@amazon.de>
Co-authored-by: Caner Turkmen <turkmen.ac@gmail.com>
Co-authored-by: Lorenzo Stella <stellalo@amazon.com>
2024-11-26 17:47:14 +01:00

2.1 KiB

1datasetmodelMASEWQL
2ETThamazon/chronos-t5-large0.781604436311640.07884375667736107
3ETTmamazon/chronos-t5-large0.73259196393899670.06656858270921162
4dominickamazon/chronos-t5-large0.82001082711558290.3311575649734524
5ercotamazon/chronos-t5-large0.60508126337427640.01822996942395577
6exchange_rateamazon/chronos-t5-large2.34392870019287440.014841231672174684
7m4_quarterlyamazon/chronos-t5-large1.21696666078681480.08235162400898562
8m4_yearlyamazon/chronos-t5-large3.55249798140189470.1325675848907479
9m5amazon/chronos-t5-large0.94229909891467370.585615077637479
10monash_australian_electricityamazon/chronos-t5-large1.4808498384979580.07973968848149568
11monash_car_partsamazon/chronos-t5-large0.9015473748733021.0467398096496576
12monash_cif_2016amazon/chronos-t5-large0.99063881856653370.011966178555329998
13monash_covid_deathsamazon/chronos-t5-large44.073541936812270.06108999981222163
14monash_fred_mdamazon/chronos-t5-large0.51844008803180440.01675533888399231
15monash_hospitalamazon/chronos-t5-large0.70553084746308980.0552450850258613
16monash_m1_monthlyamazon/chronos-t5-large1.08889953012347580.12729911122909737
17monash_m1_quarterlyamazon/chronos-t5-large1.74771345640314530.10618253695380094
18monash_m1_yearlyamazon/chronos-t5-large4.2506670494163480.17128879333643188
19monash_m3_monthlyamazon/chronos-t5-large0.85593269759038080.09572577431396007
20monash_m3_quarterlyamazon/chronos-t5-large1.18672677514206760.07449254281607631
21monash_m3_yearlyamazon/chronos-t5-large3.02394930218406350.14814710375646464
22monash_nn5_weeklyamazon/chronos-t5-large0.92287218524373640.08948447200571868
23monash_tourism_monthlyamazon/chronos-t5-large1.73044278465803480.09983169221760163
24monash_tourism_quarterlyamazon/chronos-t5-large1.64371843651140730.0690906057781915
25monash_tourism_yearlyamazon/chronos-t5-large3.62685031189285350.17732007043832695
26monash_trafficamazon/chronos-t5-large0.79859755308661480.25313515740581755
27monash_weatheramazon/chronos-t5-large0.81873884574361710.1387756772600068
28nn5amazon/chronos-t5-large0.57552608541737230.15733693855465292