chronos-forecasting/scripts/evaluation/results/chronos-t5-large-zero-shot.csv
Abdul Fatir 72ab64166c
Add support for Chronos-Bolt models (#204)
*Issue #, if available:* N/A

*Description of changes:* This PR adds support for Chronos-Bolt models.

TODOs:

- [x] Update evaluation script
- [x] Fix and add tests for Bolt
- [x] Update docstrings
- [x] Update README example and mention Chronos-Bolt
- [x] Update results bar plot in README
- [x] Add versions for libraries in `pyproject.toml`
- [x] Check that the training and eval scripts work
- [x] Change `autogluon` -> `amazon` in model names

Post Merge:
- [ ] Update Citation style in README, both Github and HuggingFace repos
- [ ] Remove note about AutoGluon
- [ ] Update READMEs of original Chronos models to refer to Chronos-Bolt

NOTE: To be merged after Chronos-Bolt models are available under the
`amazon` namespace on HF.

By submitting this pull request, I confirm that you can use, modify,
copy, and redistribute this contribution, under the terms of your
choice.

---------

Co-authored-by: Abdul Fatir Ansari <ansarnd@amazon.de>
Co-authored-by: Caner Turkmen <turkmen.ac@gmail.com>
Co-authored-by: Lorenzo Stella <stellalo@amazon.com>
2024-11-26 17:47:14 +01:00

28 lines
2.1 KiB
Text

dataset,model,MASE,WQL
ETTh,amazon/chronos-t5-large,0.78160443631164,0.07884375667736107
ETTm,amazon/chronos-t5-large,0.7325919639389967,0.06656858270921162
dominick,amazon/chronos-t5-large,0.8200108271155829,0.3311575649734524
ercot,amazon/chronos-t5-large,0.6050812633742764,0.01822996942395577
exchange_rate,amazon/chronos-t5-large,2.3439287001928744,0.014841231672174684
m4_quarterly,amazon/chronos-t5-large,1.2169666607868148,0.08235162400898562
m4_yearly,amazon/chronos-t5-large,3.5524979814018947,0.1325675848907479
m5,amazon/chronos-t5-large,0.9422990989146737,0.585615077637479
monash_australian_electricity,amazon/chronos-t5-large,1.480849838497958,0.07973968848149568
monash_car_parts,amazon/chronos-t5-large,0.901547374873302,1.0467398096496576
monash_cif_2016,amazon/chronos-t5-large,0.9906388185665337,0.011966178555329998
monash_covid_deaths,amazon/chronos-t5-large,44.07354193681227,0.06108999981222163
monash_fred_md,amazon/chronos-t5-large,0.5184400880318044,0.01675533888399231
monash_hospital,amazon/chronos-t5-large,0.7055308474630898,0.0552450850258613
monash_m1_monthly,amazon/chronos-t5-large,1.0888995301234758,0.12729911122909737
monash_m1_quarterly,amazon/chronos-t5-large,1.7477134564031453,0.10618253695380094
monash_m1_yearly,amazon/chronos-t5-large,4.250667049416348,0.17128879333643188
monash_m3_monthly,amazon/chronos-t5-large,0.8559326975903808,0.09572577431396007
monash_m3_quarterly,amazon/chronos-t5-large,1.1867267751420676,0.07449254281607631
monash_m3_yearly,amazon/chronos-t5-large,3.0239493021840635,0.14814710375646464
monash_nn5_weekly,amazon/chronos-t5-large,0.9228721852437364,0.08948447200571868
monash_tourism_monthly,amazon/chronos-t5-large,1.7304427846580348,0.09983169221760163
monash_tourism_quarterly,amazon/chronos-t5-large,1.6437184365114073,0.0690906057781915
monash_tourism_yearly,amazon/chronos-t5-large,3.6268503118928535,0.17732007043832695
monash_traffic,amazon/chronos-t5-large,0.7985975530866148,0.25313515740581755
monash_weather,amazon/chronos-t5-large,0.8187388457436171,0.1387756772600068
nn5,amazon/chronos-t5-large,0.5755260854173723,0.15733693855465292