Elgato_dark/chronos-forecasting
1
0
Fork 0
mirror of https://github.com/amazon-science/chronos-forecasting synced 2026-05-24 10:08:33 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
chronos-forecasting/scripts/evaluation/results/chronos-t5-base-zero-shot.csv

29 lines
2.1 KiB
Text
Raw Permalink Normal View History

:zap: Add support for Chronos-Bolt models (#204) *Issue #, if available:* N/A *Description of changes:* This PR adds support for Chronos-Bolt models. TODOs: - [x] Update evaluation script - [x] Fix and add tests for Bolt - [x] Update docstrings - [x] Update README example and mention Chronos-Bolt - [x] Update results bar plot in README - [x] Add versions for libraries in `pyproject.toml` - [x] Check that the training and eval scripts work - [x] Change `autogluon` -> `amazon` in model names Post Merge: - [ ] Update Citation style in README, both Github and HuggingFace repos - [ ] Remove note about AutoGluon - [ ] Update READMEs of original Chronos models to refer to Chronos-Bolt NOTE: To be merged after Chronos-Bolt models are available under the `amazon` namespace on HF. By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice. --------- Co-authored-by: Abdul Fatir Ansari <ansarnd@amazon.de> Co-authored-by: Caner Turkmen <turkmen.ac@gmail.com> Co-authored-by: Lorenzo Stella <stellalo@amazon.com>
2024-11-26 16:47:14 +00:00
dataset,model,MASE,WQL
ETTh,amazon/chronos-t5-base,0.7653491494991778,0.08087267701042929
ETTm,amazon/chronos-t5-base,0.7737006634032871,0.07008650633028274
dominick,amazon/chronos-t5-base,0.8194044957573132,0.33201307438298133
ercot,amazon/chronos-t5-base,0.5014399265038706,0.013589435745554596
exchange_rate,amazon/chronos-t5-base,2.055616906406159,0.011066070028466317
m4_quarterly,amazon/chronos-t5-base,1.2253036947743137,0.08327936201395683
m4_yearly,amazon/chronos-t5-base,3.639991540990927,0.13539258375263963
m5,amazon/chronos-t5-base,0.9391874615167101,0.5867234116216755
monash_australian_electricity,amazon/chronos-t5-base,1.2944069383163321,0.07070604202031877
monash_car_parts,amazon/chronos-t5-base,0.9071940271035218,1.077797124337994
monash_cif_2016,amazon/chronos-t5-base,0.9840747802099565,0.011825556826558836
monash_covid_deaths,amazon/chronos-t5-base,42.68503365359237,0.042229910495746356
monash_fred_md,amazon/chronos-t5-base,0.4857773806790164,0.021204829049512715
monash_hospital,amazon/chronos-t5-base,0.7053005021431749,0.05630687524507516
monash_m1_monthly,amazon/chronos-t5-base,1.1153039466137842,0.12724419775326076
monash_m1_quarterly,amazon/chronos-t5-base,1.746093728928804,0.1123583549291933
monash_m1_yearly,amazon/chronos-t5-base,4.401291522370069,0.18541586641719554
monash_m3_monthly,amazon/chronos-t5-base,0.8627172231908679,0.09640536232169555
monash_m3_quarterly,amazon/chronos-t5-base,1.1696030904401578,0.07392876900131434
monash_m3_yearly,amazon/chronos-t5-base,3.1298600218573775,0.1486674447940158
monash_nn5_weekly,amazon/chronos-t5-base,0.9334860602210187,0.08972736821598823
monash_tourism_monthly,amazon/chronos-t5-base,1.7937702435879332,0.10260220444264027
monash_tourism_quarterly,amazon/chronos-t5-base,1.7791494997972261,0.06852507950474919
monash_tourism_yearly,amazon/chronos-t5-base,3.8359926053603197,0.20722699382964643
monash_traffic,amazon/chronos-t5-base,0.8015262383138622,0.25565153982140926
monash_weather,amazon/chronos-t5-base,0.8159511190589147,0.13802320967454584
nn5,amazon/chronos-t5-base,0.5927076179914024,0.1630476065585159
Reference in a new issue Copy permalink