chronos-forecasting/scripts/evaluation/configs/in-domain.yaml
Abdul Fatir fead4ecbca
Add evaluation script (#134)
*Description of changes:* This PR adds configs and a script to evaluate
Chronos models in the same way as described in the paper.


By submitting this pull request, I confirm that you can use, modify,
copy, and redistribute this contribution, under the terms of your
choice.

Co-authored-by: Abdul Fatir Ansari <ansarnd@amazon.de>
2024-06-27 17:13:35 +02:00

78 lines
1.9 KiB
YAML

# Backtest configs for the 15 "in-domain" datasets.
# The training portion of these datasets was part of the
# training corpus for Chronos models.
- name: electricity_15min
hf_repo: autogluon/chronos_datasets
offset: -5376
prediction_length: 24
num_rolls: 1
- name: monash_electricity_hourly
hf_repo: autogluon/chronos_datasets
offset: -24
prediction_length: 24
num_rolls: 1
- name: monash_electricity_weekly
hf_repo: autogluon/chronos_datasets
offset: -8
prediction_length: 8
num_rolls: 1
- name: monash_kdd_cup_2018
hf_repo: autogluon/chronos_datasets
offset: -48
prediction_length: 48
num_rolls: 1
- name: m4_daily
hf_repo: autogluon/chronos_datasets
offset: -14
prediction_length: 14
num_rolls: 1
- name: m4_hourly
hf_repo: autogluon/chronos_datasets
offset: -48
prediction_length: 48
num_rolls: 1
- name: m4_monthly
hf_repo: autogluon/chronos_datasets
offset: -18
prediction_length: 18
num_rolls: 1
- name: m4_weekly
hf_repo: autogluon/chronos_datasets
offset: -13
prediction_length: 13
num_rolls: 1
- name: monash_pedestrian_counts
hf_repo: autogluon/chronos_datasets
offset: -48
prediction_length: 48
num_rolls: 1
- name: taxi_30min
hf_repo: autogluon/chronos_datasets
offset: -48
prediction_length: 48
num_rolls: 1
- name: uber_tlc_hourly
hf_repo: autogluon/chronos_datasets
offset: -24
prediction_length: 24
num_rolls: 1
- name: uber_tlc_daily
hf_repo: autogluon/chronos_datasets
offset: -7
prediction_length: 7
num_rolls: 1
- name: monash_rideshare
hf_repo: autogluon/chronos_datasets
offset: -24
prediction_length: 24
num_rolls: 1
- name: monash_temperature_rain
hf_repo: autogluon/chronos_datasets
offset: -30
prediction_length: 30
num_rolls: 1
- name: monash_london_smart_meters
hf_repo: autogluon/chronos_datasets
offset: -48
prediction_length: 48
num_rolls: 1