Elgato_dark/zeppelin
1
0
Fork 0
mirror of https://github.com/apache/zeppelin synced 2026-05-24 09:38:26 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1
zeppelin/testing
History
Doroszlai, Attila b6e40d4224
[ZEPPELIN-6157] Download artifacts from CDN if available 
## What changes were proposed in this pull request?

Current artifacts available in CDN (`dlcdn.apache.org`) may get removed without notice when new releases appear.  To avoid broken links, build scripts contain permanent addresses from `archive.apache.org`.  But download from `archive.apache.org` may be slow:

```
Thu, 05 Dec 2024 08:39:53 GMT [INFO] --- download:1.6.0:wget (download-sparkr-files) <at> r ---
Thu, 05 Dec 2024 08:39:54 GMT Warning:  No signatures were supplied, skipping file validation
Thu, 05 Dec 2024 08:39:54 GMT [INFO] Read Timeout is set to 60000 milliseconds (apprx 1 minutes)
Thu, 05 Dec 2024 08:45:46 GMT [INFO] Expanding: /home/runner/work/zeppelin/zeppelin/rlang/target/spark-3.5.3-bin-without-hadoop.tgz into /home/runner/work/zeppelin/zeppelin/rlang/target
```

Apache Infra's [`closer.lua` script](https://infra.apache.org/release-download-pages.html#closer) can redirect to CDN or archive, depending on artifact availability.

This change replaces `archive.apache.org` URLs, and one instance of `dist.apache.org`, with their `closer.lua` equivalent.  Output filename has to be specified for `wget` unfortunately.

https://issues.apache.org/jira/browse/ZEPPELIN-6157

## How was this patch tested?

Tried some of the URLs locally, both from CLI (`curl -L --head`) and regular build (`mvn -DskipTests clean package`).

Full CI:
- quick: https://github.com/adoroszlai/zeppelin/actions/runs/12319072153
- frontend: https://github.com/adoroszlai/zeppelin/actions/runs/12319072142
- core: https://github.com/adoroszlai/zeppelin/actions/runs/12319072156

Closes #4901 from adoroszlai/ZEPPELIN-6157.

Signed-off-by: Philipp Dallig <philipp.dallig@gmail.com>
2024-12-19 10:19:39 +01:00
..
resources [HOTFIX] Add bank.csv for integration test (#4617) 2023-06-19 06:59:46 +02:00
downloadLivy.sh [ZEPPELIN-6157] Download artifacts from CDN if available 2024-12-19 10:19:39 +01:00
downloadSpark.sh [ZEPPELIN-6157] Download artifacts from CDN if available 2024-12-19 10:19:39 +01:00
env_python_3.7_with_R.yml Install holoview 1.16, 1.17 drops python 3.7 support see https://github.com/holoviz/holoviews/pull/5695 (#4638) 2023-08-07 09:33:10 +02:00
env_python_3.8_with_R.yml Install holoview 1.16, 1.17 drops python 3.7 support see https://github.com/holoviz/holoviews/pull/5695 (#4638) 2023-08-07 09:33:10 +02:00
env_python_3.9_with_R.yml [ZEPPELIN-5979] Support and use Python 3.9 in default (#4690) 2023-11-15 13:06:01 +08:00
env_python_3.yml [ZEPPELIN-5979] Support and use Python 3.9 in default (#4690) 2023-11-15 13:06:01 +08:00
env_python_3_with_flink_115.yml Install holoview 1.16, 1.17 drops python 3.7 support see https://github.com/holoviz/holoviews/pull/5695 (#4638) 2023-08-07 09:33:10 +02:00
env_python_3_with_flink_116.yml Install holoview 1.16, 1.17 drops python 3.7 support see https://github.com/holoviz/holoviews/pull/5695 (#4638) 2023-08-07 09:33:10 +02:00
env_python_3_with_flink_117.yml [ZEPPELIN-5979] Support and use Python 3.9 in default (#4690) 2023-11-15 13:06:01 +08:00
env_python_3_with_R.yml [ZEPPELIN-5979] Support and use Python 3.9 in default (#4690) 2023-11-15 13:06:01 +08:00
env_python_3_with_R_and_tensorflow.yml [ZEPPELIN-5979] Support and use Python 3.9 in default (#4690) 2023-11-15 13:06:01 +08:00