TDengine/tests/script/sh
Bomin Zhang 876979b5f5
feat[ts-6107]: shared storage (#31552)
* add API to use s3 as shared storage

* support using local file system as shared storage

* upload file to shared storage

* support read, compact and drop

* finish basic mnode & vnode msg processing

* follower sync migration state

* implement mnode transaction, and improve log

* send migration progress msg to dnode to avoid deadlock

* implement following migration

* remove mcount

* avoid redo migration on startup

* avoid follower deadlock when leader is down

* trigger migrate by timer,  avoid compact after migration

* comment out the usage of 'tcs' functions in stream

* change config item prefix from s3 to ss

* change db option prefix from s3 to ss

* rename s3 data struct, function, file to ss

* rename s3 macro to ss

* update s3 sql to ss

* rename remaining s3 items to ss

* check ss configruation, improve s3 retry

* grant object storage -> shared storage,  check ssEnabled

* fix memory leaks

* update build options

* omit sensitive information when dump config

* fix backward compatibility issue

* fix issues found in ci-checks

* fix some failed test cases

* avoid follower timeout and improve log

* fix: follower timeout because migration status not updated

* refuse migration if there's an in progress one

* fix ss test case

* remove garbage files and other minor improvement

* fix failed test cases

* update unit test

* fix failed test case

* fix failed test case

* update document

* update document and fix failed test cases

* fix minor issues in code, test and document

* check new commit after migration task is scheduled

* fix several issus

1. migrate information cannot be dropped sometimes because progress response was put into read queue.
2. memory leak in rare cases
3. data corruption in rare cases
4. failed test case

* add shared storage upgrade tool

* fix compile error
2025-07-14 16:33:53 +08:00
..
dockerbuilder [TD-13408]<test>: move tests in for3.0 (#10598) 2022-03-07 19:25:29 +08:00
massiveTable [test: not repull submodules] 2022-04-26 18:19:01 +08:00
bit_and.c enh: adjust udf example codes 2024-08-08 19:19:23 +08:00
cfg.bat test: add test time count print 2022-06-24 14:04:25 +08:00
cfg.sh fix: alpine support (#19353) 2023-02-10 13:00:55 +08:00
checkAsan.sh tetst:check stream task status in common.py 2024-08-28 20:54:42 +08:00
checkValgrind.bat fix: windows test (#20256) 2023-03-16 10:18:06 +08:00
checkValgrind.sh remove reachable mem check 2023-04-18 20:03:51 +08:00
clear.sh fix: alpine support (#19353) 2023-02-10 13:00:55 +08:00
compile_udf.sh fix: expand scalar param column data to fill the udf datablock 2022-12-13 14:51:11 +08:00
copy_udf.bat test: add test time count print 2022-06-24 14:04:25 +08:00
copy_udf.sh modify copy_udf.sh script to use the right root directory 2022-05-10 16:21:28 +08:00
deploy.bat test: configure debug flag to 135 or 131 in dnodes 2024-04-16 14:27:06 +08:00
deploy.sh feat[ts-6107]: shared storage (#31552) 2025-07-14 16:33:53 +08:00
exec-default.sh fix: alpine support (#19353) 2023-02-10 13:00:55 +08:00
exec-no-random-fail.sh fix: alpine support (#19353) 2023-02-10 13:00:55 +08:00
exec-random-fail.sh fix: alpine support (#19353) 2023-02-10 13:00:55 +08:00
exec.bat fix: windows test (#20256) 2023-03-16 10:18:06 +08:00
exec.sh sim/valgrind: suppress rocks reachables 2023-04-26 16:03:37 +08:00
exec_tarbitrator.sh fix: alpine support (#19353) 2023-02-10 13:00:55 +08:00
extract_avg.c docs: udf function, extract_avg (#30244) 2025-03-18 17:52:21 +08:00
gpd.c fix: expand scalar param column data to fill the udf datablock 2022-12-13 14:51:11 +08:00
ip.sh [TD-13408]<test>: move tests in for3.0 (#10598) 2022-03-07 19:25:29 +08:00
l2norm.c enh: adjust udf example codes 2024-08-08 19:19:23 +08:00
max_vol.c enh: adjust udf example codes 2024-08-08 19:19:23 +08:00
mv_old_data.sh fix: alpine support (#19353) 2023-02-10 13:00:55 +08:00
prepare_pyudf.sh fix: prepare_pyudf.sh is not executable 2023-03-17 15:22:06 +08:00
prepare_udf.sh [TD-13408]<test>: move tests in for3.0 (#10598) 2022-03-07 19:25:29 +08:00
pybitand.py enhance: add taospyudf test and run it in CI 2023-03-16 19:06:18 +08:00
pycumsum.py enhance: improve document 2023-05-25 11:13:05 +08:00
pyl2norm.py enhance: add taospyudf test and run it in CI 2023-03-16 19:06:18 +08:00
scalar_demo.lua [TD-13408]<test>: move tests in for3.0 (#10598) 2022-03-07 19:25:29 +08:00
sigint_stop_dnodes.sh test: close all dnodes when tsim execution is complete 2022-11-21 11:01:44 +08:00
stop_dnodes.bat tetst:sleep 2 after stop taosd in windows ci 2024-09-03 19:37:22 +08:00
stop_dnodes.sh unify among LINUX and MacOSX 2025-01-04 10:52:05 +08:00