Pan Wei
bcc25e56bc
feat: new stream ( #31678 )
...
* fix: windows compile issue
* test: add vtable cases (#31829 )
* fix: windows compile issues
* test:add test cases
* fix: windows compile issue
* case: em-4 stream case submit
* test: stream4_sub1 found bug2
* test: submit test_scene_meters_bug2.py
* add stream parameters example
* feat: [TS-6100] Do not translate const value as column.
* Feat/ts 6100 3.0 zlv (#31747 )
* modify asan exampel
* modify asan exampel
* add example
* add example
* modify case example
---------
Co-authored-by: zelv01 <1101510017@qq.com>
* feat(stream): fix memory leak
* modify sliding example
* test: update test case.
* feat(stream): fix conflicts
* fix: add offset case 10a 10s 10m 10h 10d
* feat(stream): fix conflicts
* chore(stream): rename case name #TS-6100
* add case
* modify example
* fix: windows compile issues
* fix: data null check
* feat: [TS-6100] Forbid where when using %%trows (#31827 )
* feat: [TS-6100] Forbid where when using %%trows
* test: update cases
* feat: [TS-6100] Fix leaks.
---------
Co-authored-by: Simon Guan <guanshengliang@qq.com>
* test: reproduce bugs
* test: update test case.
* test: update test case.
* feat: [TS-6100] Fix leaks.
* test: add cases
* Feat/ts 6100 3.0.pw10 (#31841 )
* enh: add operator reset func
* fix: merge join reset issue
* fix: memory issues
* fix: add debug assert
* fix: memory issues
* fix: memory leak
* fix: memory issues
* fix taos log miss
* fix: case issue
* fix: case issue
* fix: case issues
* fix: drop dnode issue
* fix: memory issues
* fix: memory issues
* fix: memory leak issues
* fix: recalculate time range issue
* fix: add debug log
* fix: memory issues
* fix: enable case asan
* Update streamlist_for_ci.task
* fix: case asan issue
* fix: stream name issue
* fix: external window compile issues
* fix: deploy memory issue
* fix: ahandle issue
* fix: ahandle issue
* fix: ahandle issue
* fix: virtual table reader list issue
* fix: log info
* fix: msg error
* fix: virtual table addr list issue
* fix: memory issues
* fix: memory leak issue
* fix: memory issues
* fix: memory free issues
* fix: memory issues
* fix: snode deploy issue
* fix: mnode reader issue
* fix: memory issues
* fix: add debug test
* enh: add ignore nodata trigger
* fix: memory leaks
* fix: configuration issue
* fix: memory issue
* fix: external window issue
* fix: external window issues
* fix: external window placeholder issue
* fix: placeholder function init issues
* fix: memory leak issue
* fix: add debug log
* fix: compile issues
* fix: double free issue
* fix: runner addr update issue
* fix: msg rsp issue
* fix: external window reset issue
* fix: configuration issue
* fix: deploy msg issue
* fix: compile issue
---------
Co-authored-by: huohong <sallyhuo@taosdata.com>
* test: reproduce bugs
* fix: add sliding interval combine case
* test: add cases
* test: add recalc test.
* test: reproduce bugs
* case : add vt ts is null check
* modify case
* bug: submit test_idmp_meters_bug3.py
* test: add test for recalc.
* test: add cases
* fix: error code check
* test: add cases
* fix(stream): scan wal with schema in that version
* add case
* test: add cases
* test: update test case.
* fix: windows compile issues
* add case
* test: add cases (#31845 )
* modify case
* fix: reset interpPrev
* test: add test_idmp_meters bug4 and bug3
* add case
* fix(stream): opti wal interface
* fix: remove test_idmp_meters_bug5.py
* test: add cases
* fix(stream): fix ts data fetch for virtual tables
* cancel asan case
* test: update test case.
* test: update test case.
* add case
* test: add cases
* test: add cases
* test: add case test_idmp_meters_bug5.py
* test: update test case.
* fix(stream): tmq error
* test: add cases
* feat: [TS-6100] Restore deleted code in mndSma.c since they are still in use.
* fix(stream): optimize val scan logic
* test: add test_recalc_expired_time.py to ci.
* test: update test case.
* test: update test case.
* feat: [TS-6100] Fix fill range check
* fix(stream): optimize val scan logic
* add case
* test: modify for partition by %%1
* test: add fun case stream4_sub7
* fix(stream): optimize val scan logic
* add case
* feat: [TS-6100] Rename OPTIONS to STREAM_OPTIONS.
* test: add test for recalc.
* test: use stream_options.
* fix: some cases error.
* test: remove recalc from ci.
* fix: ci case issues (#31880 )
* enh: add operator reset func
* fix: merge join reset issue
* fix: memory issues
* fix: add debug assert
* fix: memory issues
* fix: memory leak
* fix: memory issues
* fix taos log miss
* fix: case issue
* fix: case issue
* fix: case issues
* fix: drop dnode issue
* fix: memory issues
* fix: memory issues
* fix: memory leak issues
* fix: recalculate time range issue
* fix: add debug log
* fix: memory issues
* fix: enable case asan
* Update streamlist_for_ci.task
* fix: case asan issue
* fix: stream name issue
* fix: external window compile issues
* fix: deploy memory issue
* fix: ahandle issue
* fix: ahandle issue
* fix: ahandle issue
* fix: virtual table reader list issue
* fix: log info
* fix: msg error
* fix: virtual table addr list issue
* fix: memory issues
* fix: memory leak issue
* fix: memory issues
* fix: memory free issues
* fix: memory issues
* fix: snode deploy issue
* fix: mnode reader issue
* fix: memory issues
* fix: add debug test
* enh: add ignore nodata trigger
* fix: memory leaks
* fix: configuration issue
* fix: memory issue
* fix: external window issue
* fix: external window issues
* fix: external window placeholder issue
* fix: placeholder function init issues
* fix: memory leak issue
* fix: add debug log
* fix: compile issues
* fix: double free issue
* fix: runner addr update issue
* fix: msg rsp issue
* fix: external window reset issue
* fix: configuration issue
* fix: deploy msg issue
* fix: compile issue
* fix: external window idx issue
* fix: ci issues
---------
Co-authored-by: huohong <sallyhuo@taosdata.com>
* fix(stream): fix compilation error
* fix(stream): optimize val scan logic
* test:add test cases
* test: modify case
* fix: external agg error
* test(stream): tobacco scene testing #TD-36514
* test: add stream cases (#31885 )
* fix: windows compile issue
* fix: calc timerange
* fix: windows compile issue
* modify case
* fix(stream): compile error
* test: remove one debug test case file
* test: modify
* test: add test cases
* test: reproduce bugs
* test: reproduce bugs
* feat: [TS-6100] Placeholder function should only appera in SELECT and… (#31868 )
* feat: [TS-6100] Placeholder function should only appera in SELECT and WHERE and FROM.
* test: update case
---------
Co-authored-by: Simon Guan <guanshengliang@qq.com>
* add example
* add example
* modify case example
* modify case
* test:alter sql
* test: add stream5 case
* fix(stream): get schema error with version
* test: add delete recalc test py.
* test: remove bug cases
* test: stream5 case test passed
* test: add state cases (#31893 )
* fix(stream): compile error
* test: modify case
* test: add cases
* test: add test.
* test: update test case.
* chore(test): fix case err
* test: update test case.
* fix: align data get
* fix(stream): fix row index of datablock written into data cache
* fix: put align data
* test: update test case.
* test: add test cases for virtual table
* chore(test): fix case err #TD-36514
* add case
* test: add test for water mark.
* test: add meters bug6 for stream5
* test: add cases (#31903 )
* test: add test for recalc.
* feat: [TS-6100] %%trows can only be used when event type is window close.
* test: add precision of database for ms/us/ns
* modify case
* add case
* add case
* test: add test to ci.
* modify case
* fix: ci case issues (#31904 )
* enh: add operator reset func
* fix: merge join reset issue
* fix: memory issues
* fix: add debug assert
* fix: memory issues
* fix: memory leak
* fix: memory issues
* fix taos log miss
* fix: case issue
* fix: case issue
* fix: case issues
* fix: drop dnode issue
* fix: memory issues
* fix: memory issues
* fix: memory leak issues
* fix: recalculate time range issue
* fix: add debug log
* fix: memory issues
* fix: enable case asan
* Update streamlist_for_ci.task
* fix: case asan issue
* fix: stream name issue
* fix: external window compile issues
* fix: deploy memory issue
* fix: ahandle issue
* fix: ahandle issue
* fix: ahandle issue
* fix: virtual table reader list issue
* fix: log info
* fix: msg error
* fix: virtual table addr list issue
* fix: memory issues
* fix: memory leak issue
* fix: memory issues
* fix: memory free issues
* fix: memory issues
* fix: snode deploy issue
* fix: mnode reader issue
* fix: memory issues
* fix: add debug test
* enh: add ignore nodata trigger
* fix: memory leaks
* fix: configuration issue
* fix: memory issue
* fix: external window issue
* fix: external window issues
* fix: external window placeholder issue
* fix: placeholder function init issues
* fix: memory leak issue
* fix: add debug log
* fix: compile issues
* fix: double free issue
* fix: runner addr update issue
* fix: msg rsp issue
* fix: external window reset issue
* fix: configuration issue
* fix: deploy msg issue
* fix: compile issue
* fix: external window idx issue
* fix: ci issues
* fix: ci case issues
* fix: drop dnode issue
---------
Co-authored-by: huohong <sallyhuo@taosdata.com>
* fix(stream): ci error
* test: update test case.
* feat: [TS-6100] Disable some failed UT.
* feat: [TS-6100] Fix virtual table
* test: add bug 5.
* test: add test delete recalc to ci.
* test: add bug 6.
* test(stream): tobacco scene #TD-36514
* fix: reqCids,reqCols memory leak in SSTriggerRealtimeContext
Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>
* test: add case stream6
* fix(stream): implement some pending features in trigger task
* modify case
* modify case
* fix: case issues
* modify case
* test: add recalc for warter mark.
* fix(stream): fix count window trigger of virtual tables
* fix(stream): memory leak
* test: fix run err.
* test: add stream6 bug7
* fix: adjust format
* test(stream): tobacco scene testing #TD-36514
* test: change bug7 with update window1 and 2
* test: add test bug 7.
* case: restore write 3 window
* fix: windows compile issue
* fix: notify
* test: add cases
* modify case
* test: update test case.
* test(stream): toobacco scene testing #TD-36514
---------
Co-authored-by: Simon Guan <slguan@taosdata.com>
Co-authored-by: plum-lihui <huili@taosdata.com>
Co-authored-by: Alex Duan <417921451@qq.com>
Co-authored-by: zelv01 <1101510017@qq.com>
Co-authored-by: Jing Sima <simondominic9997@outlook.com>
Co-authored-by: xiangyang guo <66111494+happyguoxy@users.noreply.github.com>
Co-authored-by: wangmm0220 <wangmm0220@gmail.com>
Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: zyyang90 <zyyang@taosdata.com>
Co-authored-by: Alex Duan <51781608+DuanKuanJun@users.noreply.github.com>
Co-authored-by: facetosea <285808407@qq.com>
Co-authored-by: Simon Guan <guanshengliang@qq.com>
Co-authored-by: huohong <sallyhuo@taosdata.com>
Co-authored-by: Li Hui <52318143+plum-lihui@users.noreply.github.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: xiao-77 <berylbao@taosdata.com>
Co-authored-by: Zhixiao Bao <62235797+xiao-77@users.noreply.github.com>
Co-authored-by: happyguoxy <happy_guoxy@163.com>
Co-authored-by: Tony Zhang <34825804+Tony2h@users.noreply.github.com>
Co-authored-by: Tony Zhang <tonyzhang@taosdata.com>
2025-07-16 14:42:16 +08:00
dongming chen
119e57756a
enh: enables automatic detection and repair of WAL file corruption during startup ( #31565 )
2025-07-11 15:56:07 +08:00
Simon Guan
556e426880
Merge branch 'main' into merge/mainto3.0
2025-05-17 12:55:32 +08:00
Zhixiao Bao
e81dd1ec28
fix: double close wal meta file. ( #31083 )
2025-05-15 14:44:44 +08:00
Zhixiao Bao
7ceadeea8f
fix: double close wal meta file. ( #31059 )
2025-05-14 16:55:46 +08:00
WANG MINGMING
ddd32e23d9
fix(tmq): init tmq handle error if snapshotVer is out of range ( #30859 )
2025-04-24 09:50:51 +08:00
dongming chen
2502086b71
fix: [TS-5926] change wal read file log ( #30416 )
2025-03-24 21:30:09 +08:00
Simon Guan
ddc05f168e
refactor: adjust the log to track the data writing process on the server via QID ( #30195 )
...
* refactor: adjust wal log infos
* refactor: adjust some log's level
* refactor: adjust some log's level
* fix: add traceId for sync module
* refactor: adjust log level
* refactor: adjust log level
* refactor: adjust log levels
* refactor: adjust log levels
* refactor: adjust log levels
* refactor: adjust log levels
* refactor: adjust log levels
* refactor: adjust log levels
* refactor: adjust log levels
* fix: compile errors in windows
* refactor: minor changes
2025-03-18 16:21:44 +08:00
Kaili Xu
13f9bddf3d
feat: support customized taos/taosd ( #29736 )
...
* feat: support TDAcoreOS
* chore: cmake options for TD_ACORE
* chore: disable lemon for TD_ACORE
* chore: add lzma2 and msvcregex
* chore: cmake for lzma2
* chore: adapt for TD_ACORE
* chore: adapt strcasecmp for TD_ACORE
* chore: adapt for geos/threadName
* chore: build adapt for TD_ACORE
* chore: build adapt for TD_ACORE
* chore: build adapt for TD_ACORE
* chore: build adapt for TD_ACORE
* chore: build adapt for TD_ACORE termio
* chore: refact transComm.h for TD_ACORE
* chore: refact transportInt.h for TD_ACORE
* chore: refact trans.c for TD_ACORE
* chore: refact trpc.h for TD_ACORE
* chore: refact transCli.c/transComm.c/transSvr.c for TD_ACORE
* chore: refact uv.h for TD_ACORE
* chore: refact geosWrapper.h for TD_ACORE
* chore: refact token/builtins/udf for TD_ACORE
* chore: refact rocks for TD_ACORE
* chore: refact tsdbCache.c for TD_ACORE, use LRU cache for last/last_row, not use rocksdb
* chore: refact FAIL to _ERR to solve conflicts for TD_ACORE
* chore: restore lemon.c/lempar.c
* chore: support build lemon for TD_ACORE
* chore: refact trpc and siginfo_t for TD_ACORE
* chore: refact timezone for TD_ACORE
* chore: refact lz4 for TD_ACORE
* chore: refact TD_ACORE to make compile pass
* chore: code optimization for TD_ASTRA
* feat: support run taos with taosd integrated
* feat: support invoke taos shell
* feat: support invoke taos shell
* feat: support invoke taos shell
* chore: code optimization
* chore: fix undefined reference problem os TD_ASTRA
* chore: resolve compile problem for TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix undefined reference problem os TD_ASTRA
* chore: fix getpid
* chore: fix typo
* chore: set stack size and ajust min pack size for TD_ASTRA
* chore: fix pthread create parameters
* chore: chmod adapt for TD_ASTRA
* chore: fix trans compile problem
* chore: adapt chmod for TD_ASTRA
* chore: byte alignment for TD_ASTRA
* chore: more code for adaption of TD_ASTRA
* chore: more code for adaption of TD_ASTRA
* chore: more code for adaption of TD_ASTRA
* chore: byte alignment for TD_ASTRA
* chore: conditional compile option
* chore: adapt for TD_ASTRA
* chore: adjust taosPId and msvcregex for TD_ASTRA
* chore: log dir separator for wal build name
* chore: fix type of pointer parameter
* chore: fix compile problem of tsdbGetS3Size
* enh: get last ver from wal log for TD_ASTRA
* enh: refact wal meta ver
* enh: refact wal meta ver
* fix: typo of taosUcs4Compare
* enh: process return value of CI
* chore: more code for TD_ASTRA adaption
* chore: return value of taosCloseFile in walMeta.c
* chore: fix compile problem
* chore: fix compile problem of TD_ASTRA
* fix: update macro for tq and stream task
* chore: code optimization for TD_ASTRA
* chore: restore create log and init cfg interface
* chore: restore strncasecmp and strcasecmp
* fix: adjust the field position of SDataBlockInfo
* fix: pragma pack min size
* fix: pragma pack min size
* chore: more code for TD_ASTRA adaption
* fix: type of parameters
* chore: adapt strncasecmp and strcasecmp for TD_ASTRA
* chore: restore interface of init log
* enh: pack push optimization
* fix: taos init cfg
* add astra support
* fix: fetch the value of suid
* chore: switch of build with udf
* add temp code
* chore: more code for TD_ASTRA adaption
* chore: add macro ERRNO to replace errno
* chore: bytes align for TD_ASTRA
* fix: remove obsolete codes
* enh: support USE_UDF macro
* fix compile error
* fix: resolve redefinition problem
* fix: compile problem of log.cpp
* fix: compile problem of osTimezone
* fix: resolve compile problem of udf
* fix: pragma definition on windows
* fix: ucs4 and stpncpy for TD_ASTRA
* fix: memory align problem for TD_ASTRA
* enh: solve memory leak for TD_ASTRA_RPC
* fix: compile problem of taosSetInt64Aligned
* fix: restore mndSubscribe.c
* fix: scalar for udf
* chore: code adaption for TD_ASTRA
* chore: code optimization for TD_ASTRA
* fix: typo of add definition
* fix: typo of macro in tudf.h
* chore: remove void to make CI pass
* enh: move macro from cmake.platform to cmake.options
* enh: byte align for hash node and error code
* chore: restore the size for lru cache
* enh: restore some code about pack push
* chore: restore the pack push in tmsg.h
* fix: add macro of pack pop for windows
---------
Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 13:32:13 +08:00
xiao-77
b378d83194
Fix review errors for error return.
2024-12-31 15:12:53 +08:00
xiao-77
bc95f82373
add ut .
2024-12-30 17:45:43 +08:00
xiao-77
eb710ebc5f
Fix meta logic error.
2024-12-30 17:45:29 +08:00
xiao-77
fd7204b04b
Fix logic error.
2024-12-30 17:45:19 +08:00
xiao-77
5c192cbcb5
Refator walMeta.c.
2024-12-30 17:45:07 +08:00
xiao-77
1a753fedc7
Fix review errors.
2024-12-26 15:08:18 +08:00
xiao-77
9fea6fd295
Fix some review errors.
2024-12-26 14:58:09 +08:00
xiao-77
de81bfb00d
Enh(wal):Modify the error message when the wal file is corrupted.
2024-12-26 09:29:55 +08:00
xiao-77
3c3e8fdbff
Add wal & config UT.
2024-12-24 17:34:57 +08:00
xiao-77
c4ed102c11
Merge branch '3.0' into enh/3.0/TD-31709
2024-12-16 10:00:02 +08:00
Hongze Cheng
dea8d6fd62
fix some code
2024-12-13 15:03:01 +08:00
xiao-77
9096312b41
Replace unsafe memory functions with safe versions in wal&sync.
2024-12-13 09:21:43 +08:00
Shengliang Guan
ebcf538c05
Merge branch 'main' into merge/mainto3.0
2024-12-11 20:12:50 +08:00
Shengliang Guan
a1d196688e
Merge pull request #29038 from taosdata/enh/useSafySysFunc
...
Replace unsafe memory functions with safe versions
2024-12-11 19:47:47 +08:00
xiao-77
78a283411c
Fix error return code.
2024-12-11 11:17:16 +08:00
yihaoDeng
b9d92bd7b7
use safe sys func
2024-12-06 21:44:23 +08:00
yihaoDeng
c5c56606c4
use safe sys func
2024-12-05 16:35:45 +08:00
xiao-77
1698fe0544
Fix crash at wal init write file.
2024-12-04 09:30:58 +08:00
kailixu
a157caa38d
enh: process log rotate every 30 minutes
2024-11-29 18:57:09 +08:00
xiao-77
4f2faff91d
Fix maybe close undefine fd ptr.
2024-11-28 11:20:22 +08:00
xiao-77
1eb005a9f0
Fix error code return.
2024-11-27 16:27:00 +08:00
xiao-77
d609d144be
Fix ci crash.
2024-11-27 13:46:55 +08:00
xiao-77
7d961a7fec
Enh close wal module open file.
2024-11-27 10:15:50 +08:00
Shengliang Guan
a607951115
Merge branch 'main' into merge/mainto3.0
2024-11-22 13:39:44 +08:00
Shengliang Guan
cfa7d275f2
Merge branch 'main' into merge/mainto3.0
2024-11-21 11:00:00 +08:00
xiao-77
6f0279d603
Enh modify wal print fileInfo from info to trace.
2024-11-20 19:46:08 +08:00
xiao-77
c954d0ac7a
fix:skip begin&end snapshot while wal level = 0.
2024-11-18 11:23:06 +08:00
Shengliang Guan
80b7cbdb84
Merge branch '3.0' into merge/mainto3.0
2024-11-13 23:11:05 +08:00
xiao-77
27f489fadf
fix ci error.
2024-11-13 11:01:11 +08:00
xiao-77
bd9d859162
fix ci error.
2024-11-13 09:45:57 +08:00
xiao-77
095ad14bc8
fix init ptr = NULL
2024-11-12 17:44:53 +08:00
xiao-77
9c24db5d03
Add error log and close wal file.
2024-11-12 17:28:46 +08:00
xiao-77
689c0f5254
fix ci crash.
2024-11-08 14:34:31 +08:00
xiao-77
0178d734cb
fix ci crash
2024-11-08 10:17:42 +08:00
wangjiaming0909
9a92c136ce
fix drop child table with tsma
2024-11-08 09:47:47 +08:00
wangjiaming0909
65dffbda0c
fix tsma drop ctb
2024-11-08 09:47:04 +08:00
wangjiaming0909
a5a3d1d8ad
fix same timestamp written into same tsma res ctb
2024-11-08 09:40:06 +08:00
xiao-77
badc1037a9
Remove the wrong comments.
2024-11-07 17:44:25 +08:00
xiao-77
4f9fa3bb3e
fix alter wal level from 0 to 1or2 and restart failed
2024-11-07 17:43:28 +08:00
Shengliang Guan
b0902e81eb
Merge pull request #28659 from taosdata/fix/main/32800
...
fix vnode cannot restart while wal level =0
2024-11-07 11:06:31 +08:00
xiao-77
8984231b9f
fix vnode cannot restart while wal level =0
2024-11-06 11:15:08 +08:00
