Haojun Liao
454624516c
fix(stream): handle the repeatly issued nodeUpdate msg from dnode.
2023-10-27 09:59:51 +08:00
Haojun Liao
33dc51cc86
fix(stream): add some logs.
2023-10-27 09:59:44 +08:00
Haojun Liao
1ccbb77981
fix(stream): fix dead lock when shutdown all tasks.
2023-10-27 09:59:37 +08:00
Haojun Liao
2493c21ed3
fix(stream): fix the invalid write in sma
2023-10-27 09:58:52 +08:00
Haojun Liao
7cce53f7e5
fix(stream): ignore the check status when is ready.
2023-10-27 09:58:52 +08:00
Haojun Liao
c99f434706
fix(stream): set checkpoint failure when in pause status.
2023-10-27 09:58:52 +08:00
Haojun Liao
2c1af8dad8
refactor: do some internal refactor.
2023-10-27 09:58:52 +08:00
Haojun Liao
1ad2c3029a
refactor(stream): do some internal refactor.
2023-10-27 09:58:52 +08:00
Haojun Liao
7311f9d2fe
fix(sma): fix bugs in sma and do some internal refactor.
2023-10-27 09:58:51 +08:00
Haojun Liao
3bcffcf1da
other: merge stream refactor from main.
2023-10-27 09:56:02 +08:00
Haojun Liao
226b6596d6
fix(stream): fix bugs caused by refactor.
2023-10-27 09:54:58 +08:00
Haojun Liao
091238e7be
fix(stream): fix bugs caused by refactor sm.
2023-10-27 09:54:58 +08:00
Haojun Liao
e1f6043eed
fix(stream): fix bugs caused by refactor sm.
2023-10-27 09:54:57 +08:00
Haojun Liao
8729bdac1e
fix(stream): fix bugs caused by refactor.
2023-10-27 09:54:57 +08:00
Haojun Liao
1eac7f44c0
fix(stream): fix error in stream.
2023-10-27 09:54:56 +08:00
Haojun Liao
579dd8e6b2
refactor(stream): do some internal refactor.
2023-10-27 09:54:56 +08:00
Haojun Liao
6f3c0d17cc
refactor(stream): add state machine to manage the state of stream tasks.
2023-10-27 09:54:49 +08:00
Haojun Liao
596eb073b7
refactor(stream): do some internal refactor.
2023-10-27 09:54:48 +08:00
Haojun Liao
62c58ecd8b
fix(stream):add more check for test cases.
2023-10-27 09:54:06 +08:00
liuyao
cf3bfe9310
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898
2023-10-27 09:39:00 +08:00
dmchen
ca5e252c0c
atomic init
2023-10-27 01:20:33 +00:00
dmchen
21dd6f70a9
atomic init
2023-10-27 01:16:53 +00:00
Hongze Cheng
b8c379a20d
Merge pull request #23413 from taosdata/fix/TD-26669
...
fix(tsdb/commmit): make ts big enough to skip row
2023-10-26 07:17:53 -05:00
dmchen
9af7b7b178
init error
2023-10-26 11:50:34 +00:00
wade zhang
d1e4e909c3
Merge pull request #23384 from taosdata/fix/TD-26884-3.0
...
Fix/td 26884 3.0
2023-10-26 17:00:00 +08:00
wade zhang
951442e3db
Merge pull request #23381 from taosdata/fix/TD-26884-main
...
TD-26884
2023-10-26 16:59:39 +08:00
Minglei Jin
b314758108
tsdb/commit: make ts big enough to skip row
2023-10-26 16:24:06 +08:00
yihaoDeng
4c03d372ef
fix stream case error
2023-10-26 14:19:34 +08:00
kailixu
bb77015998
Merge branch '3.0' into enh/TD-26641-3.0
2023-10-26 10:40:54 +08:00
Hongze Cheng
209ebbde84
Merge pull request #23402 from taosdata/fix/TD-26189-libs3
...
cmake/xml2: use sha256 to verify distribution release
2023-10-25 20:27:29 -05:00
kailixu
64765579e9
enh: check interval and keep for retentions
2023-10-25 22:42:01 +08:00
yihaoDeng
db0f6258fe
fix stream case error
2023-10-25 19:38:22 +08:00
liuyao
f51c985914
stream event window
2023-10-25 17:50:16 +08:00
Minglei Jin
d77ecbbb1b
cmake/xml2: use sha256 to verify distribution release
2023-10-25 17:41:55 +08:00
dmchen
14be9c81e2
create table user and clusterid
2023-10-25 14:53:06 +08:00
dmchen
7ef019d105
create table user and clusterid
2023-10-25 06:49:23 +00:00
Haojun Liao
f36b24ed24
fix(stream): disable follower nodes exec reset.
2023-10-25 14:16:36 +08:00
Hongze Cheng
3ff331b8b7
Merge pull request #23391 from taosdata/fix/TD-26189-libs3
...
cmake: new option: BUILD_S3
2023-10-24 22:37:20 -05:00
Haojun Liao
03165d5327
fix(stream): handle the repeatly issued nodeUpdate msg from dnode.
2023-10-25 09:55:02 +08:00
Haojun Liao
26aaa4a83c
other: merge main.
2023-10-25 00:39:14 +08:00
Haojun Liao
13d979a2ee
fix(stream): add some logs.
2023-10-25 00:03:46 +08:00
Haojun Liao
8cde39eebd
fix(stream): fix dead lock when shutdown all tasks.
2023-10-24 19:11:24 +08:00
Minglei Jin
f9ca8fe962
cmake: new option: BUILD_S3
2023-10-24 16:10:46 +08:00
Haojun Liao
f1498f8929
fix(stream): fix the invalid write in sma
2023-10-24 15:24:34 +08:00
dmchen
162066235b
create table
2023-10-24 14:31:27 +08:00
Hongze Cheng
e7e7748e6d
Merge pull request #23366 from taosdata/fix/TD-26669
...
tsdb/commit: skip last tier ts data committing
2023-10-24 01:29:01 -05:00
dmchen
ae728ab412
create table
2023-10-24 06:17:13 +00:00
yihaoDeng
95b0d4f083
Merge branch 'enh/new3.0' into enh/refactorBackend
2023-10-24 13:40:47 +08:00
Haojun Liao
a6e706ba2d
fix(stream): ignore the check status when is ready.
2023-10-24 11:38:14 +08:00
Haojun Liao
e92b276e3e
fix(stream): set checkpoint failure when in pause status.
2023-10-24 10:14:29 +08:00
Minglei Jin
e826532592
cmake/vnode: specify no default path for ssl & crypto
2023-10-24 10:10:43 +08:00
Haojun Liao
0dae8c3c76
refactor: do some internal refactor.
2023-10-24 09:49:14 +08:00
Haojun Liao
f446ff1c36
refactor(stream): do some internal refactor.
2023-10-24 09:48:10 +08:00
Haojun Liao
7a8b046a35
fix(sma): fix bugs in sma and do some internal refactor.
2023-10-24 09:40:38 +08:00
Minglei Jin
7fdf6cc696
cmake: use new dir for libs3
2023-10-24 09:04:24 +08:00
dmchen
dec257ff59
TD-26529
2023-10-23 08:59:54 +00:00
Minglei Jin
80fb38f172
Merge branch '3.0' into fix/TD-26189-libs3
2023-10-23 16:31:21 +08:00
Minglei Jin
f630fc38f8
tsdb/commit: skip last tier ts data committing
2023-10-23 15:46:32 +08:00
Haojun Liao
2ee3319611
Merge pull request #23360 from taosdata/fix/liaohj
...
fix(tsdb): apply the window range when building blocks from stt files.
2023-10-23 12:45:42 +08:00
Haojun Liao
6dc8fc50bc
Merge pull request #23359 from taosdata/fix/3_liaohj
...
fix(tsdb): apply the window range when building blocks from stt files.
2023-10-21 14:57:14 +08:00
Haojun Liao
f667bf3866
fix(tsdb): apply the window range when building blocks from stt files.
2023-10-20 18:19:45 +08:00
Haojun Liao
f1207d8d42
fix(tsdb): apply the window range when building blocks from stt files.
2023-10-20 18:18:58 +08:00
Haojun Liao
c4268ca395
fix(stream): fix bugs caused by refactor.
2023-10-20 15:54:30 +08:00
yihaoDeng
1a4cfd11a5
Merge branch 'enh/new3.0' into enh/refactorBackend
2023-10-20 15:28:10 +08:00
Minglei Jin
55647f9ce9
cos/put: make chunk small to not block other reqs
2023-10-20 15:15:03 +08:00
Haojun Liao
3b8c85f632
fix(stream): fix bugs caused by refactor sm.
2023-10-20 14:19:57 +08:00
Minglei Jin
74d05c2771
vnode/cos: fix multipart uploading
2023-10-20 13:47:25 +08:00
Haojun Liao
270a847809
fix(stream): fix bugs caused by refactor sm.
2023-10-20 10:23:48 +08:00
Benguang Zhao
959f8105ee
enh: require command to trigger repairing vnodes on replaced disks
2023-10-19 18:55:12 +08:00
Haojun Liao
d5059826a8
fix(stream): fix bugs caused by refactor.
2023-10-19 17:59:04 +08:00
Haojun Liao
c1cebae6ba
fix(stream): fix error in stream.
2023-10-19 16:20:27 +08:00
Haojun Liao
402aefd95d
refactor(stream): do some internal refactor.
2023-10-19 15:09:47 +08:00
Benguang Zhao
a2e0480839
refact: rename as SYNC_FSM_STATE_COMPLETE
2023-10-19 11:18:57 +08:00
Benguang Zhao
a515f8a94f
feat: use vnode config info if existing during vnodeCreate
2023-10-19 11:18:57 +08:00
Benguang Zhao
a95f6e6862
feat: support restore dnode with vnodes of replaced disks for primary dirs
2023-10-19 11:18:57 +08:00
Benguang Zhao
c4e9069a66
fix: set nextProcessedVer properly in tqProcessTaskScanHistory
2023-10-19 11:18:57 +08:00
Benguang Zhao
5c85525fd0
enh: add tsdbFSCreateRefSnapshotWithoutLock
2023-10-19 11:18:57 +08:00
Benguang Zhao
f2bd43c07e
fix: set field length properly in tsdbGetSnapDetails
2023-10-19 11:18:57 +08:00
Benguang Zhao
83013e0fe5
enh: return error in case of out of memory for tsdbGetSnapRangeHash
2023-10-19 11:18:57 +08:00
Benguang Zhao
59e8a2104c
refact: wrap funcs to handle snapshot info for vnodeSnapReaderOpen and vnodeSnapWriterOpen
2023-10-19 11:18:57 +08:00
Benguang Zhao
eb8c4d3e8c
enh: use hash table for filtering fset in tsdbSnapReaderOpen and tsdbSnapWriterOpen
2023-10-19 11:18:57 +08:00
Benguang Zhao
4e74533878
enh: avoid _Static_assert
2023-10-19 11:18:57 +08:00
Benguang Zhao
094cf408df
enh: prepare vnode dir again in vnodeOpen
2023-10-19 11:18:57 +08:00
Benguang Zhao
c1f1709d59
fix: add rsmaSnapWriterPrepareClose
2023-10-19 11:18:57 +08:00
Benguang Zhao
74185b8b9c
feat: exchange snapshot info for rsma tsdbs
2023-10-19 11:18:57 +08:00
Benguang Zhao
d5d713b1b4
enh: fill snapshot info for rsma tsdbs
2023-10-19 11:04:39 +08:00
Benguang Zhao
b80f8201ce
feat: detect fs incompleteness of RSMA tsdbs
2023-10-19 11:04:39 +08:00
Benguang Zhao
29bbebc323
enh: refactor a func name as tsdbSnapGetDetails
2023-10-19 11:04:39 +08:00
Benguang Zhao
00aeb031d4
enh: replicate a fset if it is corrupted without valid minVer
2023-10-19 11:04:39 +08:00
Benguang Zhao
a6d5deb5d1
fixup: fix tsdbFSDoSanAndFix
2023-10-19 11:04:39 +08:00
Benguang Zhao
eb4e2aa58f
feat: restore incomplete fsm state with maxVerValid via snapshot replication
2023-10-19 11:04:36 +08:00
Benguang Zhao
0c41fa56dc
feat: filter pExclude in tsdbFSCreateCopyRangedSnapshot
2023-10-19 11:00:44 +08:00
Benguang Zhao
e1c03118ab
enh: extract snapshot info for both of snap reader and writer
2023-10-19 10:51:13 +08:00
Benguang Zhao
410ced8320
feat: use TLV format to encode data of snapshot info
2023-10-19 10:51:13 +08:00
Benguang Zhao
f99795d027
enh: use tsdbSnapRangeArrayDestroy
2023-10-19 10:51:13 +08:00
Benguang Zhao
c1b2eedd3c
feat: impl tsdbSnapGetInfo
2023-10-19 10:51:08 +08:00
Benguang Zhao
4d55488495
feat: use SSnapshotParam as a parameter to vnodeSnapReaderOpen
2023-10-19 10:37:34 +08:00
Benguang Zhao
083dd148be
feat: exchange difference of snapshot info for replication
2023-10-19 10:37:34 +08:00
Benguang Zhao
b23bcee690
fixup: about to revert this commit
2023-10-19 10:37:34 +08:00
Benguang Zhao
0ddbcd50d0
enh: maintain independent version range of tombs for SDataFileWriter
2023-10-19 10:37:34 +08:00
Benguang Zhao
4540bcb170
fixup: work-around a compiler bug
2023-10-19 10:37:34 +08:00
Benguang Zhao
44a7f5df47
feat: add tsdbSnapDiff
2023-10-19 10:37:34 +08:00
Benguang Zhao
6ae9bd0e9a
feat: add tsdbFSToSnapRangeArray
2023-10-19 10:37:34 +08:00
Benguang Zhao
0a67cc8477
refact: use tsdbTFileUpdVerRange in tsdbSttFWriterCloseCommit
2023-10-19 10:37:34 +08:00
Benguang Zhao
54a10154a4
fixup: remove unused minVer and maxVer in ctx of SCommitter2
2023-10-19 10:37:34 +08:00
Benguang Zhao
6b753cc0cd
refact: remove unused code is_same_file
2023-10-19 10:37:34 +08:00
Benguang Zhao
dc402e21e3
fix: merge old version range of head and tomb files in tsdbDataFileWriterCloseCommit
2023-10-19 10:37:34 +08:00
Benguang Zhao
f8c6e8744a
refact: change field name of pExclude in SVSnapReader
2023-10-19 10:37:34 +08:00
Benguang Zhao
01d0c1247d
enh: record ver range in writer ctx
2023-10-19 10:37:34 +08:00
Benguang Zhao
f207b3ddd5
refact: rename func names of tsdbDataWriterUpdVerRange and tsdbSttWriterUpdVerRange
2023-10-19 10:37:34 +08:00
Benguang Zhao
399afe1094
refact: tidy up declarations of funcs in tsdbUpgrade.c
2023-10-19 10:37:25 +08:00
Haojun Liao
f4caeca24a
refactor(stream): add state machine to manage the state of stream tasks.
2023-10-19 10:34:20 +08:00
Benguang Zhao
ed6d7c4c4d
refact: relocate declarations and defs of tsdbFileWriteTombBlock and tsdbFileWriteTombBlk
2023-10-19 10:17:34 +08:00
Benguang Zhao
823aad4a5e
enh: record version range of STFile for data and stt files
2023-10-19 10:17:34 +08:00
Benguang Zhao
3cd458f5c9
enh: fill minVer and maxVer of nf in STFileObj during migration
2023-10-19 10:17:34 +08:00
Benguang Zhao
1446b44733
fixup: remove minVer and maxVer in FSetWriterConfig
2023-10-19 10:17:34 +08:00
Benguang Zhao
c8a46394f1
enh: set default values of minVer and maxVer while upgrading from CURRENT
2023-10-19 10:17:34 +08:00
Benguang Zhao
ab7a20c117
enh: write stt and data files with minVer and maxVer
2023-10-19 10:17:34 +08:00
Benguang Zhao
da28d490aa
enh: filterByVersion with snap ranges
2023-10-19 10:17:34 +08:00
Benguang Zhao
7a13e4b2cf
enh: add minVer and maxVer for entries in current.json
2023-10-19 10:17:34 +08:00
Benguang Zhao
1be2835fc1
enh: exclude a list of snap ranges in tsdbSnapReaderOpen
2023-10-19 10:17:34 +08:00
Benguang Zhao
573c28fd06
enh: iterate over a list of snap ranges for STsdbSnapReader
2023-10-19 10:17:28 +08:00
Minglei Jin
52c8bc91f9
cos/delete: fix delete object cond and double free
2023-10-18 18:21:45 +08:00
Haojun Liao
54ec679b58
refactor(stream): do some internal refactor.
2023-10-18 15:34:53 +08:00
Minglei Jin
f26ec41b8e
vnode/cos: fix get callback buffer
2023-10-18 15:30:02 +08:00
Haojun Liao
c6dd73b68b
Merge pull request #23187 from taosdata/feat/TD-26056
...
feat:add replay logic
2023-10-18 11:43:43 +08:00
yihaoDeng
e49b9b2276
fix transfer crash
2023-10-18 11:34:11 +08:00
Haojun Liao
df07443379
Merge pull request #23288 from taosdata/fix/liaohj
...
fix(stream):add more check for test cases.
2023-10-18 08:13:15 +08:00
yihaoDeng
d67fdb5e46
fix transfer crash
2023-10-17 21:08:31 +08:00
yihaoDeng
2004c1a346
fix transfer crash
2023-10-17 18:19:52 +08:00
Minglei Jin
11b65e2779
vnode/cos: make dependent lib public
2023-10-17 18:11:13 +08:00
Minglei Jin
dd21d8e3ad
cos/multipart: first round multipart uploading
2023-10-17 17:24:50 +08:00
Minglei Jin
8fa8c40391
cos/put: simple object putting(< 5 gigabytes)
2023-10-17 14:59:03 +08:00
yihaoDeng
b793c92fed
fix stream snap deadlock
2023-10-16 22:00:34 +08:00
yihaoDeng
b133418d88
fix stream snap deadlock
2023-10-16 20:03:44 +08:00
yihaoDeng
f1186be19a
fix stream snap deadlock
2023-10-16 19:38:55 +08:00
yihaoDeng
0adefd5e59
fix stream snap deadlock
2023-10-16 19:26:33 +08:00
yihaoDeng
f5ea3649c5
fix stream snap deadlock
2023-10-16 19:26:08 +08:00
yihaoDeng
0a84d7a8b3
fix stream snap deadlock
2023-10-16 19:20:48 +08:00
yihaoDeng
252b90bfab
fix stream snap deadlock
2023-10-16 19:20:09 +08:00
Haojun Liao
a1aa2c9e0c
fix(stream):add more check for test cases.
2023-10-16 18:47:01 +08:00
Minglei Jin
2479bb343e
prefix/delete: delete with prefix
2023-10-16 15:54:51 +08:00
Minglei Jin
4a77a49a3e
prefix/list: list bucket with prefix
2023-10-16 15:25:48 +08:00
Haojun Liao
f98e454c5d
Merge pull request #23193 from taosdata/fix/3_liaohj
...
other: merge stream fix in main branch.
2023-10-16 15:17:04 +08:00
Haojun Liao
33018a0bdb
fix(tsdb): fix syntax error.
2023-10-16 14:07:09 +08:00
Haojun Liao
fa6ba6faf8
fix(tdsb): adjust the log level.
2023-10-16 13:26:13 +08:00
Haojun Liao
6b86d050f2
fix(tsdb): record the pinned block iter.
2023-10-16 13:26:13 +08:00
Haojun Liao
5fe7c8de24
fix(stream): fix syntax error.
2023-10-16 13:26:12 +08:00
Haojun Liao
fb2172933a
fix(tsdb): enable pin stt datablock.
2023-10-16 13:26:06 +08:00
Haojun Liao
8f2c1944c0
fix(tdsb): adjust the log level.
2023-10-16 11:55:57 +08:00
Haojun Liao
ccecf05ff8
fix(tsdb): record the pinned block iter.
2023-10-16 11:48:57 +08:00
wangmm0220
473142fab7
fix:conflicts from 3.0
2023-10-16 11:35:56 +08:00
Haojun Liao
18bb27cdff
fix(stream): fix syntax error.
2023-10-16 10:16:39 +08:00
Haojun Liao
67bee17e5e
other: merge main.
2023-10-16 09:55:41 +08:00
Haojun Liao
f751f2bb3d
fix(tsdb): enable pin stt datablock.
2023-10-16 09:49:51 +08:00
wade zhang
0f9da01c88
Merge pull request #23264 from taosdata/3.0_main_merge.2
...
3.0 main merge
2023-10-14 09:45:49 +08:00
Minglei Jin
0a1ff3283e
vnode/cos: first round size delte and get
2023-10-13 16:59:05 +08:00
Haojun Liao
bd72d080a9
Merge pull request #23242 from taosdata/fix/liaohj
...
refactor: do some internal refactor.
2023-10-13 16:40:14 +08:00
yihaoDeng
8392c99d36
refactor backend
2023-10-13 14:54:00 +08:00
dapan1121
a418307570
Merge pull request #23236 from taosdata/fix/TD-26658-3.0
...
enh: close stt before untake read snap
2023-10-13 14:16:47 +08:00
Haojun Liao
0240ae87c3
Merge pull request #23241 from taosdata/3.0_main_merge
...
3.0 branch to main merge
2023-10-13 10:22:48 +08:00
Alex Duan
35fced8796
Merge pull request #23234 from taosdata/main_3_merge
...
other: merge main into 3.0
2023-10-12 07:48:20 -05:00
yihaoDeng
a56d831a14
refactor backend
2023-10-12 20:16:41 +08:00
Haojun Liao
506c55001d
fix(tsdb): fix race condition.
2023-10-12 17:57:03 +08:00
Haojun Liao
b782af2534
fix(stream): avoid double free.
2023-10-12 17:56:42 +08:00
Haojun Liao
90f866352b
Merge pull request #23221 from taosdata/feat/TD-26052
...
fix:[TD-26671] judge if pointer is null to avoid core dump
2023-10-12 17:23:41 +08:00
kailixu
3d32d55ea5
enh: close stt before untake read snap
2023-10-12 16:44:55 +08:00
Haojun Liao
eb4449999f
other: merge 3.0
2023-10-12 10:33:48 +08:00
Hongze Cheng
11aa9326b9
fix more
2023-10-11 20:15:46 +08:00
yihaoDeng
031506aef8
refactor backend
2023-10-11 19:46:35 +08:00
Hongze Cheng
38b036ff36
fix: possible race condition
2023-10-11 17:39:58 +08:00
Haojun Liao
ea6ffac403
refactor: do some internal refactor.
2023-10-11 16:51:27 +08:00
Minglei Jin
8253874398
enh(tsdb/cos): new sdk for s3
2023-10-11 14:47:26 +08:00
wangmm0220
f7d1e0ea82
fix:[TD-26671] judge if pointer is null to avoid core dump
2023-10-11 11:08:14 +08:00
Haojun Liao
15debda7cd
refactor: update some logs.
2023-10-11 11:04:57 +08:00
Haojun Liao
d58d663a36
refactor: update some logs.
2023-10-11 10:38:15 +08:00
Haojun Liao
a03f09c00f
refactor: update some logs.
2023-10-11 10:32:31 +08:00
Shungang Li
2c66f44b31
fix(tsdb): ensure sst trigger array size for upgrade
2023-10-10 21:07:08 +08:00
Haojun Liao
b4d7e66f19
other: add some logs.
2023-10-10 19:57:17 +08:00
Haojun Liao
56147120b9
fix(tsdb): remove invalid assert, and do some internal refactor.
2023-10-10 17:04:12 +08:00
wangmm0220
440fa77282
fix:merge datablock if data in same wal version
2023-10-10 16:55:36 +08:00
Haojun Liao
5f9b858fc1
other: merge main.
2023-10-10 15:38:46 +08:00
Haojun Liao
adf6f65d09
fix(stream): set initial version for fill-history task. disable reentry of scan-history task function.
2023-10-10 14:00:30 +08:00
Alex Duan
9da96ebf63
Merge pull request #23017 from taosdata/case/TD-26408-MAIN
...
fix: add case for lost data after split vgroup (main)
2023-10-10 00:54:34 -05:00
wangmm0220
9113c3c3b6
fix:rollback removed code
2023-10-10 11:53:54 +08:00
Hongze Cheng
1b559a0254
Merge pull request #23180 from taosdata/fix/TS-4121-main
...
fix(tsdb/cache reader): reset current fileset in cache reader
2023-10-09 20:46:33 -05:00
Hongze Cheng
4224f90661
Merge pull request #23184 from taosdata/enh/TS-4107
...
enh: clear files fset by fset
2023-10-09 20:05:12 -05:00
yihaoDeng
0fc6ffe6b6
change test case
2023-10-09 20:51:26 +08:00
wangmm0220
3e2e924e98
feat:[TD-26056] add replay logic
2023-10-09 18:36:39 +08:00
Hongze Cheng
cd61dd39fa
Merge pull request #23176 from taosdata/enh/TS-4103
...
enh: control number of stt files
2023-10-09 05:08:01 -05:00
wangmm0220
33045e63ae
feat:[TD-26056] add replay logic
2023-10-09 17:35:40 +08:00
kailixu
5dd277248e
fix: alter active code for different server
2023-10-09 17:16:56 +08:00
Hongze Cheng
e3525dba6e
enh: clear files fset by fset
2023-10-09 17:11:50 +08:00
Hongze Cheng
258181e387
change block commit factor
2023-10-09 16:03:42 +08:00
yihaoDeng
2aa88dfe9b
fix mem leak
2023-10-09 15:53:42 +08:00
Haojun Liao
8266c4ff77
fix(stream): remove invalid clear of rspmsg list.
2023-10-09 15:26:42 +08:00
Minglei Jin
93438ed838
fix(tsdb/carch reader): reset current fileset in cache reader
2023-10-09 15:24:24 +08:00
yihaoDeng
addb1107d2
fix mem leak
2023-10-09 15:11:59 +08:00
Hongze Cheng
2c9a0dbcda
enh: control stt max level
2023-10-09 14:00:11 +08:00
liuyao
1fbfdb5ab4
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174
2023-10-09 11:40:27 +08:00
Haojun Liao
74ff0c5b50
Merge branch 'main' into fix/liaohj
2023-10-09 10:14:53 +08:00
Haojun Liao
ee6516f3c4
enh(stream): add trans to reset task status to avoid being frozen in checkpoint status due to doing checkpoint failure of partial tasks.
2023-10-09 10:13:53 +08:00
Haojun Liao
0fda1793e7
fix(stream): fix error in fill-history process.
2023-10-09 10:08:48 +08:00
wangmm0220
5f7b6f19ba
feat:[TD-26056] add replay logic
2023-10-08 19:05:59 +08:00
Haojun Liao
167484ab3a
Merge pull request #23145 from taosdata/mark/tmq
...
opti:set default offset to latest in subscription
2023-10-08 18:56:37 +08:00
Hongze Cheng
880e8c1941
fix: block commit when there are too many stt file
2023-10-08 18:27:19 +08:00
yihaoDeng
bffa6387fe
refact task backend
2023-10-08 18:16:45 +08:00
yihaoDeng
f49a2cbeb0
refact task backend
2023-10-08 18:14:17 +08:00
wangmm0220
b04d57fcc3
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26056
2023-10-08 16:15:19 +08:00
wangmm0220
3f2d890560
feat:[TD-26056] add replay logic
2023-10-08 16:06:15 +08:00
Minglei Jin
ca809924cd
fix(tsdb/retention): free fopArr & fs snapshot resources
2023-10-08 15:10:54 +08:00
Hongze Cheng
ba27cc0605
fix: fid overflow
2023-10-08 14:54:24 +08:00
yihaoDeng
9d430c39ae
fix mem leak
2023-10-08 11:47:06 +08:00
wangmm0220
fb3197ea89
fix:test case error for reset=latest
2023-10-08 10:55:35 +08:00
liuyao
c75506b271
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174
2023-10-08 09:02:51 +08:00
Haojun Liao
ab17bfdf09
refactor: do some internal refactor.
2023-10-07 19:16:55 +08:00
liuyao
c088ee7f91
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174
2023-10-07 19:13:07 +08:00
yihaoDeng
97fdcbc60b
fix mem leak
2023-10-07 17:48:24 +08:00
kailixu
b9767707cb
chore: code optimization for array size
2023-10-07 15:57:26 +08:00
wangmm0220
9c470e9297
opti:set default offset to latest in subscription & return error if use snapshot when consume column
2023-10-07 15:25:24 +08:00
Hongze Cheng
d1e59b9e0e
enh: optimize merge strategy
2023-10-07 15:18:08 +08:00
Haojun Liao
7ce3d2c200
fix(stream): quit from loop when input queue is full.
2023-10-07 14:54:11 +08:00
yihaoDeng
fa70221238
refact task backend
2023-10-07 12:17:55 +08:00
kailixu
85226d05a3
chore: code refactor for time series
2023-10-07 09:30:32 +08:00
kailixu
6efe3845d4
chore: more logic
2023-10-07 07:02:16 +08:00
Haojun Liao
c20dd002fb
enh(stream): add more info for sink task.
2023-10-07 01:14:00 +08:00
kailixu
c70a1b77e6
chore: code optimization for time series
2023-10-07 00:17:21 +08:00
kailixu
c59498d90a
chore: code refactor for time series statis
2023-10-06 07:37:18 +08:00
kailixu
e4a86aa70a
chore: remove obsolete codes
2023-10-05 23:52:50 +08:00
kailixu
07f043f143
enh: exclude sys tbl for time series
2023-10-05 23:48:52 +08:00
kailixu
47e79ff5b7
enh: exclude sys tbl for time series
2023-10-05 23:45:54 +08:00
kailixu
d0a046c7a3
enh: exclude sys tbl for time series
2023-10-05 23:30:30 +08:00
kailixu
88fdeca5cf
enh: dnode notify logic
2023-10-05 22:31:25 +08:00
kailixu
086213a6c2
enh: dnode notify logic
2023-10-05 21:35:57 +08:00
Haojun Liao
5bf8d16ee1
refactor(stream): idle for 100ms when starting next round scan wal.
2023-10-04 23:33:03 +08:00
Haojun Liao
41ef1a45c1
enh(stream): optimize the scan wal perf
2023-10-04 22:06:46 +08:00
Haojun Liao
45e413f8d5
refactor: wait for 100ms before scan wal again.
2023-10-03 20:57:19 +08:00
Haojun Liao
5564eb215c
fix(stream): fix invalid check.
2023-10-03 00:38:24 +08:00
Haojun Liao
5718158fc0
refactor: do some internal refactor.
2023-10-01 22:27:29 +08:00
Haojun Liao
ff44539468
fix(stream): drop related fill-history task when dropping stream tasks.
2023-09-28 23:00:29 +08:00
Haojun Liao
31acbc6fe2
refactor: do some internal refactor (discard the checkpoint source msg during restoring).
2023-09-28 22:44:13 +08:00
Haojun Liao
f2d8431619
fix(stream): enable new time range for stream task.
2023-09-28 18:26:52 +08:00
yihaoDeng
bb265887e6
refact task backend
2023-09-28 17:07:19 +08:00
yihaoDeng
54e3ac2c1e
refact task backend
2023-09-28 15:46:12 +08:00
Haojun Liao
0047d1e1a6
Merge branch 'main' into fix/liaohj
2023-09-28 14:35:14 +08:00
Haojun Liao
0a8f4530f7
fix(tsdb): replace destroy with reset.
2023-09-28 11:42:19 +08:00
kailixu
b1a0912a61
enh: exclude systables in log/audit db
2023-09-28 10:15:34 +08:00
Haojun Liao
22e485d132
fix(stream): opt perf.
2023-09-28 09:25:23 +08:00
Haojun Liao
cc9b9d1054
Merge pull request #23102 from taosdata/fix/liaohj
...
fix(stream): fix several bugs and do some internal refactor for stream processing.
2023-09-28 09:12:39 +08:00
Minglei Jin
cd811577f3
fix(vnode/cos): use EIO as object put errno
2023-09-27 15:10:34 +08:00
Minglei Jin
5ce1dd6284
fix(tsdb/readerwriter): fix fd writing
2023-09-27 14:02:37 +08:00
Haojun Liao
e13efd5b04
refactor: optimize the fill-history task launch policy, and do some other internal refactor.
2023-09-27 14:00:48 +08:00
Minglei Jin
e6287c1a89
fix(tsdb/readerwriter): fix var shadowing
2023-09-26 19:18:10 +08:00
liuyao
ebf4283e91
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174
2023-09-26 17:19:41 +08:00
kailixu
e1cd54a1b3
fix: rwlock reentrant problem on windows
2023-09-26 15:44:35 +08:00
kailixu
c680180894
fix: rwlock reentrant problem on windows
2023-09-26 15:37:29 +08:00
wade zhang
f6134b42d7
Merge pull request #23036 from taosdata/feat/TS-4011-3.0
...
feat/TS-4011: adjust config 'keep_time_offset' level from dnode to db
2023-09-26 14:25:54 +08:00
Haojun Liao
890d658aea
refactor: do some internal refactor.
2023-09-26 14:11:45 +08:00
Haojun Liao
525ee369d3
Merge pull request #23032 from taosdata/fix/liaohj
...
fix(stream): fix several stability-related bugs in stream framework.
2023-09-26 14:10:58 +08:00
Haojun Liao
f3f18b0fa3
fix(stream): add new status for meta.
2023-09-26 12:15:12 +08:00
liuyao
ca2325f886
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174
2023-09-26 10:41:31 +08:00
Hongze Cheng
03456ce443
fix: upgrade error when has tomb data
2023-09-26 09:23:22 +08:00
wade zhang
92f5803303
Merge pull request #23050 from taosdata/fix/TD-26478
...
fix(cos): use EIO as failed code
2023-09-26 09:02:59 +08:00
Haojun Liao
6cc3618ed9
fix(stream): fix error in pause scan-history data.
2023-09-26 01:09:55 +08:00
Haojun Liao
5a4a0aa0e3
fix(stream): fix invalid read and memory leak.
2023-09-25 23:10:33 +08:00
Minglei Jin
7fd7902dda
fix(cos): use EIO as failed code
2023-09-25 18:38:55 +08:00
Benguang Zhao
5d588cb7d2
enh: trigger failover if tsdbMerge failure
2023-09-25 17:22:38 +08:00
kailixu
126a371170
chore: more code
2023-09-25 16:24:03 +08:00
kailixu
0632fb838a
chore: code refactor
2023-09-25 16:17:57 +08:00
Haojun Liao
966ce4f30e
Merge remote-tracking branch 'origin/fix/liaohj' into fix/liaohj
2023-09-25 16:00:02 +08:00
Haojun Liao
fcf4cc7169
fix(stream): fix the invalid counter for ready tasks in vnode, fix an invalid read.
2023-09-25 15:58:24 +08:00
kailixu
b0b4d782fc
chore: code refactor
2023-09-25 15:57:54 +08:00
Shungang Li
743a5b0640
feat: add db config item keep_time_offset
2023-09-25 15:46:08 +08:00
Haojun Liao
dbc53069db
Merge branch 'main' into fix/liaohj
2023-09-25 10:41:18 +08:00
Haojun Liao
eb4078b7f3
fix(stream): record the tasks started info, and do some internal refactor.
2023-09-25 09:59:05 +08:00
Haojun Liao
c987f61300
fix(stream): fix race condition.
2023-09-25 01:37:27 +08:00
kailixu
986788d4fe
enh: timeseries calculation
2023-09-24 09:14:52 +08:00
kailixu
ff3e36e679
enh: timeseries calculation
2023-09-24 08:41:45 +08:00
kailixu
53a9459c20
enh: update timeseries
2023-09-24 07:52:27 +08:00
Haojun Liao
4ea737571d
refactor: do some internal refactor.
2023-09-24 01:26:51 +08:00
kailixu
bc8ebf1562
Merge branch '3.0' into enh/TS-3812-3.0
2023-09-23 18:19:08 +08:00
Haojun Liao
b58ec1ee57
fix(stream): update logs.
2023-09-23 15:22:48 +08:00
Haojun Liao
acd3321494
fix(stream): rsp when checkpoint source failed.
2023-09-23 14:13:33 +08:00
Haojun Liao
7d5f76c6f1
fix(stream): disable auto rsp for checkpoint source.
2023-09-23 11:31:14 +08:00
Haojun Liao
5155519559
fix(stream): fix invalid assert.
2023-09-22 23:06:48 +08:00
Haojun Liao
cf6c255f22
refactor: do some internal refactor.
2023-09-22 22:50:21 +08:00
kailixu
8f828e052b
enh: timeseries calculation optimization
2023-09-22 20:07:51 +08:00
liuyao
0d983e28ef
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174
2023-09-22 19:25:41 +08:00
Haojun Liao
5b12e276cf
fix(stream): add msg identifier check.
2023-09-22 18:13:18 +08:00
yihaoDeng
11da631bb5
add cvt state
2023-09-22 09:08:42 +00:00
wade zhang
849b05a09b
Merge pull request #22927 from taosdata/fix/TD-26189
...
s3/block_cache: new tsdb block cache
2023-09-22 16:15:07 +08:00
liuyao
4f8e6d7795
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174
2023-09-22 15:00:52 +08:00
Haojun Liao
898aea5cfb
refactor(stream): refactor send msg.
2023-09-22 14:52:18 +08:00
Minglei Jin
4c151f2031
tsdb/readerwriter: remove size with download
2023-09-22 14:06:06 +08:00
Haojun Liao
7e4410f094
Merge pull request #22992 from taosdata/feat/TD-26052
...
feat:support vnode split in tmq
2023-09-22 13:57:21 +08:00
Haojun Liao
87ea745861
fix(stream): add some logs, and remove invalid assert.
2023-09-22 10:53:03 +08:00
Haojun Liao
f7bcff862d
fix(stream): add check info detailed information.
2023-09-22 10:23:56 +08:00
wangmm0220
19806cbcab
fix:memory leak
2023-09-22 10:12:11 +08:00
wangmm0220
5555371fbc
fix:memory leak
2023-09-22 10:04:53 +08:00
wangmm0220
86a4bfe28d
fix:memory leak
2023-09-22 10:02:16 +08:00
liuyao
dc2f7872f8
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174
2023-09-22 09:41:15 +08:00
wangmm0220
803b17a2db
fix:memory leak
2023-09-22 09:31:58 +08:00
Haojun Liao
b1ba716299
refactor: do some internal refactor.
2023-09-22 09:24:36 +08:00
Haojun Liao
b075b4438b
fix(stream): handle dispatch checkpoint-trigger failure.
2023-09-21 23:15:18 +08:00
Haojun Liao
3c921ba66e
Merge pull request #23006 from taosdata/fix/3_liaohj
...
fix(tsdb): set the correct scaninfo to load the tomb data.
2023-09-21 22:13:16 +08:00
Haojun Liao
f93df639c1
fix(tsdb): set the correct scaninfo to load the tomb data.
2023-09-21 17:32:21 +08:00
Minglei Jin
ce1f866416
tsdb/reader: use pTsdb handle instead of pgsz to open file
2023-09-21 16:36:17 +08:00
kailixu
7445b9ff50
Merge branch '3.0' into enh/TS-3812-3.0
2023-09-21 16:25:06 +08:00
Haojun Liao
2efd155adf
fix(stream): wait for the task checkpoint before stop.
2023-09-21 15:53:21 +08:00
Haojun Liao
0f97a21163
fix(tsdb): set the correct scaninfo to load the tomb data.
2023-09-21 15:21:01 +08:00
Haojun Liao
e4073bd9a8
fix(stream): update logs.
2023-09-21 14:03:14 +08:00
Haojun Liao
09accc71d2
log(stream): update log.
2023-09-21 14:01:41 +08:00
Haojun Liao
17586af0ce
refactor: do refactor the sink task.
2023-09-21 13:32:57 +08:00
liuyao
3b3c5d7cb8
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26174
2023-09-21 10:11:36 +08:00
wangmm0220
f9c5aa01af
fix:enable split if there are topics & fix memory leak
2023-09-21 09:20:34 +08:00
Haojun Liao
6633fb971b
fix(stream): update logs.
2023-09-20 18:18:31 +08:00
Minglei Jin
f206fa07d0
s3/put: use put2
2023-09-20 15:59:58 +08:00
Haojun Liao
2418f509ea
fix(stream): avoid invalid read.
2023-09-20 15:47:09 +08:00
Haojun Liao
1d1d9a1b0b
fix(stream): unlock when returning.
2023-09-20 15:45:15 +08:00
Haojun Liao
c8ab761d2a
fix(stream): return if failed.
2023-09-20 15:38:49 +08:00
Haojun Liao
2a781c509f
fix(stream): add task status check.
2023-09-20 15:32:15 +08:00
Minglei Jin
d155cfcf0f
tsdb/readerwriter: use tsdb's s3 block cache to read file page
2023-09-20 15:24:54 +08:00
liuyao
1cebda368a
session&state operator buff
2023-09-20 15:06:08 +08:00
Haojun Liao
af487c9048
fix(stream): fix obj.
2023-09-20 14:50:43 +08:00
Haojun Liao
361cde6497
fix(stream): fix deadlock caused by streamTaskHalt function.
2023-09-20 14:49:09 +08:00
Haojun Liao
55d4a9686c
log(tsdb): remove some logs.
2023-09-20 13:18:42 +08:00
dm chen
4497a01168
Merge branch 'main' into feat/TD-26127-audit-sql
2023-09-20 11:13:34 +08:00
Haojun Liao
392aaeb592
log(stream): remove logs.
2023-09-20 10:49:18 +08:00
Haojun Liao
779c0c5f19
Merge pull request #22970 from taosdata/fix/liaohj
...
fix(stream): keep the status entry in hash table, instead entry index.
2023-09-20 10:33:05 +08:00
kailixu
a9d30f25d2
enh: rsma support delete raw data
2023-09-20 10:11:03 +08:00
wangmm0220
2881a2504c
fix:conflicts from 3.0
2023-09-19 18:39:40 +08:00
dmchen
1a7bffb079
ci break
2023-09-19 18:01:38 +08:00
Haojun Liao
b99232fd7a
fix(stream): limit the max scan times.
2023-09-19 17:45:28 +08:00
Haojun Liao
271e492188
refactor: update the log level.
2023-09-19 17:40:26 +08:00
wangmm0220
766652a88a
fix:vnode tranform support in tmq
2023-09-19 17:27:19 +08:00
dm chen
ee913cbfbc
Merge branch 'main' into feat/TD-26127-audit-sql
2023-09-19 14:39:20 +08:00
dmchen
e36ff1282c
revert dependency
2023-09-19 13:42:02 +08:00
wangmm0220
ad70dc178f
fix:conflicts from 3.0
2023-09-19 11:56:52 +08:00
wangmm0220
edb42aa2aa
fix:move from main to 3.0
2023-09-19 11:51:52 +08:00
Haojun Liao
e76bab7122
fix(stream): not handle the check msg for follower tasks.
2023-09-19 09:43:14 +08:00
slzhou
900aacd428
fix: fix sanitizer error
2023-09-19 09:40:00 +08:00
kailixu
6698861c8b
chore: timeseries distribute
2023-09-19 08:29:51 +08:00
Hongze Cheng
b1797834c1
fix: set snapshot writer compression
2023-09-18 20:58:20 +08:00
wangmm0220
1e859084b7
fix:conflicts from 3.0
2023-09-18 19:57:33 +08:00
wangmm0220
4b74135350
fix:vnode tranform support in tmq
2023-09-18 19:47:28 +08:00
Haojun Liao
101161c52e
Merge pull request #22954 from taosdata/fix/TD-26323
...
fix:core in race condition for pTq->pExecStore & return if poll too l…
2023-09-18 17:41:01 +08:00
Haojun Liao
c33ef4ce88
fix(stream): add null check
2023-09-18 15:14:51 +08:00
wangmm0220
c3498fbfe8
fix:core in race condition for pTq->pExecStore & return if poll too long & fix test cases if submit empty
2023-09-18 14:35:07 +08:00
wangmm0220
7869b693f2
add test case for tmq in vnode transform & fix core in race condition for pTq->pExecStore
2023-09-18 14:09:28 +08:00
dmchen
b473122dac
break dependency
2023-09-18 12:29:08 +08:00
dm chen
fda32dcc51
Merge branch 'main' into feat/TD-26127-audit-sql
2023-09-18 09:41:47 +08:00
dmchen
c674e025e2
skip auto create tb
2023-09-18 09:29:51 +08:00
kailixu
8111c18cc4
chore: merge 3.0
2023-09-18 09:20:43 +08:00
Haojun Liao
8aa9960760
Merge pull request #22944 from taosdata/fix/liaohj
...
refactor: do some internal refactor, and fix some bugs.
2023-09-17 21:25:33 +08:00
Haojun Liao
01144c58a7
fix(stream): fix stream task id error.
2023-09-17 01:19:59 +08:00
Haojun Liao
4846194bbb
refactor: do some internal refactor, remove the related fill-history task by sending mesg to replay it in follower node.
2023-09-16 21:37:30 +08:00
Haojun Liao
caa7542cea
Merge pull request #22913 from taosdata/fix/liaohj
...
fix(stream): fix error in drop task.
2023-09-16 21:36:38 +08:00
Haojun Liao
91e3d70796
fix(stream): remove fill-history sink task.
2023-09-15 17:46:17 +08:00
Minglei Jin
0181bb24d3
tsdb/readerwriter: use PRId64 instead of lld
2023-09-15 16:40:04 +08:00
Alex Duan
47f2c38a56
Merge pull request #22910 from taosdata/fix/TS-3987
...
fix: delete data error
2023-09-15 16:19:29 +08:00
Minglei Jin
318281356b
s3/block_cache: new tsdb block cache
2023-09-15 16:19:21 +08:00
kailixu
03aea454d7
chore: more code
2023-09-15 14:33:35 +08:00
wade zhang
b123dd7df3
Merge pull request #22904 from taosdata/FIX/TD-26292-main
...
enh: ignore compact req during restoring
2023-09-15 11:05:18 +08:00
Haojun Liao
2bfd6e3355
refactor: do some internal refactor.
2023-09-15 09:25:22 +08:00
Haojun Liao
117de7ab7d
fix(stream): fix error in drop task.
2023-09-15 00:51:13 +08:00
Haojun Liao
500fcad36c
Merge pull request #22892 from taosdata/fix/liaohj
...
refactor: do some internal refactor.
2023-09-15 00:46:46 +08:00
Haojun Liao
73c2782d78
fix(stream): update some logs.
2023-09-14 23:17:23 +08:00
Haojun Liao
5f55f489d8
fix(stream): fix memory leak.
2023-09-14 22:59:11 +08:00
Haojun Liao
303e8caf0c
fix(stream): set the correct guard flag.
2023-09-14 22:44:16 +08:00
kailixu
449092c5dc
enh: timeseries update optimize
2023-09-14 20:16:02 +08:00
Haojun Liao
27f626769e
fix(stream): fix memory leak.
2023-09-14 19:33:05 +08:00
Haojun Liao
f2c3e0a6e8
fix(stream): disable follower send hb to mnode. and do some internal refactor.
2023-09-14 17:22:31 +08:00
Hongze Cheng
925cc8f55f
fix: delete data error
2023-09-14 17:20:10 +08:00
Benguang Zhao
bbcbe460d4
enh: ignore compact req during restoring
2023-09-14 16:17:17 +08:00
Benguang Zhao
2886913fd8
enh: ignore compact req during restoring
2023-09-14 16:09:00 +08:00
Haojun Liao
fce5be0eb4
fix(stream): fix dead lock.
2023-09-14 14:09:05 +08:00
Haojun Liao
fd6344b319
fix(tsdb): check return code.
2023-09-14 09:25:35 +08:00
Haojun Liao
9b70c0c457
fix:fix coverity issue and remove unnecessary files.
2023-09-14 09:06:10 +08:00
wangmm0220
39fb5f4334
fix:add vnode snaphot for tmq
2023-09-13 18:09:47 +08:00
Haojun Liao
7305c8dbe1
refactor: do some internal refactor about the sched status set
2023-09-13 14:00:34 +08:00
wangmm0220
1dbd322fa0
fix:remove useless code
2023-09-13 11:42:09 +08:00
Haojun Liao
99477babca
Merge pull request #22872 from taosdata/fix/coverityScanDyh
...
fix coverity scan problem
2023-09-13 09:18:27 +08:00
Haojun Liao
09a15bf340
refactor: do some internal refactor.
2023-09-12 22:07:52 +08:00
Haojun Liao
60f5056ab7
other: merge 3.0
2023-09-12 22:00:40 +08:00
Haojun Liao
f6a097d96f
refactor: do some internal refactor.
2023-09-12 21:58:22 +08:00
Haojun Liao
4325a0a433
Merge pull request #22866 from taosdata/fix/3_liaohj
...
refactor: do some internal refactor.
2023-09-12 21:56:44 +08:00
yihaoDeng
8fc33dd74d
fix coverity scan problem
2023-09-12 18:52:16 +08:00
Haojun Liao
e457d94ac6
refactor: do some internal refactor.
2023-09-12 18:09:02 +08:00
yihaoDeng
8e064cdd03
fix merge error
2023-09-12 16:41:14 +08:00
Haojun Liao
4d33387e80
Merge pull request #22814 from taosdata/fix/fixTransferCrash2
...
fix merge error
2023-09-12 16:10:07 +08:00
Haojun Liao
52931b530d
Merge pull request #22855 from taosdata/fix/3_liaohj
...
fix(stream):check error when vnode is closing.
2023-09-12 15:58:02 +08:00
dapan1121
ef7eb478e4
Merge pull request #22834 from taosdata/fix/TS-3945
...
fix: remove incorrect assert
2023-09-12 15:55:51 +08:00
yihaoDeng
63c53b6a3a
fix transfer crash
2023-09-12 15:03:13 +08:00
yihaoDeng
ccb75a9c11
fix transfer crash
2023-09-12 14:46:56 +08:00
yihaoDeng
3e48f3639c
fix transfer crash
2023-09-12 14:46:32 +08:00
wade zhang
f4e785788a
Merge pull request #22833 from taosdata/fix/TS-3943-3.m
...
fix: neighbor block overlap judgement
2023-09-12 11:51:03 +08:00
Haojun Liao
93159729f6
fix(stream):check error when vnode is closing.
2023-09-12 11:45:51 +08:00
Haojun Liao
025a2a3b50
Merge pull request #22846 from taosdata/fix/3_liaohj
...
fix(tsdb): check the schema before merge rows in buffer
2023-09-12 11:43:27 +08:00
yihaoDeng
6ce85f5cae
fix transfer crash
2023-09-12 10:44:56 +08:00
Haojun Liao
f602aa965f
fix(stream): fix coverity scan issues.
2023-09-12 09:16:18 +08:00
Haojun Liao
a5b93aaf97
fix(tsdb): fix invalid read.
2023-09-11 23:55:34 +08:00
Haojun Liao
e8f7146a2c
fix(tsdb): check the schema before merge rows in buffer, and do some refactor.
2023-09-11 22:19:10 +08:00
Haojun Liao
cd1f0ea414
Merge pull request #22826 from taosdata/fix/3_liaohj
...
fix(stream): set the correct start version for the step 2 stage in fill history.
2023-09-11 21:43:58 +08:00
Haojun Liao
5ab739ae46
fix(stream): fix memory leak.
2023-09-11 15:29:12 +08:00
dapan1121
5c21f1ca22
fix: remove incorrect assert
2023-09-11 15:16:22 +08:00
kailixu
78d136dffd
fix: neighbor block overlap judgement
2023-09-11 15:10:39 +08:00
Haojun Liao
c729fc989f
fix(stream): set the init start timestamp.
2023-09-11 13:49:43 +08:00
Haojun Liao
0980e021e5
fix(stream): set the correct start version for the step 2 stage in fill history.
2023-09-11 13:37:19 +08:00
Haojun Liao
50ef500f51
refactor(stream): do sink module refactor.
2023-09-11 10:09:31 +08:00
Minglei Jin
443756c6ff
fix(meta): null txn after abort
2023-09-11 08:55:30 +08:00
Haojun Liao
372747cc23
Merge pull request #22818 from taosdata/fix/3_liaohj
...
fix(stream): fix error in fill history and check quit status of vnode.
2023-09-10 20:47:06 +08:00
Haojun Liao
85a5c45098
fix(stream): limit the already processed data.
2023-09-10 00:01:25 +08:00
Haojun Liao
9a30573b8b
fix(stream): disable scan wal when halt is set.
2023-09-09 16:12:08 +08:00
Haojun Liao
aa8909b267
other: add some logs.
2023-09-09 15:18:54 +08:00
Haojun Liao
6f5c855a4b
fix(stream): fix msg lost bug.
2023-09-09 15:08:36 +08:00
Haojun Liao
47fd144447
other: add some logs.
2023-09-09 11:19:51 +08:00
yihaoDeng
af08289a06
Merge branch 'fix/mainNew' into fix/fixTransferCrash2
2023-09-08 19:58:21 +08:00
yihaoDeng
a0494695de
fix merge error
2023-09-08 19:48:06 +08:00
Haojun Liao
b317c8ebff
fix(stream): disable merge submit blocks.
2023-09-08 12:46:15 +08:00
Benguang Zhao
55a9668908
fix: next merger iter of tombs in loop of tsdbSnapWriteTombRecord
2023-09-07 17:26:30 +08:00
Benguang Zhao
2d5b18039d
fix: next merger iter of tombs in loop of tsdbSnapWriteTombRecord
2023-09-07 17:14:50 +08:00
wade zhang
d3f0c5ac3e
Merge pull request #22770 from taosdata/fix/TD-25445-main
...
fix/TD-25445: search memory in ttlMgrFindExpired
2023-09-07 16:13:32 +08:00
Haojun Liao
55ac835294
Merge branch 'main' into fix/3_liaohj
2023-09-07 11:47:25 +08:00
Haojun Liao
b240e91c91
enh(stream): add token bucket to limit the rate of sink operation.
2023-09-07 09:58:48 +08:00
Shungang Li
a6ba7e678f
fix: search memory in ttlMgrFindExpired
2023-09-07 09:33:26 +08:00
Haojun Liao
0f909285c4
Merge pull request #22684 from taosdata/mark/tmq-3.0
...
fix:use vgstatus before if rebalance
2023-09-07 09:20:27 +08:00
Haojun Liao
2b84e0b02e
refactor: check if the put data into queue is success or failed.
2023-09-06 19:39:00 +08:00
Haojun Liao
8edf86b3bb
fix(stream): add some logs.
2023-09-06 19:08:09 +08:00
Haojun Liao
5ba6a68e7a
fix(stream): fix syntax error.
2023-09-06 19:00:39 +08:00
Haojun Liao
a82027f492
enh(stream): pack multi-datablock into one submit message.
2023-09-06 18:58:47 +08:00
wade zhang
e493f983ed
Merge pull request #22735 from taosdata/fix/TD-26133
...
fix: coverity scan
2023-09-06 18:45:23 +08:00
Haojun Liao
f8a321695a
Merge pull request #22711 from taosdata/fix/TD-26069-1
...
fix rc
2023-09-06 17:58:33 +08:00
Hongze Cheng
1d343fa57e
more fix
2023-09-06 17:10:36 +08:00
Haojun Liao
926cc01cff
refactor: do some internal refactor.
2023-09-06 16:48:43 +08:00
Hongze Cheng
cd88c8ec31
fix: little test
2023-09-06 14:45:53 +08:00
Haojun Liao
b382cba58c
fix(stream): fix syntax error.
2023-09-06 14:37:58 +08:00
Haojun Liao
236b363996
fix(stream): fix syntax error.
2023-09-06 14:37:11 +08:00
Haojun Liao
8783ebcb02
enh(stream): add some logs and record the submit package performance.
2023-09-06 14:34:36 +08:00
Hongze Cheng
a6743a31b5
Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-26133
2023-09-06 14:12:21 +08:00
dapan1121
698b0b21f7
Merge pull request #22630 from taosdata/enh/TS-3812-3.0
...
enh: report time series by period and quantity
2023-09-06 13:38:24 +08:00
Haojun Liao
e607a0a5cb
fix(stream): add some logs.
2023-09-06 11:39:07 +08:00
dmchen
231ba12f70
feat/TD-26127
2023-09-06 11:00:24 +08:00
Haojun Liao
c86eeb3938
fix(stream): add task status check when waiting for the table create.
2023-09-06 10:58:33 +08:00
wangmm0220
ef87b9c571
fix:conflicts from 3.0
2023-09-05 16:19:04 +08:00
wangmm0220
4e46ce4c03
fix:wait pHandle idle if vnode receives subscribe msg
2023-09-05 16:04:44 +08:00
Haojun Liao
ac8f4f1558
Merge pull request #22736 from taosdata/fix/fixTransferCrash
...
fix invalid read
2023-09-05 15:42:03 +08:00
yihaoDeng
d0503a8a3f
fix invalid read
2023-09-05 12:11:58 +08:00
Hongze Cheng
8dbdeccc8f
fix: coverity scan
2023-09-05 11:41:36 +08:00
wade zhang
8f27724f1f
Merge pull request #22701 from taosdata/fix/test_1x
...
test: add stream cases to main
2023-09-05 10:57:38 +08:00
Haojun Liao
0441c7a870
Merge branch 'fix/3_liaohj' of github.com:taosdata/tdengine into fix/3_liaohj
2023-09-05 10:40:48 +08:00
Haojun Liao
5b3cb8ec42
fix(stream): fix memory leak.
2023-09-05 09:27:16 +08:00
Haojun Liao
db8073dadd
fix(stream): fix memory leak.
2023-09-04 23:13:57 +08:00
Haojun Liao
77eed06bcd
Merge branch '3.0' into fix/3_liaohj
2023-09-04 18:51:07 +08:00
Haojun Liao
aeea699c9c
Merge branch '3.0' into fix/3_liaohj
2023-09-04 15:53:39 +08:00
Haojun Liao
ed22dd5f26
fix(stream): fix deadlock caused during merging branch.
2023-09-04 14:09:39 +08:00
Haojun Liao
375d0abea5
fix(stream): merge main.
2023-09-04 13:12:53 +08:00
Haojun Liao
21dab8ceab
other: merge 3.0
2023-09-04 13:08:19 +08:00
yihaoDeng
03cddfa7ce
fix rc
2023-09-04 10:33:01 +08:00
wangmm0220
fd85d5885a
fix:add limit time for consume in 1 seconds
2023-09-01 16:57:49 +08:00
wangmm0220
02ac3eac5a
fix:logic error
2023-09-01 16:51:44 +08:00
Haojun Liao
4fee5ba59a
fix(stream): even in ck, start stream tasks.
2023-09-01 14:40:30 +08:00
dapan1121
cc17848b78
fix: merge 3.0 to main
2023-09-01 13:24:47 +08:00
dapan1121
2141ac8460
Merge remote-tracking branch 'origin/main' into fix/m23.2
2023-09-01 11:21:38 +08:00
Hongze Cheng
113867081e
enh: upgrade more efficiently
2023-09-01 10:16:10 +08:00
dapan1121
228e6c6acd
Merge remote-tracking branch 'origin/main' into 3.0
2023-09-01 10:01:10 +08:00
Haojun Liao
e8294ed8dc
fix(stream): fix bug in multi-replica vnode redistribute.
2023-09-01 03:10:12 +08:00
Haojun Liao
e816d0efa5
Merge pull request #22669 from taosdata/fix/TD-26069
...
fix invalid insert
2023-08-31 18:29:25 +08:00
wangmm0220
a02ab4ccfb
fix:coredump if saved epoch bigger than request epoch & modify test cases
2023-08-31 17:35:41 +08:00
yihaoDeng
1833be028f
fix invalid insert
2023-08-31 15:28:31 +08:00
yihaoDeng
9fd0bff673
fix invalid insert
2023-08-31 14:57:26 +08:00
Haojun Liao
92e258617a
refactor: do some internal refactor.
2023-08-31 14:31:45 +08:00
Haojun Liao
e2bb64eb18
refactor: do some internal refactor.
2023-08-31 14:23:46 +08:00
Haojun Liao
3fc3dafca6
refactor: do some internal refactor.
2023-08-31 13:46:48 +08:00
Haojun Liao
e53b5d4392
refactor: do some internal refactor.
2023-08-31 11:01:53 +08:00
Haojun Liao
0facde6ddc
Merge pull request #22659 from taosdata/fix/TD-26035
...
fix(stream): do not restart the stream tasks when it is running.
2023-08-31 10:16:59 +08:00
Haojun Liao
0c599fa869
Merge pull request #22415 from taosdata/szhou/tsdb-neigh-block
...
tsdb neighbouring block search and set it to global block iterator
2023-08-31 09:46:37 +08:00
wangmm0220
7f2a9a7262
fix:cancel the limit time for consume
2023-08-31 09:07:40 +08:00
wade zhang
68e4a72021
Merge pull request #22643 from taosdata/feat/audit-user-typestr
...
alter user type to str
2023-08-31 07:59:31 +08:00
wangmm0220
4f20359f43
fix:modify log level to trace
2023-08-30 23:57:48 +08:00
Haojun Liao
a2c6e4306a
fix(stream): reset the counter.
2023-08-30 20:20:20 +08:00
Haojun Liao
fd2f988cdb
fix(stream): reset the counter.
2023-08-30 20:19:51 +08:00
Haojun Liao
5d23df100c
fix(stream): ignore the fill-history tasks.
2023-08-30 19:07:06 +08:00
Haojun Liao
65eaa9b15f
fix(stream): add task release.
2023-08-30 19:06:12 +08:00
wangmm0220
23c4d7eb0a
fix:dead lock
2023-08-30 18:10:19 +08:00
dmchen
3d9274d713
create table db name
2023-08-30 17:28:03 +08:00
Haojun Liao
d99d8875e1
fix(stream): if stream task is running, do not recheck its status.
2023-08-30 17:24:13 +08:00
Haojun Liao
c5b279f045
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
2023-08-30 16:01:08 +08:00
Haojun Liao
24b1a050fc
other: merge 3.0
2023-08-30 16:00:14 +08:00
liuyao
0a72e576bd
op stream pause
...
pause data dispatch
opt stream pause
2023-08-30 14:53:49 +08:00
kailixu
1a34cd1020
chore: optimize of report time series by quantity
2023-08-30 11:45:07 +08:00
kailixu
8e20740622
enh: report time series by quantity
2023-08-30 11:39:21 +08:00
dapan1121
f6321d0c4f
Merge remote-tracking branch 'origin/main' into fix/m23.1
2023-08-30 11:03:33 +08:00
Haojun Liao
dec4d69529
fix(stream): set correct user-define table name in sink table info cache.
2023-08-30 10:52:39 +08:00
Haojun Liao
3a7a220d43
fix(stream): fix error found by ci.
2023-08-30 10:14:01 +08:00
kailixu
9d1ac801ed
Merge branch '3.0' into enh/TS-3812-3.0
2023-08-30 09:27:17 +08:00
Haojun Liao
610132e29a
Merge pull request #22633 from taosdata/fix/update_db_attr
...
fix(tsdb): add more check for block rows
2023-08-29 22:05:57 +08:00
wade zhang
701ac939c1
Merge pull request #22632 from taosdata/fix/ttl
...
fix/TD-26032: ttl cache entry record the original information for deletion
2023-08-29 18:27:50 +08:00
Haojun Liao
8dadae5d3a
fix(stream): fix invalid read.
2023-08-29 18:24:32 +08:00
Haojun Liao
d6368798da
fix(query): disable the set quit flag for tsdbreader.
2023-08-29 18:11:17 +08:00
Haojun Liao
b740ce8ad6
fix(tsdb): add more check for block rows to detect the duplicate rows in data block.
2023-08-29 17:49:43 +08:00
Haojun Liao
204fb97f68
fix(stream): fix error in snode, fix memory leaks, fix repeatly create bug in sink task.
2023-08-29 17:34:31 +08:00
Shungang Li
df2b2484df
fix: ttl cache entry record the original information for deletion
2023-08-29 17:18:22 +08:00
Minglei Jin
82fc1f41fb
fix(tsdb/cache read): remove all null row
2023-08-29 16:15:00 +08:00
kailixu
f00596868f
fix: remove duplicated line
2023-08-29 16:12:49 +08:00
kailixu
db07511c93
enh: report time series by period and quantity
2023-08-29 16:08:51 +08:00
wade zhang
53a24e04f2
Merge pull request #22604 from taosdata/feat/audit-db-detail
...
audit db detail
2023-08-29 15:46:10 +08:00
Haojun Liao
6e4acddd96
Merge pull request #22603 from taosdata/fix/TD-25962
...
fix:unregister push manager if delete subscribe to avoid tqProcessPol…
2023-08-29 10:58:49 +08:00
Minglei Jin
432eaf5110
Merge branch '3.0' into fix/TD-25963
2023-08-29 10:51:53 +08:00
Minglei Jin
b88d79d2ef
fix(tsdb/open fs): fix retval
2023-08-29 10:33:20 +08:00
wade zhang
ff6de8ebe2
Merge pull request #22600 from taosdata/fix/TD-25010-10
...
enh(s3/evict): evict cache data files for other migrated head, stt, etc.
2023-08-28 18:12:40 +08:00
dmchen
1372cede48
init
2023-08-28 17:44:10 +08:00
dapan1121
778e50da79
Merge pull request #22592 from taosdata/fix/m23.0
...
Fix/m23.0
2023-08-28 17:35:35 +08:00
wangmm0220
2e04d513a4
fix:unregister push manager if delete subscribe to avoid tqProcessPollPush
2023-08-28 16:41:28 +08:00
Minglei Jin
9ef455a454
enh(s3/evict): evict cache data files for other migrated head, stt, etc.
2023-08-28 15:57:13 +08:00
Haojun Liao
05bb164675
fix(stream): release tasks.
2023-08-28 15:56:02 +08:00
Haojun Liao
391103bc5a
fix(stream): do dome internal refactor.
2023-08-28 15:54:01 +08:00
Haojun Liao
33672f2f35
fix(stream): release stream tasks.
2023-08-28 15:52:54 +08:00
wade zhang
cd3702e91c
Merge pull request #22596 from taosdata/fix/TD-25963
...
fix(tsdb/s3): fix scan and fix with s3 files
2023-08-28 15:19:47 +08:00
Minglei Jin
f299ae9bc3
fix(tsdb/s3): fix scan and fix with s3 files
2023-08-28 12:22:53 +08:00
Haojun Liao
da0b4e1f92
Merge branch '3.0' into enh/triggerCheckPoint2
2023-08-28 10:55:38 +08:00
dapan1121
0cce255a02
Merge remote-tracking branch 'origin/3.0' into fix/m23.0
2023-08-28 10:06:53 +08:00
Haojun Liao
b75ae217f6
fix(stream): notify close for snode.
2023-08-28 09:53:08 +08:00
Haojun Liao
b11975f00c
Merge pull request #22534 from taosdata/mark/tmq
...
fix:[TD-258900]modify tmq trans conflict to db level
2023-08-28 09:45:47 +08:00
dapan1121
1f40da6fef
Merge remote-tracking branch 'origin/main' into 3.0
2023-08-28 09:28:55 +08:00
dmchen
06083e1eb9
init
2023-08-28 09:15:51 +08:00
dapan1121
cda08087b9
Merge pull request #22586 from taosdata/fix/TD-25936.3
...
fix: no explain response issue
2023-08-28 08:52:13 +08:00
Haojun Liao
6b327886e9
fix(stream): add null ptr check.
2023-08-27 00:27:04 +08:00
Haojun Liao
d8a6ec024a
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
2023-08-25 19:21:00 +08:00
Haojun Liao
7ceb8dc627
fix(stream): disable the follower to execute the stop/resume instruction.
2023-08-25 19:20:49 +08:00
yihaoDeng
22b8d90fbc
fix invalid read
2023-08-25 18:34:11 +08:00
wangmm0220
047707fa17
fix:error in privilege
2023-08-25 17:56:17 +08:00
Haojun Liao
43a3f9f535
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
2023-08-25 17:32:50 +08:00
Haojun Liao
e013ba6795
fix(stream): fix the counter.
2023-08-25 17:32:34 +08:00
Minglei Jin
f0fdbaa3f3
fix(tsdb/close): fix uaf with file closing
2023-08-25 17:27:32 +08:00
Haojun Liao
60d1df0e25
Merge branch '3.0' into enh/triggerCheckPoint2
2023-08-25 15:49:28 +08:00
Haojun Liao
ab2aad2b2c
fix(stream): update the task status even it is in stop status.
2023-08-25 15:32:55 +08:00
dapan1121
e24498b0fd
enh: add task notify
2023-08-25 14:59:34 +08:00
Hongze Cheng
e1095e7d02
fix: improve upgrade speed
2023-08-25 14:40:29 +08:00
Haojun Liao
4c7ad54c9c
fix(stream): not restart tasks when in restoring procedure.
2023-08-25 11:28:28 +08:00
Haojun Liao
38bb123701
fix(stream): release task.
2023-08-25 10:33:15 +08:00
Haojun Liao
ce1a3a379c
fix(stream): handle the case when the task not in ready state, and the checkpoint msg arrived.
2023-08-25 10:12:12 +08:00
Haojun Liao
6f514b2bee
Merge pull request #22561 from taosdata/fix/TD-25651
...
fix:[TD-25651] reset epoch if consumer changed to avoid consumeing no…
2023-08-25 09:09:41 +08:00
wade zhang
abe97e1e21
Merge pull request #22566 from taosdata/fix/TD-25952
...
enh(tsdb/openfile): lazy file open to read/write
2023-08-25 07:57:52 +08:00
Haojun Liao
f7ea875af1
fix(stream): add some logs.
2023-08-24 23:27:48 +08:00
Haojun Liao
f7dada53b9
Merge pull request #22559 from taosdata/fix/liaohj
...
other: merge main.
2023-08-24 19:01:18 +08:00
Haojun Liao
82e356a9b5
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
...
# Conflicts:
# source/dnode/vnode/src/tq/tq.c
2023-08-24 18:04:44 +08:00
Haojun Liao
70396aa5a5
fix(stream): wakeup the hb timer every 200ms, to speeup the close db procedure.
2023-08-24 17:54:50 +08:00
yihaoDeng
286ac3e3fc
fix merge error
2023-08-24 17:35:53 +08:00
yihaoDeng
9310d138a6
Merge branch 'enh/3.0' into enh/triggerCheckPoint2
2023-08-24 17:30:35 +08:00
yihaoDeng
8883d66227
Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2
2023-08-24 17:20:12 +08:00
yihaoDeng
090515c684
refactor code
2023-08-24 17:20:04 +08:00
Haojun Liao
caf20d7b5d
fix(stream): release the stream task.
2023-08-24 17:16:34 +08:00
Minglei Jin
70871139bf
enh(tsdb/openfile): lazy file open to read/write
2023-08-24 17:16:28 +08:00
wangmm0220
b83cc11043
fix:[TD-25651] reset epoch if consumer changed to avoid consumeing no data
2023-08-24 16:38:53 +08:00
wangmm0220
49216ffa54
fix:transaction in tmq
2023-08-24 16:32:15 +08:00
Haojun Liao
7d9d4ae850
fix(stream): fix the ptr ref.
2023-08-24 16:26:30 +08:00
Haojun Liao
5344efe181
fix(stream): adjust the ptr.
2023-08-24 16:22:24 +08:00
Haojun Liao
4c6bc4d2c3
fix(stream): continue check wal when meeting empty delete block msg.
2023-08-24 16:10:03 +08:00
Haojun Liao
523bad3951
fix(stream): continue check wal when meeting empty delete block msg.
2023-08-24 15:45:43 +08:00
Haojun Liao
2c9f28d97f
Merge branch 'main' into fix/liaohj
2023-08-24 14:12:15 +08:00
wangjiaming0909
7fad1de841
Revert "feat: show create table, desc table with col comments"
...
This reverts commit 16754b5ac1 .
2023-08-24 13:38:41 +08:00
wade zhang
0860670d37
Merge pull request #22526 from taosdata/enh/TD-25445-new
...
enh/TD-25445: ttl split flush and drop table
2023-08-24 13:57:07 +08:00
shenglian-zhou
e76e6bbb84
Update tsdbReadUtil.c
2023-08-24 11:34:56 +08:00
shenglian-zhou
1965703d53
Merge branch '3.0' into szhou/tsdb-neigh-block
2023-08-24 10:58:23 +08:00
yihaoDeng
3afea998ac
refactor log
2023-08-24 10:15:15 +08:00
Haojun Liao
230d8c2d80
fix(stream): fix error in stream computing after vnode is transferred to other dnodes.
2023-08-23 17:50:44 +08:00
Haojun Liao
b0c5fa8290
fix(stream): reset the task status.
2023-08-23 14:10:41 +08:00
Hongze Cheng
a601cd21bd
fix: alter stt_trigger bug
2023-08-23 13:31:19 +08:00
Shungang Li
458fd07976
enh: ttl split flush and drop table
...
config:
1. ttlFlushThreshold: maximum number of dirty items in memory
2. tsTtlBatchDropNum: number of tables dropped per batch
3. tsTrimVDbIntervalSec: interval of trimming db in all vgroups
2023-08-23 11:13:34 +08:00
wade zhang
8c4062c1b0
Merge pull request #22515 from taosdata/fix/TD-25819-2
...
fix(tsdb/file): save errno for shell reporting
2023-08-23 10:49:48 +08:00
wade zhang
e069d72229
Merge pull request #22513 from taosdata/FIX/TD-25864-3.0
...
enh: adjust the order of pre-close actions in vnodePreClose
2023-08-22 17:27:17 +08:00
Haojun Liao
af80d94a88
refactor: do some internal refactor.
2023-08-22 15:43:50 +08:00
Minglei Jin
345743aba5
fix(tsdb/file): save errno for shell reporting
2023-08-22 14:44:32 +08:00
Haojun Liao
cc8b2263cb
fix(stream): fix error in heartbeat from vnode.
2023-08-22 13:37:38 +08:00
Benguang Zhao
8be670aee8
enh: place vnodeSyncPreStop ahead of vnodeQueryPreStop in vnodePreClose
2023-08-22 11:30:40 +08:00
Haojun Liao
64556c9f1d
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
2023-08-22 10:47:02 +08:00
Haojun Liao
def0877980
fix(stream): add timer to check stream task status.
2023-08-22 10:46:49 +08:00
dm chen
b899a8b7df
Merge branch '3.0' into feat/TD-22970
2023-08-22 10:12:30 +08:00
yihaoDeng
1531e2d7d3
Merge branch 'enh/3.0' into enh/triggerCheckPoint2
2023-08-22 09:51:38 +08:00
Haojun Liao
873c22abb1
fix(stream): reset update stream tasks.
2023-08-21 19:32:27 +08:00
Haojun Liao
8b27f98ee4
refactor: do some internal refactor.
2023-08-21 19:08:27 +08:00
yihaoDeng
387b4d365e
refactor checkpoint
2023-08-21 19:07:15 +08:00
Hongze Cheng
b8d62a86ed
feat: clean useless file
2023-08-21 16:29:48 +08:00
Haojun Liao
29bb5854cc
fix(stream): fix error in check stream state.
2023-08-21 11:48:55 +08:00
dm chen
dda51d8019
Merge branch '3.0' into feat/TD-22970
2023-08-21 10:50:45 +08:00
wade zhang
54e1f69db4
Merge pull request #22481 from taosdata/fix/TD-25822
...
enh(tsdb/write): timestamp out of range with s3's last tier storage
2023-08-21 09:33:06 +08:00
yihaoDeng
6fe649c458
Merge branch 'enh/3.0' into enh/triggerCheckPoint2
2023-08-21 09:12:40 +08:00
Haojun Liao
b8101afbe2
fix(stream): refactor the tasks restart mechanism.
2023-08-18 22:36:38 +08:00
Minglei Jin
c4a3a5da35
vnode: fix write to s3 last tier
2023-08-18 18:02:53 +08:00
wade zhang
a7e11c2520
Merge pull request #22482 from taosdata/fix/TD-25818
...
fix(vnode/destroy): delete objects
2023-08-18 17:49:22 +08:00
wade zhang
87a8fe34ef
Merge pull request #22480 from taosdata/fix/TD-25819
...
fix(tsdb/reader): use ENOENT for not found objects
2023-08-18 16:49:54 +08:00
Minglei Jin
7b4bb72392
fix(vnode/destroy): delete objects
2023-08-18 16:38:26 +08:00
Minglei Jin
0242d4ce33
enh(tsdb/write): timestamp out of range with s3's last tier storage
2023-08-18 16:07:15 +08:00
Haojun Liao
c26d625152
Merge branch '3.0' into enh/triggerCheckPoint2
2023-08-18 15:51:07 +08:00
Minglei Jin
73ae493fa7
tsdb/reader: use ENOENT for not found objects
2023-08-18 15:43:08 +08:00
liuyao
9afd5155ed
Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2
2023-08-18 15:33:37 +08:00
liuyao
87c65f3b68
Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2
2023-08-18 15:27:02 +08:00
dapan1121
9b953707b8
Merge remote-tracking branch 'origin/main' into fix/mainto3.0
2023-08-18 14:42:43 +08:00
Haojun Liao
edbad45772
other: add logs.
2023-08-18 13:45:08 +08:00
dm chen
e393a98ee9
Merge branch '3.0' into feat/TD-22970
2023-08-18 13:37:18 +08:00
Haojun Liao
a8b53c2e69
other: add logs.
2023-08-18 10:51:59 +08:00
Haojun Liao
633ecf66e5
other: add logs.
2023-08-18 10:39:32 +08:00
Haojun Liao
9ad8cf48dc
other: add logs.
2023-08-18 10:38:24 +08:00
Haojun Liao
87785b1d9c
refactor: add some logs.
2023-08-18 10:30:00 +08:00
slzhou
4e2a26e8be
Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan
2023-08-18 08:46:17 +08:00
Hongze Cheng
8582e0c71a
fix: important fix for compact file corruption
2023-08-17 18:13:37 +08:00
dmchen
5f138941f8
tsdb snap core
2023-08-17 17:58:35 +08:00
slzhou
85d1dbe00a
Merge branch '3.0' of github.com:taosdata/TDengine into szhou/select-tags-scan
2023-08-17 16:27:37 +08:00
Benguang Zhao
7735e6f388
Merge branch 3.0 to FEAT/TD-25699-3.0
2023-08-17 16:04:23 +08:00
shenglian zhou
4a9391929c
fix: select tags - ctb cursor pause/unlock and lock/resume
2023-08-17 14:59:17 +08:00
dapan1121
0e10e94a40
Merge pull request #22453 from taosdata/feat/TD-25685
...
feat: support column comment
2023-08-17 14:23:54 +08:00
wangjiaming0909
16754b5ac1
feat: show create table, desc table with col comments
2023-08-17 11:39:34 +08:00
liuyao
5ce7688a93
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor
2023-08-17 09:06:46 +08:00
wade zhang
e493a30a0b
Merge pull request #22460 from taosdata/fix/tsdb_snapshot_bug
...
fix: tsdb snapshot bug
2023-08-17 08:25:32 +08:00
Haojun Liao
6746339609
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
...
# Conflicts:
# source/libs/stream/src/streamSnapshot.c
2023-08-17 00:08:44 +08:00
Haojun Liao
ea6574b3c7
other: merge 3.0
2023-08-17 00:07:55 +08:00
Haojun Liao
f8f8e7a8f0
Merge pull request #22465 from taosdata/fix/3_liaohj
...
fix(stream): add the back pressure for sink node.
2023-08-16 22:59:36 +08:00
yihaoDeng
114df7c349
fix transfer error
2023-08-16 11:37:15 +00:00
Haojun Liao
80506b564b
Merge pull request #22461 from taosdata/fix/liaohj
...
refactor: do some internal refactcor
2023-08-16 19:26:39 +08:00
Haojun Liao
9a76ae72d6
fix(stream): add the back pressure for sink node.
2023-08-16 19:11:43 +08:00
Hongze Cheng
32c5b6a947
fix: tsdb snapshot bug
2023-08-16 18:21:02 +08:00
Haojun Liao
cbd24bb254
refactor: do some internal refactor
2023-08-16 18:20:34 +08:00
dmchen
fee4b875d1
error code
2023-08-16 17:49:17 +08:00
Hongze Cheng
cedc7bf1b6
fix: memory leak when commit
2023-08-16 17:21:51 +08:00
yihaoDeng
ab7e2b3122
Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2
2023-08-16 09:00:30 +00:00
dm chen
e020c4e8c5
Merge pull request #22456 from taosdata/3.0
...
merge 3.0 to feat/TD-22970
2023-08-16 16:49:43 +08:00
Haojun Liao
f1359076c1
Merge pull request #22450 from taosdata/fix/3_liaohj
...
other: merge main.
2023-08-16 16:48:33 +08:00
Haojun Liao
d63758a1c5
fix(stream): fix error in execute task on a tranferred node.
2023-08-16 15:24:24 +08:00
yihaoDeng
993ae84398
close backend
2023-08-16 07:17:15 +00:00
Haojun Liao
4ea58e5682
refactor: do some internal refactor.
2023-08-16 11:44:05 +08:00
Haojun Liao
6609882f9f
fix(tsdb): add stt statistics block buffer, and do some internal refactor.
2023-08-16 10:55:07 +08:00
dmchen
de5aedd8f3
vnode.json
2023-08-16 10:20:48 +08:00
liuyao
919ffbaf72
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor
2023-08-16 10:04:07 +08:00
Haojun Liao
63bc50a723
Merge pull request #22427 from taosdata/feature/rebuildIndex0
...
rebuild index at tag0
2023-08-16 09:47:43 +08:00
liuyao
fc09f8ef1e
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor
2023-08-16 09:36:28 +08:00
Haojun Liao
ad9f3cbc43
other: merge main.
2023-08-16 09:14:10 +08:00
Haojun Liao
7628be236d
other: merge main.
2023-08-16 09:03:54 +08:00
dapan1121
df13c6fa3e
Merge pull request #22410 from taosdata/szhou/tag-scan-opt
...
enhance: tag scan optimization
2023-08-16 08:58:17 +08:00
wade zhang
1a1a12b7b8
Merge pull request #22327 from taosdata/fix/TD-25010-3
...
feat(tsdb/cos): s3 migration
2023-08-16 08:02:20 +08:00
slzhou
4fdaaba3ce
Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt
2023-08-15 17:18:25 +08:00
Benguang Zhao
239a79d405
enh: add some vnode info in SStatusReq
2023-08-15 17:06:33 +08:00
Minglei Jin
1792bf306e
vnode: fix cos cache evicting
2023-08-15 16:54:26 +08:00
Haojun Liao
39079ab64a
fix(stream): load term from sync model to decide if the node is restart or not
2023-08-15 15:52:06 +08:00
Minglei Jin
c4e5cfd2fb
retention: return code from copy
2023-08-15 15:40:40 +08:00
Minglei Jin
bd758e0269
retention: remove old files last
2023-08-15 15:14:34 +08:00
Minglei Jin
8639c22cc0
vnode, common: USE_COS def
2023-08-15 14:53:58 +08:00
liuyao
1b4e51ee4a
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor
2023-08-15 14:20:49 +08:00
Haojun Liao
b1d35f43ba
enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not.
2023-08-15 09:25:05 +08:00
Haojun Liao
ff17763ed6
Merge pull request #22417 from taosdata/mark/tmq
...
opti:wal logic
2023-08-15 09:16:29 +08:00
Haojun Liao
9e3733a02c
Merge pull request #22358 from taosdata/feat/TD-24559
...
feat:[TD-24559]support geomety type in schemaless
2023-08-14 22:06:41 +08:00
liuyao
9d1e5a512d
add stream task id
2023-08-14 17:52:39 +08:00
Haojun Liao
2e6263b43f
fix(stream): fix memory leak.
2023-08-14 17:16:11 +08:00
yihaoDeng
cf9f9ab471
rebuild index at tag0
2023-08-14 08:01:20 +00:00
Haojun Liao
a1e554fbf3
refactor: exec directly not asynchnoized.
2023-08-14 15:05:13 +08:00
Minglei Jin
989abc2bf6
vnode/cos: move includes into USE_COS
2023-08-14 15:03:17 +08:00
Haojun Liao
91710b0c0f
fix(stream):
2023-08-14 14:56:17 +08:00
Minglei Jin
c97b9249fc
cos: only for linux
2023-08-14 14:38:28 +08:00
slzhou
692d436d68
fix: fix ci error
2023-08-14 14:14:16 +08:00
Haojun Liao
5ec6b64aab
fix(stream): add logs.
2023-08-14 13:12:41 +08:00
Haojun Liao
ead04964fd
Merge branch 'main' into fix/liaohj
2023-08-14 12:11:15 +08:00
dapan1121
c2417eb5cd
Merge pull request #22404 from taosdata/fix/TD-25621-3.0
...
fix: dup read lock on windows
2023-08-14 11:37:05 +08:00
Haojun Liao
2806fe1c56
fix(stream): ignore the related stream task destory msg in transfer state.
2023-08-14 10:58:24 +08:00
slzhou
646e52ae7f
Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt
2023-08-14 10:19:36 +08:00
yihaoDeng
246efd83c6
refactor chpt transfer
2023-08-14 02:03:41 +00:00
wangmm0220
dd0bc0e050
fix:heap use after free
2023-08-14 09:42:55 +08:00
wade zhang
1b51f53c15
Merge pull request #22407 from taosdata/fix/TD-25671
...
fix: infinite tomb data sync loop
2023-08-14 09:25:47 +08:00
shenglian zhou
46f92d222d
fix: typo error
2023-08-14 08:52:25 +08:00
shenglian zhou
db25f6c01b
Merge branch 'szhou/tsdb-neigh-block' of github.com:taosdata/TDengine into szhou/tsdb-neigh-block
2023-08-14 08:49:25 +08:00
shenglian zhou
c5a6cac34f
fix: fix compilation error
2023-08-14 08:49:10 +08:00
Haojun Liao
01ac99a651
Merge pull request #22413 from taosdata/fix/liaohj
...
refactor: refactor the transfer state procedure.
2023-08-13 23:28:18 +08:00
slzhou
8e7fc91095
enhance: set file data block iter
2023-08-13 18:30:30 +08:00
Haojun Liao
0d38f389ab
refactor: do some internal refactor.
2023-08-13 16:25:35 +08:00
Haojun Liao
ce721a0146
fix(stream): fix error.
2023-08-12 16:32:05 +08:00
wangmm0220
efb472d54a
fix:heap use after free
2023-08-12 10:15:40 +08:00
Haojun Liao
f24b22000f
enh(stream): stop stream task before redistribute vnodes.
2023-08-11 23:46:53 +08:00
wangmm0220
767563752a
opti:wal logic
2023-08-11 20:21:13 +08:00
wangmm0220
deda4b9eed
opti:wal logic
2023-08-11 19:26:17 +08:00
Hongze Cheng
847bc0da08
fix: infinite tomb data sync loop
2023-08-11 18:10:16 +08:00
slzhou
47d2f9ad6d
fix: first run without tag cond
2023-08-11 17:52:52 +08:00
wangmm0220
7b22d37f12
fix:lost data when consumer db
2023-08-11 17:25:43 +08:00
slzhou
42a4f364c1
Merge branch 'szhou/tag-scan-opt' of github.com:taosdata/TDengine into szhou/tag-scan-opt
2023-08-11 16:48:49 +08:00
Minglei Jin
84452c8dee
cos: use static sdk
2023-08-11 16:36:53 +08:00
shenglian zhou
eb9d77d639
ehance: destroy blocklist of table scan info, add block global index list to table scan info
2023-08-11 16:33:49 +08:00
Haojun Liao
87c7e4c0fe
fix(stream): not launch stream tasks when restarting the stream tasks.
2023-08-11 16:19:46 +08:00
yihaoDeng
6e6eb05d5c
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
2023-08-11 08:03:02 +00:00
Haojun Liao
e984affe90
fix(stream): disable the stream in the followers nodes.
2023-08-11 15:58:15 +08:00
wangmm0220
25e32bbf7c
fix:offset error in tmq & add test cases
2023-08-11 14:25:12 +08:00
Haojun Liao
9322f80343
fix(stream): register the rsp callback.
2023-08-11 13:31:50 +08:00
kailixu
64a1636dd2
chore: trigger CI
2023-08-11 12:54:45 +08:00
kailixu
1d089fe085
fix: dup read lock on windows
2023-08-11 11:34:57 +08:00
yihaoDeng
99be2836b2
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
2023-08-11 02:50:12 +00:00
Haojun Liao
1e636a2ef9
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
2023-08-11 10:37:40 +08:00
Haojun Liao
6a9826cf6e
enh(stream): update the stream task epset.
2023-08-11 10:37:25 +08:00
yihaoDeng
ba4ce9db02
Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer
2023-08-11 02:15:07 +00:00
Haojun Liao
d9bc881fb3
Merge pull request #22384 from taosdata/mark/tmq
...
fix:offset error in tmq & add test cases
2023-08-11 10:00:08 +08:00
Minglei Jin
4513acfee9
cos: use static libs for mxml, apr, apu, curl
2023-08-11 09:54:54 +08:00
yihaoDeng
32983a11e1
add log and fix crash
2023-08-10 20:34:00 +08:00
shenglian zhou
b2e615d4e7
enhance: tag scan cursor based block
2023-08-10 17:30:01 +08:00
wangmm0220
78fd70202c
fix:offset error in tmq & add test cases
2023-08-10 16:18:53 +08:00
Minglei Jin
c04ada3573
cos: link with static libs
2023-08-10 15:28:22 +08:00
Minglei Jin
cd63e81450
cos: separate building phase for apr & apr-util
2023-08-10 14:18:12 +08:00
dm chen
dd271bca6d
Merge pull request #22394 from taosdata/3.0
...
merge 3.0 to feat/TD-22970
2023-08-10 14:14:22 +08:00
Haojun Liao
a713b37f35
fix(stream): add more logs.
2023-08-10 14:07:29 +08:00
Haojun Liao
161fd6902a
fix(stream): fix the acquire task.
2023-08-10 12:45:20 +08:00
Minglei Jin
33967b243b
Merge branch '3.0' into fix/TD-25010-3
2023-08-10 12:14:01 +08:00
Haojun Liao
f633c7fe2b
other: merge 3.0.
2023-08-10 11:56:30 +08:00
Haojun Liao
b658608541
Merge pull request #22388 from taosdata/fix/3_liaohj
...
other: merge main.
2023-08-10 11:43:02 +08:00
yihaoDeng
ef247cdb1d
support reopen stream state
2023-08-10 01:49:26 +00:00
Haojun Liao
c10b323188
other: merge main.
2023-08-10 09:26:33 +08:00
Haojun Liao
4393375e47
fix(stream): set correct task id.
2023-08-10 02:16:04 +08:00
Haojun Liao
0757e88ced
fix(stream): set the correct hash keys.
2023-08-09 23:52:14 +08:00
Haojun Liao
7e3f1d92fc
Merge branch 'main' into fix/liaohj
2023-08-09 19:43:24 +08:00
wangmm0220
1f5532fd67
fix:offset error in tmq & add test cases
2023-08-09 19:41:22 +08:00
Minglei Jin
a853d9d40c
mxml: use ~/local/include
2023-08-09 18:21:55 +08:00
Haojun Liao
1e8579e8c5
fix(stream): fix other cases.
2023-08-09 16:04:48 +08:00
Haojun Liao
4c92997328
fix(stream): use streamId&taskId to identify the stream task in the stream meta.
2023-08-09 15:52:23 +08:00
Hui Li
584427dd44
Merge pull request #22374 from taosdata/szhou/restore-minglei-main
...
fix: restore stt/block merge back
2023-08-09 14:40:03 +08:00
Minglei Jin
b08d5b4d42
mxml: add include dir to vnode
2023-08-09 14:02:10 +08:00
Minglei Jin
7e2859ed43
apr: use tarball to avoid ./buildconf
2023-08-09 13:03:37 +08:00
Haojun Liao
3cdb16352c
fix(stream): avoid launching check downstream when failed to add stream task into stream meta.
2023-08-09 12:03:14 +08:00
Minglei Jin
2e0519b960
apr: fix apr & apr-util project names
2023-08-09 11:01:42 +08:00
Minglei Jin
7114ad63e5
apr:makefile for apr & apr-util
2023-08-09 10:54:17 +08:00
Minglei Jin
4d1155a5cf
curl: makefile for curl
2023-08-09 10:43:27 +08:00
shenglian zhou
e9e06d1eae
fix: restore stt block/data block merge back
2023-08-09 10:36:54 +08:00
shenglian zhou
2b1478f46e
Revert "fix(tsdb/read2): reset stt reader when suspended"
...
This reverts commit 079d7ff69e .
2023-08-09 10:36:26 +08:00
Haojun Liao
f3c5f20ee2
enh(stream): add timer to check the node changing.
2023-08-09 10:25:16 +08:00
Minglei Jin
16e015253b
s3/mxml: remove os external dependency
2023-08-09 10:10:25 +08:00
Haojun Liao
bb39d94f9c
Merge pull request #22357 from taosdata/fix/liaohj
...
other: merge fix from 3.0 to main.
2023-08-09 09:05:54 +08:00
wangmm0220
d322cfce50
fix:add hashIteratorCancel for hash iterator
2023-08-08 16:28:51 +08:00
Haojun Liao
17c6143471
fix(stream): check more status when handling the state transfer.
2023-08-08 15:08:11 +08:00
Hongze Cheng
c8f106106a
fix: update assert issue
2023-08-08 14:49:05 +08:00
dm chen
70a598f072
Merge pull request #22355 from taosdata/3.0
...
merge 3.0 to TD-22970
2023-08-08 09:53:07 +08:00
Hui Li
05e356cd81
Merge pull request #22346 from taosdata/fix/TD-25612
...
fix: snapshot invalid read
2023-08-08 09:19:55 +08:00
Haojun Liao
458143c8b7
Merge pull request #22348 from taosdata/szhou/restore-tsdb-minglei
...
fix: restore stt block and data block merge back
2023-08-08 08:58:02 +08:00
Haojun Liao
f8ee055641
other: merge 3.0
2023-08-08 00:19:08 +08:00
Haojun Liao
ad3e231b2f
Merge pull request #22350 from taosdata/fix/3_liaohj
...
other: merge main and fix bugs in stop stream tasks.
2023-08-07 22:57:13 +08:00
Haojun Liao
aea1690cd1
fix(stream): fix the stream task after checking if it is in the timer activities.
2023-08-07 17:49:36 +08:00
shenglian zhou
ec1270f75c
fix: restore stt block/data block merge back
2023-08-07 17:17:12 +08:00
Minglei Jin
9e4da6c089
s3/config: parsing s3 configuration
2023-08-07 17:14:58 +08:00
shenglian zhou
9ddab11d98
Revert "fix(tsdb/read2): reset stt reader when suspended"
...
This reverts commit 079d7ff69e .
2023-08-07 17:13:49 +08:00
yihaoDeng
b6c991f896
support reopen stream state
2023-08-07 08:59:04 +00:00
yihaoDeng
eeb97351e8
support reopen stream state
2023-08-07 08:51:01 +00:00
Haojun Liao
e6b80e6c52
Merge branch '3.0' into fix/3_liaohj
2023-08-07 16:26:31 +08:00
Haojun Liao
225c0e61dc
hen(stream): support the rollback and checkdown stream tasks.
2023-08-07 16:13:39 +08:00
Hongze Cheng
a545d45b5e
fix: snapshot invalid read
2023-08-07 16:12:03 +08:00
Minglei Jin
fac7e521e9
s3/evict: fetch atime from stat file
2023-08-07 15:59:37 +08:00
Hongze Cheng
661f2aca98
fix: memory leak
2023-08-07 14:13:44 +08:00
wangmm0220
9ecabb30f5
fix:ref is not there
2023-08-07 10:27:44 +08:00
wangmm0220
5f02e2ddfb
fix:ref is not there
2023-08-07 09:31:29 +08:00
Haojun Liao
8a11a0418f
other: merge 3.0
2023-08-07 09:19:26 +08:00
wangmm0220
d9a1695257
fix:add log
2023-08-04 18:07:44 +08:00
Minglei Jin
65d8af19ed
s3: new api s3Size
2023-08-04 16:35:35 +08:00
Minglei Jin
87783a9650
s3query/get: pull object to local
2023-08-04 15:37:52 +08:00
Minglei Jin
ebd09ca532
tsdb/write: use keep1 as minKey instead of keep2
2023-08-04 13:44:17 +08:00
Minglei Jin
88d755be76
feat(tsdb/cos): s3 migration
2023-08-04 13:31:00 +08:00
wade zhang
abe15cc68e
Merge pull request #22315 from taosdata/szhou/fix-td25385-main
...
fix: keep stt iterator valid in the list
2023-08-04 08:02:16 +08:00
slzhou
fef091b13d
fix: keep the stt iterator valid
2023-08-03 21:50:50 +08:00
shenglian zhou
b85c1ae8a1
fix: remove the core
2023-08-03 21:50:50 +08:00
shenglian zhou
5322e38dfe
fix: add init add check it
2023-08-03 21:50:50 +08:00
shenglian zhou
97b15ed718
fix: delete SLDataItem if stt level files num is smaller
2023-08-03 21:50:50 +08:00
slzhou
1cb1451e41
fix: set nextIndex when get neighbouring index
2023-08-03 18:26:29 +08:00
dm chen
5b03ab1705
Merge branch '3.0' into feat/TD-22970
2023-08-03 17:43:51 +08:00
yihaoDeng
f9d0874e45
support reopen stream state
2023-08-03 08:24:50 +00:00
wade zhang
68f2018246
Merge pull request #22289 from taosdata/szhou/fix-25385
...
fix: keep stt iterator valid
2023-08-02 20:22:54 +08:00
wade zhang
13c713d33b
Merge pull request #22290 from taosdata/3.0_main
...
merge 3.0 into branch main
2023-08-02 16:04:08 +08:00
Hongze Cheng
f90f0b7047
disable infinite count loop
2023-08-02 15:51:51 +08:00
Minglei Jin
cff85550f9
Merge branch '3.0' into 3.0_main
2023-08-02 14:10:45 +08:00
wade zhang
c24b52ad82
Merge pull request #22277 from taosdata/fix/TD-25400
...
enh(tsdb/cache/read): lazy init table map hash and entries
2023-08-02 14:08:43 +08:00
Haojun Liao
0feffc687b
fix(tsdb): check uid in multiple stt statistics blocks.
2023-08-02 12:44:45 +08:00
Minglei Jin
0e51277521
cache/reader: cleanup contiue nex row
2023-08-02 12:43:57 +08:00
Haojun Liao
2c357f1958
fix(stream): enable filter table based on table statistics.
2023-08-02 11:18:35 +08:00
Minglei Jin
7fca057a81
cache/reader: move pLastCols into single block
2023-08-02 11:10:12 +08:00
slzhou
dd8e893508
fix: keep the stt iterator valid
2023-08-02 11:02:27 +08:00
Minglei Jin
95cc540d9b
cache/reader: clean uid in all loop
2023-08-02 10:48:55 +08:00
shenglian zhou
38e797b4ff
fix: remove the core
2023-08-02 10:43:26 +08:00
shenglian zhou
d5ca51e94d
fix: add init add check it
2023-08-02 10:43:26 +08:00
shenglian zhou
6bf95c0c4d
fix: delete SLDataItem if stt level files num is smaller
2023-08-02 10:43:26 +08:00
Haojun Liao
13543f7daa
feature(stream): handle task update in tq module.
2023-08-02 10:33:41 +08:00
Minglei Jin
ed76525c4f
cache/reader: cleanup uid in signle loop
2023-08-02 10:28:13 +08:00
Minglei Jin
29b2f32821
cache reader: cleanup stt init
2023-08-02 09:49:41 +08:00
Haojun Liao
53aefa531f
Merge branch '3.0' into fix/3_liaohj
2023-08-02 09:45:21 +08:00
Haojun Liao
e1e5e9bb0f
enh(stream): check stream tasks dag.
2023-08-02 09:44:39 +08:00
Hongze Cheng
4ba4e83b5b
fix: retention file corruption
2023-08-01 20:19:13 +08:00
Minglei Jin
7d294cac5f
tsdb/cache: load current fileset's brinblk once
2023-08-01 18:56:10 +08:00
Minglei Jin
a593e887fa
cache: remove nFileset from fs state
2023-08-01 18:37:23 +08:00
Minglei Jin
7ad628417a
fix mem issue: stack-use-after-scope
2023-08-01 17:57:38 +08:00
Minglei Jin
4716fc6400
cache/fs: remove fs state's tsdb handle
2023-08-01 17:49:05 +08:00
Minglei Jin
1d5532019f
tsdb/merge-tree: cleanup comment
2023-08-01 17:25:15 +08:00
Minglei Jin
f72f129d41
cache/skyline: cleanup del array
2023-08-01 17:23:53 +08:00
Minglei Jin
c997662ba0
tsdb/cache: build skyline only if there's del data
2023-08-01 16:50:00 +08:00
Minglei Jin
94b9599f95
fix null pointer dereference
2023-08-01 16:39:14 +08:00
Haojun Liao
637f09359a
other: merge main.
2023-08-01 16:15:34 +08:00
Minglei Jin
72ac5a4e3b
tsdb/cache: use read util's uid compare functor
2023-08-01 16:08:20 +08:00
Minglei Jin
c0a0e07597
cache/read: lazy init uidList when laoding from tsdb
2023-08-01 16:02:09 +08:00
Minglei Jin
b3fae65d90
enh(tsdb/cache/read): lazy init table map hash and entries
2023-08-01 15:53:42 +08:00
Hongze Cheng
78c23f407e
fix compile issue
2023-08-01 15:04:14 +08:00
Hongze Cheng
07c40943a4
fix: TD-25408
2023-08-01 15:01:06 +08:00
wade zhang
347e78ecb5
Merge pull request #22272 from taosdata/fix/TD-25466
...
Fix/td 25466
2023-08-01 14:22:24 +08:00
Hongze Cheng
1b39147496
more refact
2023-08-01 11:36:37 +08:00
Hongze Cheng
0e46041c1a
fix: tsdbRetention memory leak
2023-08-01 11:21:40 +08:00
Haojun Liao
ae9745ecf2
Merge pull request #22258 from taosdata/mark/tmq-3.0
...
fix:add committed & seek process logic
2023-08-01 09:52:09 +08:00
Haojun Liao
ea875c58f2
Merge pull request #22263 from taosdata/mark/tmq-main
...
fix:add committed & seek process logic
2023-08-01 09:43:23 +08:00
Haojun Liao
36ef9a537f
Merge pull request #22256 from taosdata/fix/TD-25457
...
check update data
2023-07-31 22:56:05 +08:00
Haojun Liao
2640e41705
Merge pull request #22261 from taosdata/fix/3_liaohj
...
fix(stream): set the correct end key of delete block.
2023-07-31 22:55:50 +08:00
wangmm0220
68ae64cdb2
fix:add committed & seek process logic
2023-07-31 18:53:25 +08:00
wangmm0220
cddf27e8b4
fix:add committed & seek process logic
2023-07-31 18:48:50 +08:00
Haojun Liao
d45596bb33
fix(stream): kill task when pause the stream execution.
2023-07-31 18:07:37 +08:00
wangmm0220
6179618b17
fix:add committed & seek process logic
2023-07-31 17:56:04 +08:00
liuyao
32b59af4b1
check update data
2023-07-31 17:32:24 +08:00
wangmm0220
8093ef2dc8
Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq
2023-07-31 16:14:25 +08:00
Haojun Liao
9981cecbed
refactor: do some internal refactor.
2023-07-31 15:24:35 +08:00
Minglei Jin
079d7ff69e
fix(tsdb/read2): reset stt reader when suspended
2023-07-31 15:21:47 +08:00
wade zhang
c7fa5ed6ef
Merge pull request #22247 from taosdata/fix/TD-25436
...
fix(tsdb/cache): check stt data with empty brin index
2023-07-31 11:24:37 +08:00
Minglei Jin
135beebc0a
fix(tsdb/cache): check stt data with empty brin index
2023-07-31 09:15:08 +08:00
wade zhang
bae028d65c
Merge pull request #22230 from taosdata/mark/tmq
...
fix:semaphore always wait in tmq commit logic
2023-07-31 09:10:13 +08:00
wade zhang
c26165975d
Merge pull request #22227 from taosdata/fix/TS-3728
...
fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version
2023-07-30 14:28:56 +08:00
Haojun Liao
8dfef8768a
other: merge 3.0
2023-07-29 22:54:16 +08:00
Haojun Liao
0bd2548937
fix(stream): initialize the filter window initial range.
2023-07-29 16:41:01 +08:00
Haojun Liao
f6e07d1fdb
other: merge 3.0
2023-07-29 01:32:02 +08:00
wade zhang
c19feb2fa1
Merge pull request #22236 from taosdata/fix/TD-25416
...
fix(tsdb/cache/del): use lru mutex to fix race with committing
2023-07-28 23:17:45 +08:00
Haojun Liao
936afeb5ac
refactor: do internal refactor to simple the pause/resume in case of fill history exists.
2023-07-28 19:13:03 +08:00
Haojun Liao
d5974a8f25
refactor(stream): refactor the pause/resume for fill history execution.
2023-07-28 18:05:32 +08:00
Minglei Jin
1fcbf3432c
tsdb/cache/del: remove duplicate lruMutex lock
2023-07-28 17:20:20 +08:00
wangmm0220
d982a7cb80
fix:heap use after free for wal
2023-07-28 16:59:35 +08:00
Minglei Jin
b0f65dfa62
fix(tsdb/cache/del): use lru mutex to fix race with committing
2023-07-28 16:32:07 +08:00
wangmm0220
6e673072cd
fix:conflicts
2023-07-28 14:57:13 +08:00
Haojun Liao
9f943213ed
enh(stream): update the hb info.
2023-07-28 14:23:53 +08:00
Haojun Liao
74834aea11
enh(stream): prepare hb to mnode from stream meta.
2023-07-28 13:07:16 +08:00
Haojun Liao
2a78cd2d23
Merge pull request #22215 from taosdata/fix/liaohj
...
other: merge main.
2023-07-28 13:06:17 +08:00
wangmm0220
2f6c565392
fix:pHandle not load if taosd restart
2023-07-28 11:48:53 +08:00
wade zhang
b3e5b5bd24
Merge pull request #22217 from taosdata/fix/TD-25386
...
fix(tsdb/cache): move to stt next row if data file exausted
2023-07-28 08:56:29 +08:00
Haojun Liao
ccc0f13649
Merge pull request #22214 from taosdata/fix/3_liaohj
...
fix(stream): scan wal in step2
2023-07-28 00:42:15 +08:00
Haojun Liao
7f3d1dc464
fix(stream): fix memory leak.
2023-07-27 23:06:53 +08:00
wangmm0220
77d43ef5fd
fix:tmq ci error
2023-07-27 20:28:45 +08:00
Haojun Liao
fbb33be85d
other: add some comments.
2023-07-27 18:59:38 +08:00
Haojun Liao
22a5a18fff
fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store.
2023-07-27 18:57:36 +08:00
Minglei Jin
cc9b9bd0b9
fix(tsdb/cache): move to stt next row if data file exausted
2023-07-27 17:19:42 +08:00
Haojun Liao
b145771a1b
other: merge 3.0
2023-07-27 16:38:57 +08:00
Haojun Liao
3d403dca5a
other: merge main.
2023-07-27 16:23:41 +08:00
Haojun Liao
6ff50d4eaf
fix(stream): update the step2 scan wal files.
2023-07-27 16:10:55 +08:00
wangmm0220
75eacd56f1
fix:add log
2023-07-27 15:58:32 +08:00
wade zhang
a72c11c8de
Merge pull request #22205 from taosdata/fix/TD-25315
...
fix(tsdb/commit2): new maxDelKey for commit context
2023-07-27 15:48:46 +08:00
wangmm0220
2d41a42976
Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3728
2023-07-27 15:31:16 +08:00
Haojun Liao
40fe3ef4f6
fix(stream): refactor the step2 wal scan.
2023-07-27 14:49:20 +08:00
Minglei Jin
fe495f7013
tsdb/commit2: fix commit minKey for del
2023-07-27 13:54:48 +08:00
Haojun Liao
e89f530db2
fix(stream): scan wal in step2
2023-07-27 10:55:59 +08:00
Minglei Jin
8a2764c698
tsdb/commit2: use max fileset's maxKey as initial maxDelKey
2023-07-27 10:51:17 +08:00
Minglei Jin
dd32f12f92
tsdb/commit2: reset nextKey to max to stop commit
2023-07-27 09:50:32 +08:00
Minglei Jin
992d623ae5
fix(tsdb/commit2): initialize ctx's maxDelKey with TSKEY_MIN
2023-07-27 09:34:47 +08:00
Minglei Jin
580b7124cf
fix(tsdb/commit2): new maxDelKey for commit context
2023-07-27 09:16:28 +08:00
Haojun Liao
087d54a807
Merge pull request #22198 from taosdata/fix/3_liaohj
...
fix(stream): do filter before the update check.
2023-07-26 18:57:48 +08:00
yihaoDeng
287088ae3f
fix stream state transfer
2023-07-26 10:16:06 +00:00
Haojun Liao
c57defa1c9
Merge pull request #22195 from taosdata/szhou/fix-td25369
...
fix: stt and data block merge
2023-07-26 17:11:18 +08:00
Haojun Liao
6a6830761d
fix(tsdb): check for null ptr of pScanInfo
2023-07-26 17:08:29 +08:00
Haojun Liao
3c387f6e91
fix(stream): fix syntax error.
2023-07-26 17:00:41 +08:00
Haojun Liao
432c943c25
fix(stream): do filter before the update check.
2023-07-26 16:34:39 +08:00
Haojun Liao
610f9d19c1
Merge pull request #22188 from taosdata/fix/3_liaohj
...
fix(stream): set the correct step2 scan time window range.
2023-07-26 16:34:10 +08:00
shenglian zhou
1357e623d0
fix: fix compilation error
2023-07-26 15:43:50 +08:00
shenglian zhou
79020ea4a4
fix: stt and data block merge
2023-07-26 15:01:20 +08:00
Haojun Liao
df57768a3e
Merge branch '3.0' into fix/3_liaohj
2023-07-26 14:45:11 +08:00
Haojun Liao
cdffabcdad
fix(stream): fix memory leak.
2023-07-26 14:37:04 +08:00
Haojun Liao
728112ed89
fix(stream): set correct upstream epinfo.
2023-07-26 10:26:59 +08:00
wade zhang
d8fd5b9394
Merge pull request #22190 from taosdata/fix/TD-25315
...
fix(tsdb/del): reset next key to del record's ekey
2023-07-26 10:23:01 +08:00
yihaoDeng
c61393a7a1
fix stream state transfer
2023-07-26 01:33:41 +00:00
Haojun Liao
b6eb739ae0
fix(tsdb): fix the
2023-07-26 09:14:19 +08:00
Minglei Jin
fb860726de
fix(tsdb/del): reset next key to del record's ekey
2023-07-26 08:40:44 +08:00
Haojun Liao
1c1bf63e1f
other: merge 3.0
2023-07-25 18:17:11 +08:00
wade zhang
02bc1b2a8f
Merge pull request #22186 from taosdata/fix/TD-25315
...
fix(tsdb/del): continue committing fileset if more del left
2023-07-25 17:41:30 +08:00
Haojun Liao
0bdccd2681
refactor: do some internal refactor.
2023-07-25 17:31:54 +08:00
Minglei Jin
7bfb4e0f88
fix(tsdb/del): continue committing fileset if more del left
2023-07-25 16:42:45 +08:00
wangmm0220
be4e47e9a7
fix:add macro ASSERT_NOT_CORE to control ASSERT not core in release version
2023-07-25 16:15:33 +08:00
Haojun Liao
d29f835a63
fix(stream): set the correct step2 scan time window range.
2023-07-25 15:09:22 +08:00
Haojun Liao
c2588d71c3
Merge pull request #22173 from taosdata/fix/TS-3728
...
fix:avoid request offset type is 0
2023-07-25 14:59:30 +08:00
wade zhang
2bf84c2676
Merge pull request #22179 from taosdata/FIX/TS-3702-3.0
...
enh: compatibility between getFileNamePrefix and tsdbTFileName
2023-07-25 14:26:14 +08:00
Benguang Zhao
01f45b2a99
enh: compatibility between getFileNamePrefix and tsdbTFileName
2023-07-25 11:35:35 +08:00
Minglei Jin
1bce96ea27
fix(tsdb/pageSize): use tsdbPageSize instead of szPage(tdb's)
2023-07-25 10:46:03 +08:00
wade zhang
7ea9cf1ddc
Merge pull request #22166 from taosdata/fix/TD-24422
...
fix(tsdb/cache): reuse data file reader
2023-07-25 10:28:59 +08:00
Haojun Liao
96722a07b1
Merge pull request #22174 from taosdata/fix/3_liaohj
...
fix(stream): fix the invalid check of step2 .
2023-07-25 00:30:06 +08:00
Haojun Liao
a2694b9ce9
fix(stream): fix the invalid check of step2 .
2023-07-24 19:44:28 +08:00
wangmm0220
6a0e994169
fix:avoid request offset type is 0
2023-07-24 19:24:05 +08:00
Haojun Liao
d36903bf08
Merge pull request #22162 from taosdata/fix/3_liaohj
...
fix(stream): add some logs, and remove the invalid loop.
2023-07-24 16:29:51 +08:00
wangmm0220
9628a9f74e
fix:open info log in tmq & ignore wal apply ver when read wal
2023-07-24 15:53:02 +08:00
Haojun Liao
01f11bf5a6
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
...
# Conflicts:
# source/common/src/tglobal.c
# source/libs/executor/src/timewindowoperator.c
2023-07-24 15:25:43 +08:00
Haojun Liao
1e34f84f78
other: merge 3.0
2023-07-24 15:23:03 +08:00
Minglei Jin
424dd40078
tsdb/cache: reuse pDataFileReader for same fileset
2023-07-24 14:45:35 +08:00
Haojun Liao
9bae91bcba
fix(stream): add some logs, and remove the invalid loop.
2023-07-24 13:37:44 +08:00
Haojun Liao
13bab114cb
Merge pull request #22155 from taosdata/fix/3_liaohj
...
fix(stream): refactor the halt status to check more status.
2023-07-24 11:04:08 +08:00
Minglei Jin
968cfd9e65
tsdb/cache: pLastIter null pointer check
2023-07-24 11:03:07 +08:00
wade zhang
5f25d70fc2
Merge pull request #22154 from taosdata/enh/tsdb_optimize
...
fix(tsdb/cache): new next stt row state for fs tranverse
2023-07-24 10:47:51 +08:00
Haojun Liao
1367552f38
fix(stream): refactor the halt status to check more status.
2023-07-24 10:04:15 +08:00
Haojun Liao
6a19ad3127
Merge pull request #22151 from taosdata/fix/3_liaohj
...
fix(stream): set the correct flag of pause/resume.
2023-07-24 09:07:49 +08:00
Minglei Jin
13491fab95
tsdb/cache: new next stt row state for fs tranverse
2023-07-24 08:51:20 +08:00
Haojun Liao
0b6e1a12bb
refactor: do some internal refactor.
2023-07-23 19:09:43 +08:00
Haojun Liao
e387b2f932
refactor: do some internal refactor.
2023-07-23 18:59:34 +08:00
Haojun Liao
4e0f7ffbf8
fix(stream): set the correct flag of pause/resume.
2023-07-23 18:49:56 +08:00
Haojun Liao
321be1f83f
Merge pull request #22135 from taosdata/fix/3_liaohj
...
refactor: do some internal refactor.
2023-07-22 15:06:28 +08:00
Haojun Liao
bfc4a07207
fix(stream): fix memory leak.
2023-07-22 00:20:02 +08:00
Haojun Liao
1b2636028a
fix(stream): fix memory leak.
2023-07-21 23:05:42 +08:00
Haojun Liao
16d7707b90
fix(stream): align the scan real time data for stream task.
2023-07-21 19:33:43 +08:00
wade zhang
7b1e809d98
Merge pull request #21794 from taosdata/enh/tsdb_optimize
...
for test purpose
2023-07-21 14:18:32 +08:00
wangmm0220
bb86f5c580
fix:commit offset should not plus 1
2023-07-21 11:13:05 +08:00
wangmm0220
10ebf1f438
fix:subscribeStb.py maybe failed
2023-07-21 11:07:34 +08:00
dmchen
7d480cf3ac
compatible old sync config
2023-07-21 10:31:53 +08:00
Haojun Liao
39ca9b537f
fix(stream): fix syntax error
2023-07-21 09:43:08 +08:00
Haojun Liao
c9d75eab5a
refactor: do some internal refactor.
2023-07-21 09:16:13 +08:00
Haojun Liao
db46d31ca5
fix(stream): refactor the halt function.
2023-07-21 01:32:42 +08:00
yihaoDeng
519d3b74d1
fix stream state transfer
2023-07-20 09:51:18 +00:00
Haojun Liao
9353f7c8cf
refactor: do some internal refactor.
2023-07-20 16:35:02 +08:00
Haojun Liao
c9fa170e65
refactor: do some internal refactor.
2023-07-20 16:31:46 +08:00
Haojun Liao
45cb478b31
refactor: do some internal refactor.
2023-07-20 15:36:46 +08:00
Haojun Liao
87fa8f0c4c
Merge branch '3.0' into fix/3_liaohj
2023-07-20 12:15:23 +08:00
Haojun Liao
aed99da6c1
refactor: refactor the stream task starting order.
2023-07-20 12:14:53 +08:00
yihaoDeng
6e5be0d30e
fix stream state transfer
2023-07-20 03:49:32 +00:00
Minglei Jin
48222f5dc3
tsdb/cache: move data file reader for fs iter to cache reader
2023-07-20 09:11:26 +08:00
Minglei Jin
6dd4ec41ae
tsdb/cache cleanup: remove unused fs methods
2023-07-20 08:51:03 +08:00
Minglei Jin
7f0ea10573
Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-07-20 08:42:12 +08:00
Minglei Jin
46d6dcda3e
tsdb/cache: reset skyline when clearing fileset
2023-07-20 08:41:32 +08:00
Haojun Liao
bfcc538205
fix(tsdb):disable stt statistics.
2023-07-20 00:01:30 +08:00
yihaoDeng
733db123ad
refactor code
2023-07-19 13:24:59 +00:00
Haojun Liao
97c44e7c18
refactor: do some internal refactor.
2023-07-19 18:42:02 +08:00
wangmm0220
d7d81d82a0
feat:add committed & position & commite_offset interface
2023-07-19 18:27:19 +08:00
Yihao Deng
91a15fd7bd
Merge branch '3.0' into enh/triggerCheckPoint2
2023-07-19 18:14:08 +08:00
Minglei Jin
ce71b8bbe7
Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-07-19 18:11:14 +08:00
Minglei Jin
4eaecd11de
tsdb/cache: merge fs & stt row
2023-07-19 18:10:36 +08:00
wangmm0220
5cb35f2fa6
feat:add committed & position & commite_offset interface
2023-07-19 17:29:39 +08:00
Haojun Liao
37ae80d135
fix(tsdb): fix memory leak.
2023-07-19 16:42:51 +08:00
Haojun Liao
d82fb45a4f
Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize
2023-07-19 15:01:37 +08:00
Haojun Liao
a84efab2c8
enh(tsdb): add table filter according to stt block statistics data.
2023-07-19 15:01:25 +08:00
Minglei Jin
913cfe43e8
tsdb/cache: remove input[3]
2023-07-19 12:20:54 +08:00
Minglei Jin
7a716d452e
tsdb/fs2: fix vnode get primary dir args
2023-07-19 11:36:26 +08:00
Minglei Jin
4b96bc7147
Merge branch '3.0' into enh/tsdb_optimize
2023-07-19 11:15:57 +08:00
Shungang Li
1d88a6a7c6
enh: ttlMgrFlush adjust log level
2023-07-19 11:15:54 +08:00
Minglei Jin
185081a948
tsdb/fsreader: clear last fileset's resources
2023-07-19 11:04:28 +08:00
dm chen
141004bf77
Merge branch '3.0' into feat/TD-22970
2023-07-19 10:57:40 +08:00
yihaoDeng
b1f3dfe88f
Merge branch 'enh/triggerChpt' into enh/triggerCheckPoint2
2023-07-19 02:17:42 +00:00
yihaoDeng
34c2e6a180
forbidden streamsnapshot reader
2023-07-19 02:15:12 +00:00
Haojun Liao
a32c650248
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
2023-07-19 10:05:48 +08:00
Haojun Liao
2ae95217bd
fix(stream): open inputQ by default for task deployed on snode.
2023-07-19 10:05:35 +08:00
liuyao
fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2
2023-07-19 10:02:06 +08:00
wade zhang
c3e5375f15
Merge pull request #22085 from taosdata/FEAT/TS-2699-3.0
...
feat: distribute vnode primary dirs among disks of level 0
2023-07-19 09:44:43 +08:00
wangmm0220
5c344b0159
fix:conflicts from main
2023-07-19 09:05:05 +08:00
Haojun Liao
9513f76172
fix(stream): set downstream task ready state.
2023-07-18 19:02:24 +08:00
Minglei Jin
a127e91534
tsdb/cache skyline: first round implementation of cache skyline
2023-07-18 17:17:06 +08:00
dmchen
3711fdd865
feat/TD-22970
2023-07-18 16:09:38 +08:00
Benguang Zhao
2faa3d2e7b
enh: check validity of diskPrimary during vnodeOpen
2023-07-18 15:39:29 +08:00
Minglei Jin
9f9efe9a5e
tsdb/cache reader: remove dataf & dataf last readers
2023-07-18 15:30:31 +08:00
Haojun Liao
901b7d8ecc
fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore.
2023-07-18 15:18:57 +08:00
Benguang Zhao
24fed51137
enh: tfsRename dir on primary disk at last
2023-07-18 13:58:43 +08:00
Benguang Zhao
5624ecc8df
fix: prepare vnode dir recursively in vnodeCreate
2023-07-18 11:32:23 +08:00
Benguang Zhao
6b6b7d8d8f
enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk
2023-07-18 11:32:23 +08:00
Haojun Liao
92106312d2
fix(stream): not dispatch checkpoint block result to downstream.
2023-07-18 09:43:38 +08:00
Minglei Jin
998fbe574d
tsdb/cache reader: move suid into reader's info field
2023-07-17 19:10:33 +08:00
yihaoDeng
40eb50676d
add checkpoint
2023-07-17 11:04:19 +00:00
Minglei Jin
463b5b608b
tsdb/read2: fix null pointer runtime error
2023-07-17 18:35:56 +08:00
Minglei Jin
62cfda1a88
tsdb/read2: fix UAF
2023-07-17 17:35:08 +08:00
Minglei Jin
832b68e17d
tsdb/cache: load mem del data
2023-07-17 15:48:08 +08:00
Minglei Jin
a05383e29e
tsdb/cache: new load tomb callback from tsdb mergetree
2023-07-17 15:07:10 +08:00
Minglei Jin
27b8671f97
tsdb/cache: new cacheReader field for tsdb & cache reader
2023-07-17 14:27:27 +08:00
Minglei Jin
9b0b4061e0
tsdb/cache: relayout cache row reader
2023-07-17 14:16:54 +08:00
Haojun Liao
eaaf306c81
fix(stream): fix syntax error
2023-07-17 12:54:05 +08:00
Haojun Liao
d7f7a7d6cf
fix(stream): fix syntax error
2023-07-17 12:53:36 +08:00
Haojun Liao
b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2
2023-07-17 11:50:12 +08:00
Benguang Zhao
b21e603481
enh: add the field diskPrimary to vnodeGetPrimaryDir, and entries of vnodes.json
2023-07-17 11:48:48 +08:00
Minglei Jin
8263c49c17
tsdb/cache: fix compilation
2023-07-17 09:00:17 +08:00
Minglei Jin
2b21c5e0f6
tsdb2: adapt cache with tsdb2 API
2023-07-17 08:50:54 +08:00
Haojun Liao
a9757637d9
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
2023-07-16 12:47:24 +08:00
Haojun Liao
c6a322e0ef
refactor(stream): back pressure is active, which is trigger by dispatch rsp.
2023-07-16 12:47:08 +08:00
yihaoDeng
e18c9ea672
add checkpoint
2023-07-15 04:26:34 +00:00
yihaoDeng
3c4631ef1f
add checkpoint
2023-07-14 10:06:24 +00:00
wade zhang
c2b3c2db52
Merge pull request #22066 from taosdata/fix/TD-25215-main
...
fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables for main
2023-07-14 17:53:25 +08:00
wade zhang
021fcf2a59
Merge pull request #22059 from taosdata/fix/TD-25215
...
fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables
2023-07-14 17:53:06 +08:00
Haojun Liao
b16432280e
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
2023-07-14 17:21:37 +08:00
Haojun Liao
eb7e6152ae
refactor(stream): do some internal refactor.
2023-07-14 17:21:20 +08:00
wangmm0220
6762a01d88
Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq
2023-07-14 16:44:00 +08:00
wangmm0220
bbdcbcb75b
fix:modify commit version to next validate version
2023-07-14 16:43:28 +08:00
Hongze Cheng
145c43e346
little fix
2023-07-14 16:38:35 +08:00
yihaoDeng
15f5fd19eb
fix recover error
2023-07-14 14:47:06 +08:00
yihaoDeng
e16a3935a5
fix coverity scan problem
2023-07-14 14:40:32 +08:00
Shungang Li
a48d359f8b
fix: ttlMgrDeleteTtl should ignore ttl 0 tables
2023-07-14 14:37:17 +08:00
Hongze Cheng
25120cede4
fix sma merge error
2023-07-14 13:46:01 +08:00
Hongze Cheng
5a89b96e91
make compile
2023-07-14 10:21:06 +08:00
Hongze Cheng
1fad69df3b
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-07-14 10:13:15 +08:00
dapan1121
9bf7180074
Merge pull request #21969 from taosdata/enh/TD-23769-3.0
...
enh: rsma stream state adaption
2023-07-13 19:19:37 +08:00
Haojun Liao
e0ea0f2df4
Merge pull request #22020 from taosdata/fix/liaohj
...
other: merge main
2023-07-13 17:55:28 +08:00
Shungang Li
a39a9428af
fix: ttlMgrDeleteTtl should ignore ttl 0 tables
2023-07-13 17:43:32 +08:00
Benguang Zhao
81a2cd16e7
enh: unify handling of vnode primary dir in current_fname
2023-07-13 17:37:53 +08:00
kailixu
6ee135cb52
chore: more code
2023-07-13 17:37:31 +08:00
kailixu
67461d92a7
chore: merge 3.0 and solve conflict
2023-07-13 17:35:55 +08:00
Hongze Cheng
d81d2790ea
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-07-13 17:20:45 +08:00
Haojun Liao
e2ae868377
Merge pull request #22032 from taosdata/mark/tmq
...
fix:set firset version to reqOffset of response
2023-07-13 16:35:21 +08:00
Haojun Liao
813f4cb363
refactor: do some internal refactor.
2023-07-13 16:32:25 +08:00
wade zhang
ec86a68b6f
Merge pull request #22045 from taosdata/FEAT/TS-2699-3.0
...
enh: unify handling of vnode primary dir for vnd, tsdb and sma
2023-07-13 13:55:46 +08:00
Benguang Zhao
dc75f7ce21
enh: use VNODE_RSMA_DIR in tdRSmaGetCurrentFName
2023-07-13 11:27:31 +08:00
Haojun Liao
f41bcd73b0
other: merge main.
2023-07-13 11:02:09 +08:00
Benguang Zhao
e209b487c6
enh: rename func name vnodeGetPrimaryDir
2023-07-13 10:38:05 +08:00
Haojun Liao
2f90a53548
fix(stream): set checkpoint id when expanding task.
2023-07-13 10:16:57 +08:00
Haojun Liao
08a4fb06ae
fix(stream): dispatch checkpoint msg to downstream by puting message into input queue.
2023-07-13 09:17:20 +08:00
kailixu
466f1037b4
Merge branch '3.0' into enh/TD-23769-3.0
2023-07-12 18:50:16 +08:00
Haojun Liao
c388802bda
Merge pull request #22024 from taosdata/fix/3_liaohj
...
fix(stream): fix concurrent bug in save task meta.
2023-07-12 18:17:27 +08:00
kailixu
8f58f9aa5b
fix: skip primary key for block sma
2023-07-12 18:07:01 +08:00
Benguang Zhao
05e8af4837
enh: unify handling of vnode primary dir for vnd and tsdb
2023-07-12 17:58:18 +08:00
Benguang Zhao
4c3bf41178
enh: unify handling of vnode primary dir for sma
2023-07-12 17:56:21 +08:00
Benguang Zhao
bbf58d2d9d
enh: unify handling of vnode primary dir in vnodeCreate and metaOpen
2023-07-12 17:56:21 +08:00
wangmm0220
cf64d4c9c5
fix:set get_assignment offset to first version of response block
2023-07-12 17:22:23 +08:00
Hongze Cheng
3fc282f035
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-07-12 11:57:19 +08:00
Haojun Liao
3ce54423a5
Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
2023-07-12 11:38:27 +08:00
Haojun Liao
d392bb60ba
refactor(stream): set the initial version from the checkpoint.
2023-07-12 11:38:13 +08:00
kailixu
8cb6356b99
chore: more code
2023-07-12 10:47:02 +08:00
Haojun Liao
9484f3da94
Merge branch '3.0' into enh/triggerCheckPoint2
2023-07-12 10:20:18 +08:00
kailixu
f282acbc4c
chore: rsma refactor
2023-07-12 10:13:50 +08:00
kailixu
8c8bcabdd4
Merge branch '3.0' into enh/TD-23769-3.0
2023-07-12 09:11:34 +08:00
wade zhang
2cfdd234b3
Merge pull request #22034 from taosdata/feat/TS-3239
...
feat/TS-3239/TS-3596: port 'keepTimeOffset' from 2.6 to 3.0
2023-07-12 08:18:38 +08:00
Haojun Liao
fed3803739
fix(stream): fix memory leak.
2023-07-11 19:29:52 +08:00
kailixu
ba0bce8092
chore: code revert
2023-07-11 18:52:51 +08:00
kailixu
30f8c9c79e
chore: more check
2023-07-11 18:08:48 +08:00
Shungang Li
4886cb4674
feat: port 'keepTimeOffset' from 2.6 to 3.0
2023-07-11 17:40:35 +08:00
kailixu
7c85f7701d
chore: more check
2023-07-11 16:32:29 +08:00
wangmm0220
8dd7f36993
fix:set firset version to reqOffset of response
2023-07-11 16:19:38 +08:00
wangmm0220
7bc19df0ef
fix:set firset version to reqOffset of response
2023-07-11 15:48:19 +08:00
Haojun Liao
2e386a6fdf
fix(stream): check if stream task is in normal state.
2023-07-11 15:23:49 +08:00
wangmm0220
cb62d4cb97
fix:set firset version to reqOffset of response
2023-07-11 14:49:53 +08:00
Haojun Liao
6d78816d22
fix(stream): fix syntax error.
2023-07-11 14:06:25 +08:00
kailixu
314123ef34
chore: add check
2023-07-11 14:05:09 +08:00
Haojun Liao
09b764494d
fix(stream): set correct checkpoint version when starting stream tasks.
2023-07-11 14:03:43 +08:00
kailixu
d5435926c2
chore: more code
2023-07-11 12:37:01 +08:00
Haojun Liao
3ffdbe923d
other: merge 3.0
2023-07-11 09:12:57 +08:00
Haojun Liao
04f5bcd23a
fix(stream): remove invalid set of task status .
2023-07-11 08:51:13 +08:00
kailixu
14b438ec64
chore: bug fix
2023-07-11 07:02:36 +08:00
kailixu
f391462e34
chore: more code
2023-07-10 20:01:50 +08:00
kailixu
57ceaed535
chore: code revert
2023-07-10 19:55:01 +08:00
kailixu
f16fa6d000
enh: exclude tk log from time series check
2023-07-10 19:48:50 +08:00
Haojun Liao
87bedef2cd
fix(stream): fix error in checkpointing.
2023-07-10 19:20:05 +08:00
Haojun Liao
385a5c9651
fix(stream): fix error in generating checkpoint.
2023-07-10 18:20:50 +08:00
Hongze Cheng
7014f790a0
optmize table statistic info
2023-07-10 17:35:26 +08:00
liuyao
84f0dfd6d4
stream operator checkpoint
2023-07-10 11:07:08 +08:00
kailixu
802112c00a
chore: more code
2023-07-09 21:49:37 +08:00
Haojun Liao
98349a4265
refactor(tsdb): do some internal refactor.
2023-07-09 18:05:24 +08:00
kailixu
a7253fc390
Merge branch '3.0' into enh/TD-25083-3.0
2023-07-09 16:04:38 +08:00
wangmm0220
35ba132a29
fix:conflicts from main
2023-07-09 12:52:18 +08:00
wangmm0220
a5363e6e03
fix:test case in tmq
2023-07-09 12:49:50 +08:00
Haojun Liao
ba4d726af6
fix(tsdb): fix error in tsdbread.
2023-07-09 01:31:02 +08:00
Haojun Liao
b39198a53a
refactor: do some internal refactor.
2023-07-08 21:44:58 +08:00
Haojun Liao
1470e51dc1
Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize
2023-07-08 21:25:24 +08:00
Haojun Liao
14844c7b4b
refactor(tsdb): opt tsdb read perf
2023-07-08 21:25:11 +08:00
wangmm0220
f9f656b21a
fix:return offset stored if get assignment in init mode
2023-07-08 13:25:39 +08:00
Haojun Liao
4f534ce6e9
fix(stream): fix error in generating checkpoint.
2023-07-08 10:29:09 +08:00
Haojun Liao
a5c19427e7
fix(stream): send correct rsp to mnode.
2023-07-08 09:39:44 +08:00
Haojun Liao
9c30abf95b
fix(stream): fix error in generating checkpoint.
2023-07-07 21:38:53 +08:00
wangmm0220
4436eb7e0f
fix:set commitOffset is send msg success & optimize log & add test cases for TD-25129
2023-07-07 19:12:18 +08:00
kailixu
a746d288a1
chore: add debug info
2023-07-07 18:53:01 +08:00
Haojun Liao
128f67784a
fix(stream): fix error in parsing checkpoint msg.
2023-07-07 18:17:50 +08:00
Haojun Liao
8298f30e56
fix(stream): fix bug in checkpoint.
2023-07-07 17:16:08 +08:00
wangmm0220
106e273157
fix:bugs in get_assignment
2023-07-07 16:12:15 +08:00
Haojun Liao
47877898d0
enh(stream): generate the checkpoint framework.
2023-07-07 16:07:52 +08:00
wade zhang
0865b1a828
Merge pull request #21973 from luckeverda/fix/TD-25074-main
...
fix/TD-25074 for main
2023-07-07 11:24:33 +08:00
Hongze Cheng
090ca39132
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-07-07 10:38:04 +08:00
kailixu
cb8b10f6a2
Merge branch '3.0' into enh/TD-23769-3.0
2023-07-07 10:19:43 +08:00
kailixu
64ef48e0dd
Merge branch '3.0' into enh/TD-23769-3.0
2023-07-07 10:17:25 +08:00
kailixu
06c52af2c2
enh: exclude tk_log from timeseries check
2023-07-07 10:14:37 +08:00
wade zhang
47a7a45d1d
Merge pull request #21978 from taosdata/fix/TD-24962
...
fix(coverity): fix coverity scan issues
2023-07-07 08:20:07 +08:00
wangmm0220
0928bd5510
fix:send rsp offset to client if unregister push mgr
2023-07-06 19:35:48 +08:00
wangmm0220
b2d41ce907
Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD-25071
2023-07-06 19:34:22 +08:00
Haojun Liao
aad906f2b0
fix(stream): fix syntax error.
2023-07-06 18:26:44 +08:00
Haojun Liao
d7101f7109
enh(stream): support dispatch checkpoint msg.
2023-07-06 18:26:22 +08:00
Minglei Jin
09222801c4
fix(coverity): fix coverity scan issues
2023-07-06 17:52:48 +08:00
wangmm0220
f1ce91f600
fix:race condition for pTq->pStore->pHash
2023-07-06 16:49:59 +08:00
wangmm0220
9e6e59adc2
fix:race condition for pTq->pStore->pHash
2023-07-06 16:47:48 +08:00
Shungang Li
a31e054146
fix: ttlmgr convert in metaUpgrade
2023-07-06 15:47:32 +08:00
Shungang Li
a1a2b8331f
fix: ttl fill cache only in initialization
2023-07-06 15:47:32 +08:00
wade zhang
84740e96ee
Merge pull request #21939 from luckeverda/fix/TD-25074
...
fix/TD-25074
2023-07-06 15:44:22 +08:00
Haojun Liao
a94ace4cc8
refactor:do some internal refactor.
2023-07-06 15:10:45 +08:00
wangmm0220
47ae92af93
fix:conflicts from main
2023-07-06 13:40:04 +08:00
wangmm0220
11e6856d3e
fix:init char array
2023-07-06 13:37:58 +08:00
kailixu
c1393fb2e2
chore: invoke streamStateCommit for rsma
2023-07-06 13:26:25 +08:00
Haojun Liao
5a9461a69a
other: merge 3.0
2023-07-06 11:52:21 +08:00
kailixu
e8cdf132fb
chore: rsma code refactor
2023-07-06 11:32:20 +08:00
Haojun Liao
f4a3567935
other: merge 3.0
2023-07-06 11:24:30 +08:00
kailixu
61380b7822
chore: test case adaption
2023-07-06 11:09:44 +08:00
Haojun Liao
851f6df094
enh(tsdb): opt perf.
2023-07-06 09:58:15 +08:00
wangmm0220
34a62c3f38
fix:vginfo assigment not in same time,we should get vginfo by vg,not all vg
2023-07-05 22:55:41 +08:00
kailixu
3f6768d8cf
chore: rsma rocksdb adaption
2023-07-05 19:43:29 +08:00
Haojun Liao
aeb9473382
enh(tsdb): add some logs.
2023-07-05 19:41:34 +08:00
Haojun Liao
a0a116b674
fix(tsdb): fix error in sma extracting and do NOT clear fileDelData when extracting data from stt files.
2023-07-05 19:11:14 +08:00
kailixu
df7866e9f6
chore: refactor
2023-07-05 19:08:43 +08:00
kailixu
59e83fca5d
chore: build fix
2023-07-05 18:33:09 +08:00
Benguang Zhao
9b477eed81
enh: terminate on failure to recover WAL from writing errors, or to commit vnode
2023-07-05 17:54:56 +08:00
Haojun Liao
74f5b3f80e
Merge pull request #21959 from taosdata/refact/fillhistory
...
refactor: do some internal refactor.
2023-07-05 17:47:00 +08:00
Shungang Li
e6e52c3641
fix: ttlmgr convert in metaUpgrade
2023-07-05 17:44:17 +08:00
Haojun Liao
8f8dfc593b
Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize
2023-07-05 17:43:56 +08:00
Haojun Liao
a738b6eba6
fix(tsdb): add empty del skyline check.
2023-07-05 17:43:41 +08:00
Hongze Cheng
21d972938f
more fix
2023-07-05 17:43:15 +08:00
Haojun Liao
f35db3ba6c
fix(tsdb): add none check.
2023-07-05 17:36:55 +08:00
Haojun Liao
f0cec22d4f
fix(tsdb): fix some error.
2023-07-05 17:20:17 +08:00
kailixu
d093b0e20f
chore: merge 3.0
2023-07-05 16:45:12 +08:00
Haojun Liao
8c8aa5cd57
fix(tsdb): fix error in extract brinblock.
2023-07-05 16:39:04 +08:00
wangmm0220
bdfeb32923
fix:bugs in tmq_get_topic_assignment
2023-07-05 16:04:34 +08:00
Haojun Liao
03dbcbf055
refactor: do some internal refactor.
2023-07-05 15:55:55 +08:00
Haojun Liao
7d7e12a5e7
fix(tsdb): fix syntax error.
2023-07-05 11:22:58 +08:00
Hongze Cheng
1304c08cdd
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-07-05 10:57:55 +08:00
Haojun Liao
9b3e34d589
Merge pull request #21735 from taosdata/refact/fillhistory
...
refactor: refactor the fill history operation
2023-07-05 10:48:51 +08:00
Haojun Liao
6e15478c43
fix(tsdb): do some internal refactor.
2023-07-05 10:31:38 +08:00
Haojun Liao
6fb1e716c0
Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize
2023-07-05 10:31:09 +08:00
Haojun Liao
8ab10a8da1
fix(tsdb): fix error in check tomb record. #TD-25117
2023-07-05 10:30:55 +08:00
Hongze Cheng
23a743fd66
fix snapshot coredump
2023-07-05 10:01:00 +08:00
Haojun Liao
37ff3a419a
fix(tsdb): fix error in load tomb from stt files.
2023-07-04 23:35:52 +08:00
wade zhang
bc8efd7014
Merge pull request #21949 from taosdata/FIX/TD-25103-3.0
...
enh: tfsRename in the reverse order of levels with tiered storages
2023-07-04 17:34:49 +08:00
Benguang Zhao
1ca4256927
enh: use var prefixLen instead in vnodeRenameVgroupId
2023-07-04 15:36:42 +08:00
Haojun Liao
ff2bf35603
fix(stream): fix error in set the version range for secondary scan.
2023-07-04 15:08:39 +08:00
wade zhang
35a35ad4f9
Merge pull request #21930 from taosdata/fix/TD-24966
...
fix: coverity scan
2023-07-04 14:55:54 +08:00
Hongze Cheng
acde8586e0
ignore file check
2023-07-04 14:16:09 +08:00
Hongze Cheng
2e88ad2c14
fix: upgrade bug
2023-07-04 14:00:44 +08:00
Haojun Liao
82342ebdc7
Merge pull request #21934 from taosdata/feature/TD-20678
...
feat:subscribe only meta info
2023-07-04 11:28:27 +08:00
Shungang Li
dbf47f5fc1
fix: ttl fill cache only in initialization
2023-07-03 21:30:53 -04:00
wangmm0220
dbcd33a402
fix:memory leak
2023-07-03 18:43:12 +08:00
Benguang Zhao
ddaba463c0
enh: check failure of tfsMkdirRecurAt
2023-07-03 16:16:27 +08:00
Haojun Liao
200575647c
Merge branch '3.0' into refact/fillhistory
2023-07-03 15:16:18 +08:00
Haojun Liao
20d099dfa6
Merge pull request #21901 from taosdata/fix/liaohj
...
fix: fix coverity issue.
2023-07-03 15:15:21 +08:00
Hongze Cheng
8384b6ce29
fix CI case
2023-07-03 15:01:05 +08:00
Hongze Cheng
5390732f42
fix: coverity scan
2023-07-03 14:13:01 +08:00
Hongze Cheng
214c92264c
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-07-03 11:27:26 +08:00
wangmm0220
136bc379d1
feat:ignore delete info
2023-07-03 11:02:08 +08:00
Haojun Liao
9e98c64b1e
fix(tsdb): set correct stt load info. update the test case.
2023-06-30 22:57:49 +08:00
Haojun Liao
450a9f3ca1
Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize
2023-06-30 18:22:35 +08:00
Haojun Liao
c2a7c37b00
fix(tsdb): opt perf for reading data from stt files.
2023-06-30 18:22:20 +08:00
wade zhang
84c20463f3
Merge pull request #21907 from luckeverda/fix/ttlpresubmit
...
fix: ttl compatibility for main
2023-06-30 16:47:25 +08:00
wade zhang
617115ba85
Merge pull request #21906 from luckeverda/fix/ttlpresubmit
...
fix: ttl compatibility for 3.0
2023-06-30 16:45:58 +08:00
Hongze Cheng
9fd453d78a
more code
2023-06-30 16:13:48 +08:00
yihaoDeng
93391f73e5
vnode snapshot read
2023-06-30 07:46:56 +00:00
Hongze Cheng
2f57c8439b
more fix
2023-06-30 15:04:18 +08:00
Hongze Cheng
e79fe91ba0
more code
2023-06-30 14:57:57 +08:00
Shungang Li
8f164a7922
fix: ttl compatibility
2023-06-30 14:57:34 +08:00
Hongze Cheng
c714138e9e
fix snapshot problem
2023-06-30 14:37:26 +08:00
Hongze Cheng
55840709ed
skip dropped table tomb data commit
2023-06-30 13:54:49 +08:00
wangmm0220
58c7011e0e
feat:support only meta in tmq subscriptions
2023-06-30 11:42:40 +08:00
yihaoDeng
e25df41536
vnode snapshot read
2023-06-30 03:11:55 +00:00
Haojun Liao
ee5e3b7cc0
fix(tsdb): fix error in tsdb2
2023-06-30 00:38:53 +08:00
Haojun Liao
9740d1353c
fix(tsdb): opt perf for read data in stt files.
2023-06-29 23:16:07 +08:00
Haojun Liao
15487c9c8f
fix(tsdb): fix memory leak.
2023-06-29 22:52:07 +08:00
yihaoDeng
60a0b1e1bd
vnode snapshot read
2023-06-29 11:52:34 +00:00
Haojun Liao
17c6b9f81b
fix(tsdb): fix error in set file reader.
2023-06-29 18:40:14 +08:00
Hongze Cheng
eee8007736
fix bug
2023-06-29 17:48:36 +08:00
yihaoDeng
9eb6d8cf1e
vnode snapshot read
2023-06-29 09:35:09 +00:00
Haojun Liao
622e1cb608
fix: fix coverity issue.
2023-06-29 15:54:09 +08:00
Haojun Liao
63834713b2
Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize
2023-06-29 15:09:14 +08:00
Haojun Liao
81eb8523f1
fix(tsdb): fix invalid ptr.
2023-06-29 15:09:01 +08:00
Hongze Cheng
1e5fef9dbe
fix retention CI cases
2023-06-29 15:01:54 +08:00
yihaoDeng
5cebd36c1c
add checkpoint
2023-06-29 06:56:14 +00:00
dapan1121
c8435de64a
Merge branch '3.0' into fix/m23.0
2023-06-29 14:03:56 +08:00
Hongze Cheng
1556dedb85
fix file remove by edit
2023-06-29 14:03:01 +08:00
Haojun Liao
ba38a625cf
fix(stream): remove the shared ptr between reader ptr.
2023-06-29 13:42:23 +08:00
dapan1121
3519e9170e
Merge remote-tracking branch 'origin/main' into 3.0
2023-06-29 11:13:45 +08:00
Haojun Liao
c4a6b85bdf
fix(tsdb): support stt and file block overlap.
2023-06-28 22:38:51 +08:00
yihaoDeng
3d532a54a8
add checkpoint
2023-06-28 12:22:27 +00:00
yihaoDeng
6b6e237079
add checkpoint
2023-06-28 09:57:08 +00:00
liuyao
2fc5eeb810
session win range
2023-06-28 17:20:08 +08:00
Hongze Cheng
9be13427f6
fix tomb record loss bug
2023-06-28 17:01:08 +08:00
yihaoDeng
871f66565d
add checkpoint
2023-06-28 07:02:20 +00:00
Haojun Liao
8867a57262
fix(stream): fix syntax error.
2023-06-28 14:48:59 +08:00
Haojun Liao
57fcd553f8
refactor: do some internal refactor.
2023-06-28 13:13:13 +08:00
wangmm0220
1fc664693e
fix:continue consume if wal is dropped
2023-06-28 11:54:48 +08:00
yihaoDeng
f6d5d0c8ca
add checkpoint
2023-06-28 02:39:01 +00:00
Haojun Liao
3710ea4aca
refactor: do some internal refactor.
2023-06-28 09:41:08 +08:00
Hongze Cheng
c3a34f5012
Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-06-28 09:16:48 +08:00
Hongze Cheng
b13010c490
fix retention infinit loop
2023-06-28 09:16:43 +08:00
Haojun Liao
9116a4092a
fix(tsdb):fix memory leak.
2023-06-28 01:04:58 +08:00
Haojun Liao
15c55508ac
fix(stream): fix error in read tombblock in stt files.
2023-06-27 23:37:11 +08:00
Haojun Liao
a19e63fd23
fix(stream): fix error in handling fill history.
2023-06-27 23:00:14 +08:00
yihaoDeng
9adccf5715
add checkpoint
2023-06-27 14:31:50 +00:00
yihaoDeng
977d6b7803
add checkpoint
2023-06-27 12:52:27 +00:00
yihaoDeng
74764108fd
add checkpoint
2023-06-27 12:46:08 +00:00
yihaoDeng
f2b96fb4b3
add checkpoint
2023-06-27 12:28:28 +00:00
yihaoDeng
9d69b284db
add checkpoint
2023-06-27 12:03:29 +00:00
Yihao Deng
4de7db06f9
Merge branch '3.0' into enh/triggerCheckPoint2
2023-06-27 17:57:14 +08:00
yihaoDeng
0a0410cd09
add checkpoint
2023-06-27 09:56:14 +00:00
Haojun Liao
4bb78df27c
fix(stream): reduce the sleep time.
2023-06-27 16:44:35 +08:00
Haojun Liao
32fddeff18
fix(stream): fix error retrieve data from source task.And optimize the test cases.
2023-06-27 16:24:47 +08:00
yihaoDeng
a824db4fd5
add checkpoint
2023-06-27 07:46:30 +00:00
Hongze Cheng
d23902877e
make it compile on win
2023-06-27 14:33:55 +08:00
Haojun Liao
1ad05a06d6
Merge branch '3.0' into enh/tsdb_optimize
2023-06-27 11:46:37 +08:00
Haojun Liao
3289ad62be
other: merge 3.0
2023-06-27 11:33:40 +08:00
Haojun Liao
1073b5e4c2
fix(tsdb): support to read multi-level of stt files.
2023-06-27 11:15:53 +08:00
liuyao
71f4226e15
fix coverity san issues
2023-06-27 10:39:38 +08:00
Haojun Liao
b73444b291
fix(stream): start stream task in case of scan history completing.
2023-06-27 09:44:51 +08:00
Hongze Cheng
3edee3fe9f
fix memory leak
2023-06-26 22:04:29 +08:00
dapan1121
4dae9f4eff
merge main to 3.0
2023-06-26 18:43:00 +08:00
Hongze Cheng
3172306f65
more fix
2023-06-26 16:38:26 +08:00
Hongze Cheng
5a0218d1ca
fix memory leak
2023-06-26 16:34:58 +08:00
Hongze Cheng
58ce6a3f26
fix vnode close
2023-06-26 16:28:33 +08:00
Haojun Liao
6a29bce44e
Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize
2023-06-26 15:56:11 +08:00
Haojun Liao
9f664cbf14
fix(tsdb): fix error in extracting block distribution.
2023-06-26 15:54:44 +08:00
Hongze Cheng
5ad9bd938f
change default stt trigger as 2
2023-06-26 15:47:36 +08:00
Hongze Cheng
e79683a684
fix more
2023-06-26 13:57:18 +08:00
Minglei Jin
020678391c
fix(tsdb/cache): refine del locks
2023-06-26 11:19:31 +08:00
Hongze Cheng
27e17048ac
fix: retention coredump
2023-06-26 09:06:59 +08:00
Minglei Jin
5eb57f2e6e
enh(tsdb/cache): writebatch with rcache locked
2023-06-26 08:41:14 +08:00
yihaoDeng
04ab8e19d0
Merge branch 'enh/dev30' into enh/triggerCheckPoint2
2023-06-25 19:58:45 +08:00
Haojun Liao
402c091df0
fix(stream): fix sma error.
2023-06-25 19:41:44 +08:00
Hongze Cheng
b881b87218
more code
2023-06-25 18:02:31 +08:00
liuyao
e236bf818c
set fill history info
2023-06-25 17:47:10 +08:00
Hongze Cheng
cc0727aee3
more code
2023-06-25 17:13:12 +08:00
Hongze Cheng
014bfc4ad4
more code
2023-06-25 16:27:14 +08:00
Hongze Cheng
5b1492cb4b
refact code
2023-06-25 15:09:15 +08:00
wangmm0220
7a49d67078
Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TS-3495
2023-06-25 14:54:16 +08:00
Haojun Liao
7e7feeffdf
fix: fix memory leak.
2023-06-25 14:38:31 +08:00
liuyao
c950c7379d
Merge branch 'refact/fillhistory' of https://github.com/taosdata/TDengine into refact/fillhistory
2023-06-25 10:58:43 +08:00
liuyao
e9d3198e05
mem leak
2023-06-25 10:57:10 +08:00
Haojun Liao
6ac179501a
fix: fix syntax error.
2023-06-25 10:46:21 +08:00
Haojun Liao
6857881742
Merge branch '3.0' into refact/fillhistory
2023-06-25 10:41:32 +08:00
Hongze Cheng
c161943fe0
fix snapshot problem
2023-06-25 10:01:30 +08:00
Hongze Cheng
3582046129
fix coredump
2023-06-25 09:45:58 +08:00
Haojun Liao
3099ec31cb
fix(tsdb): fix syntax error.
2023-06-25 09:36:43 +08:00
Haojun Liao
dad1854cbb
other: merge 3.0
2023-06-25 09:33:37 +08:00
Haojun Liao
7c23630fe4
fix(stream): set correct stream error code.
2023-06-25 09:26:37 +08:00
wade zhang
254a20bdf3
Merge pull request #21660 from luckeverda/feat/TD-23739
...
feat/TD-23739: enhance ttl, deletetime modified by writing-op
2023-06-25 09:06:57 +08:00
Haojun Liao
a8de3694fa
Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine into refact/fillhistory
2023-06-24 18:55:03 +08:00
Haojun Liao
ceb78fdad2
Merge branch '3.0' into refact/fillhistory
2023-06-24 18:53:48 +08:00
Haojun Liao
4a7698d4ab
fix(tsdb): add null ptr check.
2023-06-24 00:41:05 +08:00
Haojun Liao
4ce1614045
fix(tsdb): fix error in retrieve sma.
2023-06-24 00:33:47 +08:00
Haojun Liao
5cac7c7a02
fix(tsdb): fix error in query super table.
2023-06-23 02:06:50 +08:00
yihaoDeng
c36d14df77
add compile opt
2023-06-22 13:19:14 +08:00
Hongze Cheng
a5049b4861
fix bug
2023-06-21 20:26:52 +08:00
Haojun Liao
0c2273daf2
fix(tsdb): fix memory leak.
2023-06-21 19:38:25 +08:00
Haojun Liao
3ca3dc54ae
Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize
2023-06-21 19:22:58 +08:00
Haojun Liao
cf02ac7229
fix(tsdb): extract tomb data in stt files.
2023-06-21 18:57:14 +08:00
Haojun Liao
92249d892a
Merge pull request #21717 from taosdata/enh/staticLibMain
...
Enh/static lib main
2023-06-21 17:46:30 +08:00
Hongze Cheng
feda122fdc
more code
2023-06-21 17:29:41 +08:00
Haojun Liao
f49f96049e
Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize
2023-06-21 16:56:11 +08:00
Hongze Cheng
32a256bfee
fix commit bug
2023-06-21 16:55:31 +08:00
Haojun Liao
e76ae4ffc5
fix(tsdb) : fix memory leak.
2023-06-21 16:53:47 +08:00
Hongze Cheng
1160f53062
more code
2023-06-21 16:35:06 +08:00
Haojun Liao
84bd2fb7a1
Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize
2023-06-21 16:15:04 +08:00
Hongze Cheng
5e9d263e19
fix: infinite loop
2023-06-21 15:08:16 +08:00
Hongze Cheng
0e97340e50
more code
2023-06-21 14:53:36 +08:00
Haojun Liao
6261359efe
fix(tsdb): reset the stt reader for new files.
2023-06-21 14:46:35 +08:00
yihaoDeng
ff3ad6c65f
add static lib to 3.0
2023-06-21 14:38:52 +08:00
Hongze Cheng
4a1010cdec
more
2023-06-21 13:39:29 +08:00
wade zhang
e95b430e89
Merge pull request #21786 from taosdata/FIX/TD-24817-3.0
...
enh: make alter-hashrange atomic and idempotent
2023-06-21 13:29:04 +08:00
Haojun Liao
ea7b8e91d3
fix(stream): fix memory leak.
2023-06-21 12:03:26 +08:00
Haojun Liao
f6e3ad27f0
fix(tsdb): fix memory leak.
2023-06-21 11:38:35 +08:00
Haojun Liao
a92d16a508
fix(tsdb): adjust invalid assert.
2023-06-21 00:12:08 +08:00
Hongze Cheng
413d00db9e
fix memory leak
2023-06-20 20:10:57 +08:00
yihaoDeng
daa3b5238f
add static lib
2023-06-20 19:29:43 +08:00
Haojun Liao
f8437789f9
Merge remote-tracking branch 'origin/enh/tsdb_optimize' into enh/tsdb_optimize
2023-06-20 18:38:59 +08:00
Haojun Liao
a16dce1873
fix(tsdb): set correct callback fp.
2023-06-20 18:38:45 +08:00
Hongze Cheng
a3f784a5bc
more code
2023-06-20 18:25:24 +08:00
Hongze Cheng
ccc8faf3ee
Merge branch 'enh/tsdb_optimize' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-06-20 18:24:02 +08:00
Hongze Cheng
8855659534
more code
2023-06-20 18:23:58 +08:00
liuyao
74bea44300
stream op transform
2023-06-20 17:30:59 +08:00
Haojun Liao
2d4eed4234
other: merge other branch.
2023-06-20 17:12:31 +08:00
Hongze Cheng
fbc4cc9053
fix commit issue
2023-06-20 16:48:54 +08:00
Haojun Liao
7627035629
fix(tsdb): set the hasVal initial value.
2023-06-20 15:58:22 +08:00
Benguang Zhao
424086e324
enh: restore vgroup id in vmOpenVnodes for vnodeAlterHashRange
2023-06-20 15:40:09 +08:00
Haojun Liao
a87c3cfd24
fix(tsdb):check null ptr.
2023-06-20 15:39:53 +08:00
liuyao
aafbdcb492
set task status
2023-06-20 15:20:04 +08:00
Haojun Liao
a1f2ce389b
fix(tsdb): fix memory leak.
2023-06-20 14:46:32 +08:00
Hongze Cheng
09f2858927
fix some coredump
2023-06-20 14:34:52 +08:00
Haojun Liao
976dc322db
enh(tsdb): support delete data read.
2023-06-20 14:26:15 +08:00
Hongze Cheng
a33ce92e5d
more code
2023-06-20 13:33:31 +08:00
liuyao
870d75bf82
fill history pause&resume
2023-06-20 11:34:09 +08:00
Hongze Cheng
927f6861be
more code
2023-06-20 10:41:24 +08:00
Hongze Cheng
a4ca770449
refact code
2023-06-20 09:33:22 +08:00
Shungang Li
aa3dd2bbe8
fix for compile
2023-06-20 09:06:23 +08:00
yihaoDeng
548e439aa2
add checkpoint
2023-06-19 20:48:49 +08:00
Shungang Li
b93f653d7e
feat: enhance ttl, deletetime modified by writing-ops
...
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
2023-06-19 19:03:35 +08:00
Haojun Liao
77af819708
Merge branch 'enh/tsdb_optimize' of github.com:taosdata/tdengine into enh/tsdb_optimize
2023-06-19 17:57:00 +08:00
Haojun Liao
524ef6edda
fix(tsdb): read data from new storage format.
2023-06-19 17:51:05 +08:00
liuyao
41c193945f
fill history pause&resume
2023-06-19 17:28:19 +08:00
Benguang Zhao
090a1a1595
enh: rename dir at the end in vnodeRenameVgroupId
2023-06-19 15:48:32 +08:00
Hongze Cheng
6d2ce5cd39
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-06-19 14:13:08 +08:00
Hongze Cheng
3074ab6541
more code
2023-06-19 14:12:48 +08:00
Hongze Cheng
de60e688f6
more fix
2023-06-19 12:52:09 +08:00
Hongze Cheng
9ce58a2d80
refact more code
2023-06-19 11:32:19 +08:00
Hongze Cheng
073a2b8dd3
refact more code
2023-06-19 09:32:29 +08:00
yihaoDeng
fd85a8495a
Merge branch 'dev30' into enh/triggerCheckPoint2
2023-06-17 14:17:21 +08:00
kailixu
b40069c0e1
chore: log optimization
2023-06-17 05:05:43 +08:00
Hongze Cheng
aba73614df
more code
2023-06-17 00:12:11 +08:00
wangmm0220
c5dfe169a6
fix:error
2023-06-16 19:33:03 +08:00
kailixu
4097b860d3
enh: support delete tsma interval
2023-06-16 19:04:12 +08:00
dapan1121
1329dce320
Merge pull request #21712 from taosdata/fix/TS-3484
...
fix: fix order by ts desc error
2023-06-16 18:01:16 +08:00
Hongze Cheng
a9fcebbdaf
more code
2023-06-16 17:12:05 +08:00
Haojun Liao
64365666b7
fix(stream): update the info, and do some internal refactor.
2023-06-16 16:04:43 +08:00
Hongze Cheng
d97f34931d
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-06-16 13:54:59 +08:00
Hongze Cheng
ec288ade15
change stt from multi seg to one seg
2023-06-16 12:16:53 +08:00
wade zhang
01b1cfe965
Merge pull request #21676 from taosdata/fix/TD-24715
...
enh(vnd/svr): convert msyType to string
2023-06-16 12:06:47 +08:00
wade zhang
d5f37359f4
Merge pull request #21722 from taosdata/fix/TD-24761
...
fix(tsdb/cache): rewrite cache update to fix cpu usage
2023-06-16 11:52:02 +08:00
Minglei Jin
968e3cf1ea
lru/applyF: fix ret value
2023-06-16 10:00:17 +08:00
Haojun Liao
4c82558eab
Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory
2023-06-16 09:55:24 +08:00
Haojun Liao
933801269a
fix(stream): fix memory leak and failed to close vnode.
2023-06-16 09:55:11 +08:00
Yihao Deng
97fa74ae2e
Merge branch 'main' into enh/staticLibMain
2023-06-15 21:37:01 +08:00
liuyao
0aa141ec77
use stream task state
2023-06-15 18:24:40 +08:00
Haojun Liao
a3e1882fb2
fix: fix dead lock.
2023-06-15 18:17:38 +08:00
Haojun Liao
2ad30e2946
other: add files.
2023-06-15 17:31:59 +08:00
Minglei Jin
2cb6c7af16
cache/commit: use outter lock
2023-06-15 17:16:14 +08:00
Minglei Jin
9d6a22e35e
cache/apply: use tsdb's flushState as ud
2023-06-15 17:07:56 +08:00
Minglei Jin
c56f29c031
cache/flushState: init flush state when open cache
2023-06-15 17:01:27 +08:00
Minglei Jin
158ae209bf
cache/lru: new applyF API for tlrucache
2023-06-15 16:34:51 +08:00
Haojun Liao
74e0138f72
Merge branch '3.0' into refact/fillhistory
2023-06-15 15:25:00 +08:00
wangmm0220
22776e60d5
fix:control memory size if consumer group is too much
2023-06-15 14:51:04 +08:00
Hongze Cheng
b6a567f92e
more code
2023-06-15 14:43:14 +08:00
Hongze Cheng
eacd2ac234
more code
2023-06-15 14:23:12 +08:00
liuyao
693942b821
trans state
2023-06-15 14:13:17 +08:00
Hongze Cheng
e34ff2a894
more code
2023-06-15 14:10:35 +08:00
Haojun Liao
5fdfe98696
fix: fix syntax error.
2023-06-15 13:31:30 +08:00
Hongze Cheng
56dfeadd50
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-06-15 13:17:44 +08:00
Haojun Liao
1b9eca5ce0
other: merge main.
2023-06-15 13:03:17 +08:00
Haojun Liao
13028744df
refactor: do some internal refactor.
2023-06-15 10:24:21 +08:00
Minglei Jin
6d23ea93ea
cache/update: fix memory leak
2023-06-15 08:40:36 +08:00
Haojun Liao
53377c2c1f
fix(stream): wait for stream task completed.
2023-06-15 01:14:41 +08:00
Benguang Zhao
b86fc3a697
fix: vnodeRenameVgroupId correctly
2023-06-14 21:38:25 +08:00
Yihao Deng
7ded6fc7a2
Merge branch '3.0' into enh/triggerCheckPoint2
2023-06-14 16:30:38 +08:00
Hongze Cheng
33eaeb743c
more code
2023-06-14 16:15:40 +08:00
liuyao
9a3708e17b
pause&resume fill history
2023-06-14 15:54:07 +08:00
Minglei Jin
d04a33f349
fix(tsdb/cache): rewrite cache update to fix cpu usage
2023-06-14 15:35:21 +08:00
Haojun Liao
7c6fbd7772
enh(stream): do some internal refactor and support secondary scan for history data.
2023-06-14 14:10:09 +08:00
Hongze Cheng
4138361839
refact code
2023-06-14 14:05:41 +08:00
Hongze Cheng
5bacfb4f94
refact code
2023-06-14 13:38:51 +08:00
Hongze Cheng
48ea3963e7
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-06-14 13:12:31 +08:00
yihaoDeng
30ea3aa419
add static lib
2023-06-14 12:15:02 +08:00
yihaoDeng
ee3017ed3a
add static lib
2023-06-14 12:14:49 +08:00
Haojun Liao
b44447e6f3
enh(stream): support restore from disk.
2023-06-14 10:19:03 +08:00
Haojun Liao
844a23225a
Merge pull request #21600 from taosdata/mark/tmq
...
fix:check wal not exist again before register to push & move push log…
2023-06-14 10:18:39 +08:00
Ganlin Zhao
4bd1ae90fa
fix: fix order by ts desc error
2023-06-14 09:52:41 +08:00
Hongze Cheng
c85c032158
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-06-14 09:14:16 +08:00
wangmm0220
8070223aba
fix:lock error
2023-06-13 18:27:06 +08:00
Ganlin Zhao
647ddaad97
fix: fix order by ts desc error
2023-06-13 17:28:31 +08:00
Hongze Cheng
e01d598da9
more code
2023-06-13 17:16:06 +08:00
Haojun Liao
97da2a8fac
fix(stream): set the fill history status.
2023-06-13 16:10:55 +08:00
wangmm0220
d8d6b6dd21
Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-24749
2023-06-13 15:15:05 +08:00
wangmm0220
8a81278024
fix:load pHandle if necessary wher tq restore
2023-06-13 15:14:11 +08:00
Haojun Liao
933d08b489
Merge pull request #21690 from taosdata/feature/TS-3495
...
feat:add parameters for consumer & add offset rows for subscription
2023-06-13 14:59:15 +08:00
Hongze Cheng
42a09cc9df
more code
2023-06-13 14:30:24 +08:00
Hongze Cheng
7baeabc6b9
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-06-13 13:21:12 +08:00
wangmm0220
fb123d8761
fix:conflict from 3.0
2023-06-13 09:47:08 +08:00
Haojun Liao
fb24ed161d
enh(stream): set correct task status.
2023-06-12 22:48:23 +08:00
yihaoDeng
83dde6a212
add trigger checkpoint
2023-06-12 14:33:08 +00:00
Hongze Cheng
e4840cb5ab
fix
2023-06-12 17:48:49 +08:00
Hongze Cheng
bd01d08b05
mroe code
2023-06-12 17:19:31 +08:00
Hongze Cheng
71df0a00be
more code
2023-06-12 17:17:00 +08:00
Hongze Cheng
438d0caef7
mroe code
2023-06-12 16:55:20 +08:00
Hongze Cheng
9a4f6abe54
more code
2023-06-12 16:12:29 +08:00
Benguang Zhao
16fbcbb67a
fix: filter by tbFName in metaFilterTableByHash
2023-06-12 14:19:50 +08:00
Hongze Cheng
5405a967fb
refact code
2023-06-12 13:39:25 +08:00
Hongze Cheng
4813af0867
refact code
2023-06-12 13:27:02 +08:00
Haojun Liao
78a240be8f
enh(stream): add dispatch msg.
2023-06-12 13:12:45 +08:00
Hongze Cheng
22b80c55bf
refact code
2023-06-12 10:27:22 +08:00
Hongze Cheng
e6039839f1
refact code
2023-06-12 10:26:18 +08:00
Hongze Cheng
b8fb34e6c6
refact
2023-06-12 10:13:15 +08:00
Hongze Cheng
8be0e1710e
refact code
2023-06-12 10:08:35 +08:00
wangmm0220
1903b815d4
fix:modify offset description to string
2023-06-12 09:45:06 +08:00
wangmm0220
6657b8d849
fix:modify offset description to string
2023-06-12 09:44:00 +08:00
Benguang Zhao
3689b41f3a
Merge branch '3.0' into FIX/TD-24182-3.0
2023-06-12 09:39:49 +08:00
Hongze Cheng
0c6acda102
refact code
2023-06-10 17:16:01 +08:00
yihaoDeng
a2030dc378
add trigger checkpoint
2023-06-09 12:12:51 +00:00
Minglei Jin
4884d0af53
vnd/svr: convert msyType to string
2023-06-09 18:00:04 +08:00
Hongze Cheng
9cdaf24113
more code
2023-06-09 17:52:57 +08:00
Hongze Cheng
2c5b5289d0
fix more code
2023-06-09 16:43:09 +08:00
Hongze Cheng
cbd5da5dee
more code
2023-06-09 16:07:06 +08:00
Hongze Cheng
1ee9f80e1f
more code
2023-06-09 15:10:54 +08:00
Haojun Liao
69c9eda7af
fix(stream): fix race condition.
2023-06-09 11:37:38 +08:00
Haojun Liao
63ef04593d
fix: fix syntax error.
2023-06-09 09:48:18 +08:00
Haojun Liao
53246ed6bb
other: merge other branch.
2023-06-09 09:41:10 +08:00
Hongze Cheng
3753c7d602
refact more
2023-06-09 09:23:56 +08:00
Minglei Jin
cab07b2736
vnode/svr: fix missing colon post vgId
2023-06-09 08:21:45 +08:00
wangmm0220
3f46a9bbc9
feat:add parameters for consumer & add offset rows for subscription
2023-06-08 18:14:02 +08:00
Haojun Liao
6726edae0c
fix(stream): add more logs.
2023-06-08 17:54:22 +08:00
Hongze Cheng
cb52b7a747
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-06-08 17:39:01 +08:00
Hongze Cheng
e9a0210ea6
more code
2023-06-08 17:31:35 +08:00
Haojun Liao
2b6ace653a
refactor: do some internal refactor.
2023-06-08 16:14:27 +08:00
Hongze Cheng
ef524f6965
more code
2023-06-08 15:35:43 +08:00
yihaoDeng
8b91617145
Merge branch 'enh/dv3' into enh/triggerCheckpoint
2023-06-08 07:20:41 +00:00
yihaoDeng
77f287d9be
add trigger checkpoint
2023-06-08 07:19:59 +00:00
Minglei Jin
a6968485a8
enh(vnd/sync): refine invalid message log
2023-06-08 14:45:02 +08:00
Haojun Liao
30eba472c3
Merge pull request #21602 from taosdata/fix/TD-24600-dv3
...
fix/td-24600-dv3
2023-06-08 13:42:02 +08:00
Hongze Cheng
13229b0ee1
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-06-08 13:38:32 +08:00
Hongze Cheng
9d4a626f42
more code
2023-06-08 13:28:13 +08:00
Hongze Cheng
685c0e5593
more code
2023-06-08 11:41:01 +08:00
Hongze Cheng
0c9b66b574
more code
2023-06-08 10:51:43 +08:00
yihaoDeng
9b749b8faa
change link op t
2023-06-08 02:43:44 +00:00
Hongze Cheng
2f5f0b75df
refact code
2023-06-08 10:31:19 +08:00
Hongze Cheng
91c8391bff
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-06-08 09:53:57 +08:00
yihaoDeng
1f1f37312d
add trigger checkpoint
2023-06-07 14:32:48 +00:00
Haojun Liao
06cf3588da
refactor: do some internal refactor.
2023-06-07 15:03:04 +08:00
yihaoDeng
4fa1cc6dd3
change link opt
2023-06-07 05:26:07 +00:00
liuyao
1e9c4d5fac
opt stream block dispatch
2023-06-07 10:45:27 +08:00
Haojun Liao
6a3c935b4a
fix(stream): fix error in fill history scan.
2023-06-07 09:15:55 +08:00
Hongze Cheng
e6fb46c072
more code
2023-06-06 16:42:51 +08:00
Hongze Cheng
89a9e01375
more code
2023-06-06 16:17:29 +08:00
Hongze Cheng
96d29bc93b
more code
2023-06-06 11:07:45 +08:00
Minglei Jin
57b0cb84eb
fix(cache/binary): fix crash in freeItem
2023-06-06 10:23:50 +08:00
Hongze Cheng
d3bf34e92a
more code
2023-06-05 22:55:00 +08:00
Hongze Cheng
aad386e795
more code
2023-06-05 22:35:06 +08:00
yihaoDeng
ae09d1d031
fix:wal error
2023-06-05 19:49:54 +08:00
Hongze Cheng
5d1783f4d4
more code
2023-06-05 18:31:59 +08:00
Hongze Cheng
9caf359ee1
more code
2023-06-05 18:29:05 +08:00
Minglei Jin
c4418046e1
Merge branch '3.0' into fix/TS-3247
2023-06-05 18:17:18 +08:00
Haojun Liao
0dd933013c
enh(stream): make history task for stream running.
2023-06-05 17:58:00 +08:00
wade zhang
11321aa279
Merge pull request #21386 from taosdata/fix/TD-23549
...
fix(meta): split meta
2023-06-05 17:47:19 +08:00
wangmm0220
1b9387b683
fix:remove tq lock in write thread
2023-06-05 17:45:46 +08:00
wangmm0220
f2ee657b62
fix:check wal not exist again before register to push & move push logic from write thread to query thread
2023-06-05 17:21:47 +08:00
Hongze Cheng
46aa6d4896
refact code
2023-06-05 16:22:06 +08:00
Hongze Cheng
37ae918114
more code
2023-06-05 16:08:02 +08:00
Hongze Cheng
934a170e64
more code
2023-06-05 16:02:53 +08:00
Haojun Liao
fcc706c45c
enh(stream): refactor the fill history task.
2023-06-05 15:59:01 +08:00
Hongze Cheng
ac62592140
more code
2023-06-05 15:46:35 +08:00
Minglei Jin
d02746d86f
fix(query/sys): pause/resume with sys scan operator
2023-06-05 15:24:39 +08:00
Haojun Liao
077e1a1ed4
Merge branch '3.0' into refact/fillhistory
2023-06-05 11:41:13 +08:00
Hongze Cheng
efff4e77f0
more code
2023-06-05 09:36:26 +08:00
Hongze Cheng
5649401a65
more code
2023-06-05 09:22:20 +08:00
Hongze Cheng
3df9620450
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-06-05 09:10:16 +08:00
Haojun Liao
044e56fc97
Merge branch '3.0' into fix/resume_mem
2023-06-03 12:19:17 +08:00
Haojun Liao
4bb6429249
fix(query): fix syntax error.
2023-06-03 00:20:59 +08:00
Haojun Liao
becacbc84b
fix(query): fix syntax error.
2023-06-02 23:36:47 +08:00
Haojun Liao
b5b4cd2a05
fix(query): load del info with upper version limitation.
2023-06-02 23:15:27 +08:00
Hongze Cheng
53ff6edad7
fix bug
2023-06-02 19:03:34 +08:00
Hongze Cheng
632c6fb4dd
more code
2023-06-02 18:42:15 +08:00
Haojun Liao
cca69f3038
Merge branch '3.0' into fix/resume_mem
2023-06-02 18:40:48 +08:00
Hongze Cheng
a2dafefe03
more code
2023-06-02 17:36:14 +08:00
wangmm0220
56f7a137ee
fix:conflict
2023-06-02 15:47:53 +08:00
wangmm0220
b2f0d88639
fix:conflict
2023-06-02 15:43:35 +08:00
Hongze Cheng
33afb08e5c
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-06-02 14:40:01 +08:00
Hongze Cheng
da31d92b7e
more code
2023-06-02 14:39:54 +08:00
yihaoDeng
f4bde33dc3
avoid mem leak
2023-06-02 06:06:05 +00:00
Haojun Liao
cce87a036f
other: merge 3.0.
2023-06-02 13:34:20 +08:00
Haojun Liao
709e3f5079
Merge pull request #21566 from taosdata/fix/TD-24570
...
reset ud table name
2023-06-02 13:26:49 +08:00
Haojun Liao
d45aa7ef84
Merge pull request #21555 from taosdata/fix/liaohj_main
...
other: merge main into 3.0.
2023-06-02 13:11:12 +08:00
Haojun Liao
f1bd829977
refactor: do some internal refactor.
2023-06-02 13:10:54 +08:00
Haojun Liao
27b7d1ec88
refactor: do some internal refactor.
2023-06-02 11:17:44 +08:00
liuyao
27f791ac7f
reset ud table name
2023-06-02 11:05:39 +08:00
Hongze Cheng
884d2cc834
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-06-02 09:31:54 +08:00
yihaoDeng
4d0ce625c4
Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042
2023-06-01 22:55:30 +08:00
wangmm0220
a7418d439b
Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042
2023-06-01 22:50:51 +08:00
Hongze Cheng
5e75fe006c
more code
2023-06-01 18:56:40 +08:00
wangmm0220
56782a5d41
fix:open task case & modify mqRebVgReq encode/decode style
2023-06-01 18:29:16 +08:00
Haojun Liao
ee8a9856cb
Merge pull request #21557 from taosdata/feature/TD-19042
...
fix:make version compatible
2023-06-01 18:25:37 +08:00
Hongze Cheng
9d1e90f914
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-06-01 17:20:37 +08:00
Hongze Cheng
65720b80fa
more code
2023-06-01 17:12:26 +08:00
Hongze Cheng
a3cacfe68b
more code
2023-06-01 17:08:46 +08:00
Hongze Cheng
e07afeeeaf
more code
2023-06-01 17:05:20 +08:00
wangmm0220
69499b9582
fix:make version compatible
2023-06-01 16:09:17 +08:00
wangmm0220
d20e0a06f6
fix:make version compatible
2023-06-01 16:04:45 +08:00
wangmm0220
21920721f3
fix:make version compatible
2023-06-01 15:10:08 +08:00
Hongze Cheng
e99b33ede5
more code
2023-06-01 15:08:45 +08:00
Hongze Cheng
bdc9fc473c
more code
2023-06-01 11:11:02 +08:00
Minglei Jin
9b9bf2de68
meta/tbc: key cannot be null
2023-06-01 10:41:01 +08:00
Hongze Cheng
fbc4d649de
more code
2023-06-01 10:36:12 +08:00
Haojun Liao
5d98a319c7
Merge pull request #21515 from taosdata/feature/TD-19042
...
feat: support create topic as stable with conditions
2023-06-01 09:56:55 +08:00
Haojun Liao
5301c5756a
other: merge main into 3.0.
2023-06-01 09:29:18 +08:00
Minglei Jin
fb2f367aac
meta/split: trim invalidated uids
2023-06-01 08:13:32 +08:00
Haojun Liao
6d04c4e2fd
refactor: do some internal refactor.
2023-05-31 19:05:40 +08:00
Haojun Liao
9e021087a9
refactor: do some internal refactor.
2023-05-31 19:04:53 +08:00
Haojun Liao
a3abe25539
refactor: do some internal refactor.
2023-05-31 19:03:37 +08:00
Hongze Cheng
d4f4ac1d89
more code
2023-05-31 17:49:08 +08:00
Haojun Liao
fa5c024b3e
refactor: do some internal refactor.
2023-05-31 17:22:59 +08:00
Haojun Liao
18b971c666
fix(query): check the version range when dump partial rows of file block to sdata block directly.
2023-05-31 17:06:38 +08:00
Haojun Liao
bbb6359ea2
fix(query): add check for version range when dumping partial rows of file block to data block
2023-05-31 17:03:39 +08:00
Hongze Cheng
dc8901268e
fix code
2023-05-31 16:34:50 +08:00
Hongze Cheng
cf0228f87e
more code
2023-05-31 15:57:51 +08:00
Minglei Jin
99d6c5cfa0
Merge branch '3.0' into fix/TD-23549
2023-05-31 15:31:20 +08:00
Hongze Cheng
10e6e52670
more code
2023-05-31 15:19:28 +08:00
Hongze Cheng
616a675682
more code
2023-05-31 10:59:47 +08:00
Benguang Zhao
28efd7dcd7
enh: check trans conflicts in mndTransValidate
2023-05-31 10:53:36 +08:00
Haojun Liao
e237b4ac39
refactor: do some internal refactor.
2023-05-31 09:19:05 +08:00
Hongze Cheng
938d87f601
more code
2023-05-31 09:02:50 +08:00
Hongze Cheng
838a47cb45
more code
2023-05-30 18:08:32 +08:00
Hongze Cheng
03f7c6533e
more code
2023-05-30 18:06:28 +08:00
Haojun Liao
eda06081ff
enh(stream): refactor and serialize the attributes of history tasks.
2023-05-30 16:55:37 +08:00
wangmm0220
689ee05527
Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042
2023-05-30 15:45:46 +08:00
Hongze Cheng
e0889b404d
more code
2023-05-30 15:31:11 +08:00
Hongze Cheng
9222d9651e
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-05-30 14:21:19 +08:00
Hongze Cheng
29c29871d2
more code
2023-05-30 14:20:15 +08:00
Haojun Liao
d122a398b3
Merge pull request #21516 from taosdata/fix/TD-24447
...
set sched status
2023-05-30 10:59:28 +08:00
Hongze Cheng
8626d3e691
more code
2023-05-30 10:43:44 +08:00
wangmm0220
d490ca753f
Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042
2023-05-30 09:48:49 +08:00
Haojun Liao
65b1574fbe
Merge pull request #21499 from taosdata/mark/tmq
...
fix:put poll to push manager if wal not exist when offset is latest
2023-05-30 09:36:53 +08:00
Haojun Liao
20a0054c4a
Merge pull request #21472 from taosdata/enh/addCompileError
...
change parameter
2023-05-30 09:36:36 +08:00
dapan1121
2d6859d5d6
Merge pull request #21510 from taosdata/szhou/fix-ts3461
...
fix: if block row num is less than definit min rows, set the bucket index to 0
2023-05-30 08:51:24 +08:00
wade zhang
3a2831a3f4
Merge pull request #21517 from taosdata/fix/TD-24472
...
fix(rocks/log): set info log level to warn_level
2023-05-30 08:35:00 +08:00
Hongze Cheng
b479a0a06b
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-05-29 21:46:26 +08:00
Hongze Cheng
41459a92c0
more code
2023-05-29 18:42:31 +08:00
wangmm0220
41ed0138b4
fix:compile error
2023-05-29 17:25:11 +08:00
wangmm0220
07bdb95b1a
fix:compile error
2023-05-29 17:10:11 +08:00
wangmm0220
9eb15e41ef
fix:put poll to push manager if wal not exist when offset is latest
2023-05-29 16:44:03 +08:00
Hongze Cheng
6aac0e0c49
more code
2023-05-29 15:58:54 +08:00
Minglei Jin
3a9d55ca35
fix(rocks/log): set info log level to warn_level
2023-05-29 15:56:28 +08:00
wangmm0220
5eb1c559e5
fix:save offset if latest
2023-05-29 15:51:00 +08:00
liuyao
b541a0a053
set sched status
2023-05-29 15:42:47 +08:00
wangmm0220
78db3520a6
fix:conflict
2023-05-29 14:57:03 +08:00
wangmm0220
a71878d07f
feat: support create topic as stable with conditions
2023-05-29 11:46:59 +08:00
Haojun Liao
8f61e2d6ef
refactor: do some internal refactor.
2023-05-29 10:50:50 +08:00
shenglian zhou
43c0656df2
fix: if block row num is less than definit min rows, set the bucket index to 0
2023-05-29 10:45:26 +08:00
yihaoDeng
342ce14c7d
Merge branch 'enh/3.0' into fix/shared_link_rocksdb
2023-05-29 02:37:47 +00:00
yihaoDeng
58cc631c22
Merge branch 'enh/3.0' into fix/shared_link_rocksdb
2023-05-29 02:29:56 +00:00
Haojun Liao
953a69a829
refactor: do some internal refactor.
2023-05-29 10:12:27 +08:00
Hongze Cheng
9d6a264e4d
more code
2023-05-28 23:33:03 +08:00
Hongze Cheng
9d031f4d7b
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-05-28 11:08:39 +08:00
Hongze Cheng
5bcc9c540a
more code
2023-05-27 23:08:08 +08:00
Haojun Liao
1e786624b2
Merge pull request #21501 from taosdata/refact/fillhistory
...
fix(stream): set the skip offset when resume stream task.
2023-05-27 22:45:54 +08:00
Hongze Cheng
6668da43f8
more code
2023-05-27 20:13:07 +08:00
Hongze Cheng
e4b7318ced
more code
2023-05-27 19:54:07 +08:00
Hongze Cheng
442586692b
more code
2023-05-27 19:01:52 +08:00
Haojun Liao
d9de1813da
Merge branch '3.0' into refact/fillhistory
2023-05-27 16:31:11 +08:00
Hongze Cheng
2cf70ab0cc
more code
2023-05-27 15:29:22 +08:00
Hongze Cheng
880359ddb3
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-05-27 11:50:25 +08:00
Hongze Cheng
62a3c27176
more code
2023-05-27 11:49:59 +08:00
Hongze Cheng
b4b0db9a3d
more code
2023-05-26 23:51:18 +08:00
Hongze Cheng
0090d02226
more code
2023-05-26 23:42:47 +08:00
Haojun Liao
b38e253019
fix(stream): set the skip offset when resume stream task.
2023-05-26 22:51:58 +08:00
Hongze Cheng
9abfe52c4d
more code
2023-05-26 19:41:27 +08:00
Hongze Cheng
4cb4c6388c
more code
2023-05-26 19:32:02 +08:00
wangmm0220
a3e214b9e8
fix:put poll to push manager if wal not exist when offset is latest
2023-05-26 19:17:04 +08:00
wangmm0220
50487255b3
fix:put poll to push manager if wal not exist when offset is latest
2023-05-26 19:02:40 +08:00
wade zhang
66b7d90849
Merge pull request #21479 from taosdata/fix/TD-24405
...
fix(cache): fix deleted data
2023-05-26 17:02:33 +08:00
Haojun Liao
87957e2bb0
Merge pull request #21478 from taosdata/fix/TD-23423
...
fix tsdb read error version
2023-05-26 16:56:09 +08:00
Hongze Cheng
f5286359fa
more code
2023-05-26 15:57:31 +08:00
Hongze Cheng
7acc124dfc
more code
2023-05-26 15:25:29 +08:00
Minglei Jin
34b9b322cd
cache/var-data: realloc for cache reading
2023-05-26 15:01:57 +08:00
Hongze Cheng
b07ad168c3
more code
2023-05-26 14:49:50 +08:00
Haojun Liao
f61f37c936
fix(tmq): set the correct offset rsp when no poll occuring.
2023-05-26 14:20:01 +08:00
Minglei Jin
6e29d7879f
cache/var-data: realloc var data
2023-05-26 14:13:01 +08:00
Hongze Cheng
9156b297ae
more code
2023-05-26 11:51:08 +08:00
Haojun Liao
1e845acabe
fix(tmq): allow seek before get assignment
2023-05-26 11:34:12 +08:00
Minglei Jin
bb481c52b6
cache/skyline: fix skyline false condition
2023-05-26 11:26:55 +08:00
Haojun Liao
ccbea13012
Merge branch '3.0' into refact/fillhistory
2023-05-26 10:40:53 +08:00
Haojun Liao
974b59c238
fix(query): fix bug in iterating the table list.
2023-05-26 10:10:10 +08:00
Haojun Liao
409656f7b6
fix(query): fix bug in iterating the table list.
2023-05-26 10:05:54 +08:00
Hongze Cheng
fa00d0df77
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-05-26 09:55:27 +08:00
Haojun Liao
cea8334427
Merge pull request #21449 from taosdata/refact/fillhistory
...
refactor: remove the module dependency. TD-24279
2023-05-26 09:01:45 +08:00
liuyao
75eb724c37
fix tsdb read error version
2023-05-26 08:55:23 +08:00
Haojun Liao
e24ce2111f
fix: set function ptr.
2023-05-26 00:00:07 +08:00
Haojun Liao
1e22d875b3
fix: fix dead lock.
2023-05-25 20:00:26 +08:00
Haojun Liao
c3be7b14be
fix: set correct function ptr.
2023-05-25 17:51:03 +08:00
Minglei Jin
8ee1288611
fix(cache): remove deleted data
2023-05-25 17:47:55 +08:00
Haojun Liao
0966213847
fix(arch): set the correct module api dependency.
2023-05-25 14:21:40 +08:00
Haojun Liao
da9f33a483
fix: fix error in set function ptr.
2023-05-25 09:56:34 +08:00
wade zhang
511ff7130b
Merge pull request #21445 from taosdata/fix/TD-24373
...
fix(cache/read): associate tbname with primary ts column
2023-05-25 08:01:51 +08:00
Haojun Liao
4a42f6b983
fix: fix error in api call.
2023-05-25 00:50:03 +08:00
Haojun Liao
a9b18d203d
fix:fix error.
2023-05-24 23:49:26 +08:00
Haojun Liao
ab907e3344
fix(query): fix syntax error.
2023-05-24 21:53:40 +08:00
Hongze Cheng
5586c6d8fb
Merge branch 'fix/shared_link_rocksdb' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-05-24 19:05:30 +08:00
Hongze Cheng
4d526ed0cd
change more
2023-05-24 18:59:09 +08:00
Minglei Jin
fc5d06681e
cache/last_row: treat none as null with last_row
2023-05-24 18:55:51 +08:00
Hongze Cheng
3c2a54ab4b
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-05-24 18:28:56 +08:00
Hongze Cheng
7d7c8af852
more code
2023-05-24 18:28:44 +08:00
wangmm0220
8537e4e80e
feat:add tag filter for stable subscribe
2023-05-24 18:26:55 +08:00
Haojun Liao
fe09705855
fix: set the init function pointer.
2023-05-24 17:13:20 +08:00
Ganlin Zhao
89bea7100f
fix: fix count var type error
2023-05-24 00:31:05 -07:00
dapan1121
cbbbaca553
Merge pull request #21437 from taosdata/fix/TD-23955-3.0
...
fix: delete index filter for desc query
2023-05-24 14:05:07 +08:00
Hongze Cheng
ab7f6eb764
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-05-24 13:47:35 +08:00
Hongze Cheng
106f701ebb
more code
2023-05-24 13:47:28 +08:00
Haojun Liao
b2ce45b07b
refactor: do some internal refactor.
2023-05-24 13:39:20 +08:00
Haojun Liao
a2f29aa0f5
refactor: do some internal refactor.
2023-05-24 13:34:46 +08:00
Haojun Liao
1f7f326bed
refactor: do some internal refactor and set the api function ptr.
2023-05-24 13:22:05 +08:00
Hongze Cheng
4775b26e5e
more code
2023-05-24 11:52:38 +08:00
kailixu
ef899a0cc3
fix: delete index filter for desc query
2023-05-24 11:28:45 +08:00
Minglei Jin
26bfa4363d
fix(cache/read): associate tbname with primary ts column
2023-05-24 11:01:47 +08:00
Hongze Cheng
d6d0bf0e41
enh: add varchar sma
2023-05-24 10:47:26 +08:00
liuyao
180abf2229
set agg task status
2023-05-24 09:34:40 +08:00
Hongze Cheng
166a86db69
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-05-24 09:31:20 +08:00
Hongze Cheng
0c09d6f0d2
more code
2023-05-24 09:30:14 +08:00
liuyao
b5d01f9bab
set agg pause status
2023-05-24 09:19:28 +08:00
Haojun Liao
39a1fa8f78
refactor: do some internal refactor.
2023-05-23 19:20:25 +08:00
Haojun Liao
66477a28ca
refactor: do some internal refactor.
2023-05-23 19:10:50 +08:00
Haojun Liao
3d084adf1f
Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory
...
# Conflicts:
# source/dnode/vnode/inc/vnode.h
# source/libs/executor/src/executil.c
# source/libs/index/CMakeLists.txt
# source/libs/index/src/indexFilter.c
2023-05-23 18:32:47 +08:00
Haojun Liao
e67b532d8a
refactor: refactor the module dependency.
2023-05-23 18:29:23 +08:00
kailixu
82b8c3c3d1
fix: delete index filter for desc query
2023-05-23 18:21:21 +08:00
kailixu
18e83173c8
fix: delete index filter for desc query
2023-05-23 17:21:45 +08:00
wade zhang
68a98d4d09
Merge pull request #21429 from taosdata/fix/TD-24306
...
fix(cache): sychronize commit, read and write threads with writebatch
2023-05-23 16:20:59 +08:00
Hongze Cheng
1c10694fde
more code
2023-05-23 16:20:19 +08:00
Hongze Cheng
36b2495cf6
more code
2023-05-23 15:07:42 +08:00
Minglei Jin
6d620a7d7c
fix(cache/read): set none to null instead of skipping column
2023-05-23 14:51:26 +08:00
Hongze Cheng
5d5add3f4b
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-05-23 14:31:47 +08:00
Hongze Cheng
cd39d129c2
more code
2023-05-23 14:25:47 +08:00
Hongze Cheng
85c4c61027
more code
2023-05-23 14:18:23 +08:00
Minglei Jin
81048f93b0
fix(cache): sychronize commit, read and write threads with writebatch
2023-05-23 13:44:33 +08:00
yihaoDeng
c15b1e3520
opt compile
2023-05-23 11:46:02 +08:00
Hongze Cheng
91a5e17b9b
more code
2023-05-23 11:45:33 +08:00
Hongze Cheng
57bde4f311
more code
2023-05-23 11:35:44 +08:00
Hongze Cheng
ca28c99f80
more code
2023-05-23 11:19:24 +08:00
wangmm0220
ed612088c0
fix:lost data because tsdbreader or task is killed
2023-05-23 10:32:13 +08:00
Hongze Cheng
89eafa18cb
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-05-23 09:58:53 +08:00
Hongze Cheng
46b72f340a
more fix
2023-05-23 09:58:40 +08:00
kailixu
a171c0c860
Merge branch '3.0' into fix/TD-21457-3.0
2023-05-23 09:27:31 +08:00
wade zhang
9e73a69316
Merge pull request #21389 from taosdata/fix/TD-24306
...
fix(cache/commit): skip batch write if empty
2023-05-23 08:22:33 +08:00
kailixu
a3bf49d22f
chore: revert
2023-05-22 20:35:52 +08:00
kailixu
c75aa54a3d
fix: tsdb read and append _wstart for tsma
2023-05-22 20:33:29 +08:00
wangmm0220
d8387b95ff
fix:set task status to 0 in inti
2023-05-22 20:14:43 +08:00
Hongze Cheng
c16126fa96
more code
2023-05-22 18:39:10 +08:00
Haojun Liao
f3491310a9
Merge pull request #21411 from taosdata/fix/TD-24144
...
fix:remove get schema from previous for taosx
2023-05-22 18:37:20 +08:00
Minglei Jin
75ccd024a2
cache/writebatch: separate read & write batches
2023-05-22 18:06:58 +08:00
dapan1121
08ff4f4540
fix: crash issue
2023-05-22 17:06:01 +08:00
Hongze Cheng
8b83c85b0c
more code
2023-05-22 16:28:31 +08:00
kailixu
f18fc19d76
fix: tsdb read and tsma _wstart append
2023-05-22 16:13:50 +08:00
Hui Li
0f4fb1c31d
Merge pull request #21407 from taosdata/mark/tmq
...
fix:set task code success after kill
2023-05-22 16:10:18 +08:00
wangmm0220
ae515851c4
fix:remove get schema from previous for taosx
2023-05-22 15:32:30 +08:00
Minglei Jin
21adc23af4
cache/loading: skip partial loading tables
2023-05-22 15:21:19 +08:00
Hongze Cheng
e731a08f2d
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-05-22 14:07:49 +08:00
wangmm0220
591b51f624
fix:set task code success after kill
2023-05-22 12:42:21 +08:00
Haojun Liao
f520de0dab
refactor: adjust the module dependency.
2023-05-22 10:07:01 +08:00
Hui Li
3f824e2045
Merge pull request #21355 from taosdata/mark/tmq
...
fix:error in pHandle lock
2023-05-22 08:57:45 +08:00
Haojun Liao
9423001fea
Merge pull request #21396 from taosdata/refact/fillhistory
...
Refact/fillhistory
2023-05-21 01:12:00 +08:00
Haojun Liao
899e4d3350
refactor: do some internal refactor.
2023-05-20 18:13:58 +08:00
Haojun Liao
de44c9160c
refactor: do some internal refactor.
2023-05-20 18:05:39 +08:00
wangmm0220
7b735c67d0
fix:move sleep logic from rpc thread to tmq thread & fix some error
2023-05-20 16:36:25 +08:00
wangmm0220
8183be4aff
fix:move sleep logic from rpc thread to tmq thread & fix some error
2023-05-20 16:13:52 +08:00
wangmm0220
04858fae22
fix:tsdbreader is free by mistake
2023-05-20 12:20:54 +08:00
wangmm0220
1ddbdad33c
fix:set task status killed when vnode receive subscribe msg from mnode
2023-05-19 21:40:33 +08:00
wangmm0220
33d6df8717
fix:set task status killed when vnode receive subscribe msg from mnode
2023-05-19 19:11:49 +08:00
Haojun Liao
e2ec8d738c
other: add some logs.
2023-05-19 18:08:01 +08:00
wangmm0220
c7c255e967
fix:set task status killed when vnode receive subscribe msg from mnode
2023-05-19 18:06:05 +08:00
Hongze Cheng
545d7a6ad6
more code
2023-05-19 17:56:21 +08:00
Haojun Liao
bcaa44e290
Merge pull request #21385 from taosdata/fix/liaohj_main
...
fix(query): add null check.
2023-05-19 17:55:02 +08:00
Hongze Cheng
de1bdf97f9
more code
2023-05-19 17:20:53 +08:00
wangmm0220
ff2b545b27
fix:set task status killed when vnode receive subscribe msg from mnode
2023-05-19 17:16:47 +08:00
Minglei Jin
a5c1b9a054
cache/commit: skip batch write if empty
2023-05-19 17:10:24 +08:00
Hongze Cheng
b75aca7538
more code
2023-05-19 16:44:32 +08:00
Minglei Jin
962db65775
Merge branch '3.0' into fix/TD-23549
2023-05-19 16:19:57 +08:00
Haojun Liao
be35194d16
fix(query): add null check.
2023-05-19 15:54:46 +08:00
Hongze Cheng
1c4abc62c3
more code
2023-05-19 15:16:01 +08:00
wangmm0220
f7ab8dabf0
fix:[TD-23972] push subscribe msg to vnode even though consumer not change
2023-05-19 15:14:39 +08:00
wangmm0220
238254e49e
fix:add task status check in doQueueScan & checkout consumer in tqProcessPollReq
2023-05-19 14:06:43 +08:00
Hongze Cheng
e247870548
more code
2023-05-19 13:35:32 +08:00
Haojun Liao
d8525123a2
enh(stream): add API to retrieve last ts for multi-tables.
2023-05-19 11:03:41 +08:00
Hongze Cheng
66ea10755e
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-05-19 10:58:12 +08:00
Hongze Cheng
944d6a9c74
more code
2023-05-19 10:24:07 +08:00
wade zhang
208c9756cf
Merge pull request #21331 from taosdata/fix/TD-24097
...
enh(cache/batchread): load columns in one trip
2023-05-19 10:20:47 +08:00
dapan1121
e882601b67
fix: last table scan issue
2023-05-19 09:15:48 +08:00
wangmm0220
bca1af3f5d
fix:change tmq subscribe try time to 60mins
2023-05-18 21:18:44 +08:00
Minglei Jin
35f74ce2e8
cache/schema: not cache schema
2023-05-18 18:35:06 +08:00
Haojun Liao
c4c5bbb65c
other: merge 3.0
2023-05-18 17:28:40 +08:00
Haojun Liao
dbd52ecffa
Merge pull request #21364 from taosdata/enh/rocksdbSstate
...
state merge into 3.0
2023-05-18 17:25:44 +08:00
Hongze Cheng
a622a1065a
more code
2023-05-18 17:08:46 +08:00
liuyao
da3fc5111e
fix pause agg task
2023-05-18 15:29:41 +08:00
Hongze Cheng
c7d1c88fbc
more code
2023-05-18 15:06:21 +08:00
Minglei Jin
f95867d255
cache/del: fix lru key length
2023-05-18 14:48:08 +08:00
Minglei Jin
3b316051bf
cache/schema: fix schema double free
2023-05-18 13:51:07 +08:00
yihaoDeng
9380b22394
merge 3.0
2023-05-18 05:46:38 +00:00
Minglei Jin
0f8b7c87f7
cache/delete: fix rocks key length
2023-05-18 13:15:25 +08:00
Haojun Liao
5d5b2bb16a
refactor: do some internal refactor.
2023-05-18 12:59:19 +08:00
Haojun Liao
ce61b2ab00
fix: fix syntax error in tqRead
2023-05-18 11:35:45 +08:00
Haojun Liao
c3491dae16
refactor: do some interal refactor.
2023-05-18 10:56:40 +08:00
Haojun Liao
81f821a6fc
refactor: do some internal refactor.
2023-05-18 10:51:43 +08:00
Hongze Cheng
c8ba83cb31
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-05-18 10:38:50 +08:00
wangmm0220
54f4860139
fix:rollback [TD-23972] push subscribe msg to vnode even though consumer not change
2023-05-17 19:44:56 +08:00
Haojun Liao
b9bda9b30f
fix(stream): set the correct start offset for resumed stream task.
2023-05-17 19:36:42 +08:00
wangmm0220
405cdfa7bc
fix:error in pHandle lock
2023-05-17 19:02:16 +08:00
wangmm0220
1d9dd153ea
fix:error in pHandle lock
2023-05-17 18:57:45 +08:00
Minglei Jin
765cc72618
cache/memtable: update cache when flag is on
2023-05-17 18:56:03 +08:00
Haojun Liao
73b1a4bddf
fix(stream): fix syntax error.
2023-05-17 18:29:52 +08:00
Haojun Liao
92feb89a09
refactor: do some internal refactor.
2023-05-17 18:08:04 +08:00
Hongze Cheng
d4ab729c10
more code
2023-05-17 17:14:11 +08:00
Hongze Cheng
4b5ea55d1a
more code
2023-05-17 16:46:10 +08:00
Haojun Liao
a4d9210b07
fix(tmq): add filter for taosX poll rsp.
2023-05-17 16:40:44 +08:00
Minglei Jin
f428a68ec1
cache/update: update lru when deleting or updating
2023-05-17 16:08:48 +08:00
wangmm0220
4bb25c280f
fix:add log
2023-05-17 15:54:36 +08:00
Haojun Liao
041ffa91bd
other: merge main.
2023-05-17 15:42:15 +08:00
Minglei Jin
b892b1fdfe
cache/flag: fix cache flag compiling issue
2023-05-17 15:26:10 +08:00
Haojun Liao
f55f8d245c
fix(tmq): avoid the offset is revised by pool rsp which is issued before invoking tmq_offset_seek function.
2023-05-17 15:19:51 +08:00
Hongze Cheng
ccbc7c5ba0
more code
2023-05-17 15:18:08 +08:00
Haojun Liao
366cd1871a
Merge pull request #21314 from taosdata/fix/liaohj_main
...
fix(stream):extract delete msg from wal.
2023-05-17 14:52:49 +08:00
Minglei Jin
e95613ec10
cache/commit: update & commit cache if cache not off
2023-05-17 14:32:02 +08:00
Minglei Jin
86e3c1d20d
cache/stt: remove ts from merge tree loading
2023-05-17 14:05:28 +08:00
Haojun Liao
3896e148fd
log(tmq): add some logs.
2023-05-17 11:37:38 +08:00
dapan1121
fb7a06e06e
Merge pull request #21271 from taosdata/enh/tsbsPerf.4
...
Enh/tsbs perf.4
2023-05-17 11:00:14 +08:00
Haojun Liao
f3f52c0232
fix(stream): add some logs and set the wal offset to be the ended version when finishing the step2 recover stage.
2023-05-17 10:43:23 +08:00
Haojun Liao
d457b84aba
Merge pull request #21311 from taosdata/mark/tmq
...
fix:add lock to pHandle for safety
2023-05-17 09:11:39 +08:00
wangmm0220
c52a4ea4f0
fix:merge from 3.0
2023-05-17 01:11:55 +08:00
Minglei Jin
756fefaa29
cache/batchread: load columns in one trip
2023-05-16 18:56:05 +08:00
wangmm0220
90099ea1c0
fix:compile error in windows
2023-05-16 18:41:35 +08:00
wangmm0220
e6860cada8
fix:compile error in windows
2023-05-16 18:35:10 +08:00
wangmm0220
a52939127f
fix:dead lock
2023-05-16 17:58:31 +08:00
Hongze Cheng
0e466a97f0
more code
2023-05-16 15:48:17 +08:00
Hongze Cheng
f39b8a0652
more code
2023-05-16 15:31:38 +08:00
Hongze Cheng
ec7cb5f217
more code
2023-05-16 15:19:13 +08:00
kailixu
9faefb7498
Merge branch 'main' into enh/TD-22404-M
2023-05-16 15:17:42 +08:00
Hongze Cheng
0b17e3fe1c
more code
2023-05-16 14:35:57 +08:00
wangmm0220
e6e0ac7603
fix:alwalys in exec if consumer Id mismatch & check result for wal seek ver
2023-05-16 14:01:38 +08:00
Haojun Liao
e35d145734
fix(stream): fix memory leak.
2023-05-16 13:59:13 +08:00
Hongze Cheng
d273d10ff0
more code
2023-05-16 11:39:53 +08:00
Haojun Liao
cbb02458ed
fix(stream): fix the seek condition.
2023-05-16 11:19:11 +08:00
Hongze Cheng
7cc7d35be4
more code
2023-05-16 11:09:15 +08:00
Haojun Liao
30e7cb5860
fix(tmq): avoid return delete msg for table subscription.
2023-05-16 10:42:02 +08:00
Hongze Cheng
f40986408c
more code
2023-05-16 10:34:02 +08:00
Hongze Cheng
96bfbbe784
refact more code
2023-05-16 10:07:46 +08:00
Hongze Cheng
e783609ebd
more code
2023-05-16 09:36:32 +08:00
Haojun Liao
5e16db4e19
fix(stream):extract delete msg from wal.
2023-05-16 08:54:03 +08:00
wangmm0220
62520af2e5
fix:core dump
2023-05-16 00:32:21 +08:00
Haojun Liao
d585f34ea9
fix(tmq): avoid seek to previous position.
2023-05-15 18:48:50 +08:00
wangmm0220
36454c73ed
fix:add lock to pHandle for safety
2023-05-15 18:38:14 +08:00
Hongze Cheng
f8220e8b90
more code
2023-05-15 17:26:00 +08:00
Haojun Liao
04c8c933c8
fix(stream): add initial offset check.
2023-05-15 17:15:03 +08:00
Hongze Cheng
68f07c4bec
more code
2023-05-15 17:14:45 +08:00
Hongze Cheng
23ad540035
more code
2023-05-15 15:56:13 +08:00
Hongze Cheng
066786e681
more code
2023-05-15 15:47:06 +08:00
Hongze Cheng
c31b1034cd
Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize
2023-05-15 14:26:40 +08:00
Haojun Liao
17592ea294
refactor: do some internal refactor.
2023-05-15 13:49:26 +08:00
Haojun Liao
9feb0a86d6
fix(tmq): assert after the assignment of value.
2023-05-15 12:46:00 +08:00
Hongze Cheng
33b8ff9bce
more code
2023-05-15 11:39:00 +08:00
Haojun Liao
6aa197123e
refactor: do some internal refactor.
2023-05-15 11:29:23 +08:00
Haojun Liao
6f7add8870
refactor: do some internal refactor.
2023-05-15 10:48:03 +08:00
Haojun Liao
6cbedc5d4a
refactor: do some internal refactor.
2023-05-15 10:45:01 +08:00