Commit graph

94 commits

Author SHA1 Message Date
Jing Sima
410324746b
feat:[TS-4897] virtual table (#30098)
* feat: [TS-4897] Support create/drop/alter/show/describe vtable

* feat: [TS-4897] Support vtable's query

* feat: [TS-4897] Support create virtual supertable

* feat: [TS-4897] Support explain analyze / where / count(*) and only select ts of vtable.

* feat: [TS-4897] Add create test and fix bugs

* feat: [TS-4897] Add alter/drop test and fix bugs

* feat: [TS-4897] Add describe/show test and fix bugs

* feat: [TS-4897] Add auth test and fix bugs

* feat: [TS-4897] Fix meta/catalog/cache bugs

* feat: [TS-4897] Support select tag from virtual child table

* feat: [TS-4897] Add select test and fix plenty of bugs

* feat: [TS-4897] Add optimize rule for vtable scan / support create vtable cross database / remove enterprise constraint / fix bugs.

* feat: [TS-4897] Fix 'schema is old'

* feat: [TS-4897] Support virtual stable query

* feat: [TS-4897] Add tests and Fix bugs

* feat: [TS-4897] resolve conflict.
2025-03-15 14:10:46 +08:00
liuyao
2de6736160
feat(stream): add new trigger continuous_window_close (#30125)
* opt stream build twa result

* opt force window close memory

* feat(stream):optimize new interval and scan operator

* adj log

* opt code

* opt code

* fill history

* fix issue for fill history

* add ci

* feat(stream): add new stream nonblock interval operator

* adjust code

* use new scan operator

* use new scan operator

* add log

* fix issue

* recover stream scan next function

* fix issue

* fix issue

* fix issue

* ignore disorder data

* fix issue

* fix issue for interval sliding

* fix issue

* fix ci issue

* fix ci issue

* fix ci issue

* add semi && final nonblock interval operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* refactor(stream): track the msgId for each upstream tasks.

* fix(stream): fix race condition.

* fix(stream): update the task last msgId when putting into input queue succ.

* fix issue

* fix issue

* put recalculate data to rocksdb

* fix issue

* fix issue

* enh(query)[TD-33071]: add support for saving and restoring tsdbReader scan progress

- Implement functionality to save scan progress during tsdbReader operations
- Enable resuming scans from the last saved position

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* add rec interval check

* enh(stream):add recalculate tasks.

* enh(stream): support the re-calculate the tasks.

* fix issue && do refactor

* do refactor

* fix issue

* fix issue

* update backend opt

* add new interface

* add new session operator

* support blob

* add new session operator

* fix issue

* add rec state for rec task

* fix invalid read

* add new session window

* enh(stream): update the stream tasks backend.

* new session operator

* add pull data

* fix(stream): fix error in expand stream backend.

* fix issue

* fix issue

* fix issue

* merge code

* fix issue

* fix(stream): check for null ptr.

* fix(stream): add more check.

* fix issue

* fix issue

* fix issue

* add debug code

* fix issue

* fix issue

* fix issue

* set rec end flag

* fix(stream): opt re-calculate stream tasks.

* fix issue

* fix issue

* add new operator

* enh(stream): dispatch recalculate block to agg tasks.

* fix issue

* fix issue

* fix(stream): adjust filter.

* fix issue

* refactor

* refactor(stream): adjust the recalculate end block.

* fix issue

* fix(stream): set correct create trigger block.

* fix issue

* fix(stream): fix error in build recalculate end block.

* fix(stream): check null ptr.

* add stream client && fix issue

* fix mem leak

* fix(stream): free msg.

* add stream client

* fix(stream): fix error.

* add stream client && fix issue

* add stream client

* refactor(stream): set the recalculate task complete.

* add wend and group_id for session window dest table

* feat(stream): refactor and set the recalcul agg task complete.

* add cfg for adapter

* fix issue

* add state && event operator

* feat(stream): support fill-history task.

* add new fill operator

* fix(stream): set correct backend when updating fill-history task to recalculate task.

* add new fill operator

* fix(stream): s2025-03-06 11:10:31.272
et ops always open in scan tsdb

* fix(stream):set the correct taskType for sink task.

* new fill operator

* adj stream fill operator

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* fix issue

* adj test

* fix issue

* fix(stream): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(steam): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix(stream): fix issue

* fix: ut com error

* fix(stream): fix mem leak and adjust operator type check rule

* fix(stream): fix mem leak and adjust test case

* refactor code

* fix(stream): free items.

* fix(stream): free fix memory leak.

* fix(stream): fix syntax error.

* fix: ignore unexpect block

* fix: adjust op type

---------

Co-authored-by: Haojun Liao <hjliao@taosdata.com>
Co-authored-by: Jinqing Kuang <kuangjinqingcn@gmail.com>
Co-authored-by: yihaoDeng <luomoxyz@126.com>
2025-03-14 20:14:01 +08:00
wangmm0220
67a1df6269 feat:[TD-32642] fix problems reviewd 2024-12-09 16:15:48 +08:00
54liuyao
a60f390cdc stream primary key 2024-03-21 10:50:07 +08:00
kailixu
a9316c3710 feat: support uniq grant 2024-02-04 12:28:00 +08:00
dapan1121
170182fecd feat: support fill history with sub request 2023-06-12 16:10:54 +08:00
Xiaoyu Wang
98e2fa2d7b feat: add ignore update option for create stream 2023-02-08 18:46:12 +08:00
Xiaoyu Wang
bc413b8fff feat: add stream option 'delete_mark' 2022-12-06 16:07:11 +08:00
Xiaoyu Wang
02ac6fa552 enh: add unit test and delete useless code 2022-10-26 17:01:55 +08:00
Xiaoyu Wang
5116e0a01b enh: added memory allocators for parser and planner 2022-09-21 17:04:12 +08:00
Xiaoyu Wang
ff9d673489 enh: add binary serialization method to node structure 2022-09-13 10:48:39 +08:00
Xiaoyu Wang
99490c063e feat: system table visible permission 2022-08-24 17:36:10 +08:00
Xiaoyu Wang
1530b33991 feat: support 'select *, expr from ...' syntax 2022-06-30 16:16:05 +08:00
Xiaoyu Wang
ae076af4f1 feat: sql system info function 'database()', 'client_version()', 'server_version()', 'server_status()', 'current_user()' and 'user()' 2022-06-29 11:41:32 +08:00
Xiaoyu Wang
cd36807faf feat: refactor the plan implementation of unique function 2022-06-27 21:30:20 +08:00
Xiaoyu Wang
c41a4bd7db feat: subplan adds 'user' field 2022-06-24 17:27:43 +08:00
Liu Jicong
53ef66961a feat(stream): support snode 2022-06-20 14:29:18 +08:00
Liu Jicong
9ae7dc1028 enh(sma): remove filefator 2022-06-15 17:42:21 +08:00
Xiaoyu Wang
f45ddaf1c8 feat: stream interval distributed split 2022-06-02 16:37:46 +08:00
54liuyao
901ff9bf18 feat(sma):files factor 2022-05-31 16:14:56 +08:00
Xiaoyu Wang
fb901d95e4 fix: some problems of parser for stmt mode 2022-05-17 11:11:40 +08:00
Xiaoyu Wang
41e36dddb7 fix: some problems of parser 2022-05-11 19:03:59 +08:00
Xiaoyu Wang
6e50691b29 feat: sql command 'grant', 'revoke', 'kill transaction' and 'show transactions' 2022-05-07 17:37:17 +08:00
dapan1121
1850dc0371 stmt query 2022-04-28 11:47:55 +08:00
dapan1121
1aa22beb60 stmt query 2022-04-27 20:03:13 +08:00
dapan1121
15d7abf46f stmt query 2022-04-25 20:03:28 +08:00
Xiaoyu Wang
74fb0f4b55 enh: order by primary key optimize 2022-04-24 20:11:06 +08:00
Xiaoyu Wang
20879d0ef7 fix: some syntax parsing problems 2022-04-22 18:23:37 +08:00
Liu Jicong
78222a1722
Merge pull request #11706 from taosdata/feature/tq
refactor(tmq): rewrite tq read function
2022-04-21 15:02:59 +08:00
Liu Jicong
a98bf9d1b5 add convert for rSma 2022-04-21 14:19:58 +08:00
dapan1121
da4379853d stmt 2022-04-20 09:12:59 +08:00
Xiaoyu Wang
ff80459821 feat: implementation of parser and planner for stmt API 2022-04-18 20:19:24 +08:00
Xiaoyu Wang
b9fb9c580d feat: sql command "create stream" 2022-04-16 13:15:14 +08:00
dapan1121
96eee80063 feature/qnode 2022-03-26 15:03:22 +08:00
Xiaoyu Wang
9ca80596e4 merge 3.0 2022-03-21 02:00:30 -04:00
Xiaoyu Wang
e4dd627b20 stream plan implement 2022-03-19 03:02:31 -04:00
Xiaoyu Wang
c2aebb25bf TD-13675 create sma index parser implement 2022-03-15 06:44:38 -04:00
Xiaoyu Wang
028e6d1620 TD-13981 show databases rewrite 2022-03-11 02:58:29 -05:00
Xiaoyu Wang
84f60fcc0a TD-13747 deal memory leaks 2022-03-10 06:32:39 -05:00
Xiaoyu Wang
8615c97fc6 TD-13704 super table plan split 2022-03-09 06:53:00 -05:00
Xiaoyu Wang
b91899e757 TD-13704 super table plan split 2022-03-09 04:32:12 -05:00
Xiaoyu Wang
92cd252b70 TD-13706 integration create table stmt and insert stmt 2022-03-04 05:43:23 -05:00
Xiaoyu Wang
523855bec5 TD-13747 planner integrate 2022-03-01 21:50:51 -05:00
Xiaoyu Wang
cd7a0e559b TD-13747 New SQL model integration 2022-02-28 04:56:38 -05:00
Xiaoyu Wang
768e05939c TD-13747 New SQL model integration 2022-02-28 04:02:43 -05:00
Haojun Liao
3a23a30a9c [td-11818] Refactor. 2022-02-14 14:39:42 +08:00
Haojun Liao
afd1ce63db [td-11818] Refactor API. 2022-01-28 10:44:02 +08:00
Haojun Liao
069d715fe7 [td-11818]update log, fix bug in select * from super_table. 2022-01-21 23:30:03 +08:00
Haojun Liao
09ba6a611d [td-11818] refactor. 2022-01-21 11:19:24 +08:00
Haojun Liao
5a3a0f3d6c [td-11818]fix bug in creating table. 2022-01-20 22:57:29 +08:00