82 commits

Author	SHA1	Message	Date
Haojun Liao	f54fe2d6ef	refactor: do some internal refactor.	2023-12-01 10:17:15 +08:00
Haojun Liao	00f8103262	fix(stream): fix error in generating token in bucket.	2023-11-23 09:34:19 +08:00
Haojun Liao	7f3a50dfde	fix(stream): fix the invalid free.	2023-11-09 18:14:27 +08:00
Haojun Liao	43b14ba8b4	refactor: wait for a while when no quota available.	2023-11-07 17:49:49 +08:00
Haojun Liao	06d02b862e	fix(stream): update the fill-time for quota limitation.	2023-11-07 17:33:30 +08:00
Haojun Liao	0b59681158	refactor: wait a while when no token available.	2023-11-07 17:18:58 +08:00
Haojun Liao	9c49de69f8	refactor: do some internal refactor.	2023-11-07 17:05:20 +08:00
Haojun Liao	680eb5674e	refactor: do some internal refactor.	2023-11-06 09:15:49 +08:00
Haojun Liao	4c267b538f	fix(stream): add expired epset node list for stream tasks in hb to mnode.	2023-10-27 23:05:41 +08:00
Haojun Liao	4826b34a2b	refactor: do some internal refactor.	2023-10-21 16:32:44 +08:00
Haojun Liao	06cd67e26e	refactor: do some internal refactor.	2023-10-21 16:20:03 +08:00
Haojun Liao	402aefd95d	refactor(stream): do some internal refactor.	2023-10-19 15:09:47 +08:00
Haojun Liao	fdb6ec1fa3	enh(stream): add parameter to limit the stream sink task.	2023-10-16 22:52:39 +08:00
Haojun Liao	4b8cd3bccd	fix(stream): not idle for sink task when no tokens are available.	2023-10-09 10:07:19 +08:00
Haojun Liao	23fb26798f	fix(stream): sleep for 10ms	2023-10-07 19:47:49 +08:00
Haojun Liao	e4e4c5a36e	fix(stream): wait for a while when no available token.	2023-10-07 19:41:49 +08:00
Haojun Liao	ab17bfdf09	refactor: do some internal refactor.	2023-10-07 19:16:55 +08:00
Haojun Liao	d11c0a113c	fix(stream): fix syntax error.	2023-10-07 14:56:09 +08:00
Haojun Liao	7ce3d2c200	fix(stream): quit from loop when input queue is full.	2023-10-07 14:54:11 +08:00
Haojun Liao	c20dd002fb	enh(stream): add more info for sink task.	2023-10-07 01:14:00 +08:00
Haojun Liao	98659ad323	fix(stream): fix the invalid check.	2023-10-05 00:09:47 +08:00
Haojun Liao	41ef1a45c1	enh(stream): optimize the scan wal perf	2023-10-04 22:06:46 +08:00
Haojun Liao	45e413f8d5	refactor: wait for 100ms before scan wal again.	2023-10-03 20:57:19 +08:00
Haojun Liao	132fb8e82e	refactor: wait for more time for future data	2023-10-03 15:42:00 +08:00
Haojun Liao	5718158fc0	refactor: do some internal refactor.	2023-10-01 22:27:29 +08:00
Haojun Liao	f525778aef	fix(stream): fix syntax error.	2023-09-28 00:53:36 +08:00
Haojun Liao	9ab9de0ad3	fix(stream): limit sink quota.	2023-09-27 00:30:38 +08:00
Haojun Liao	aec15ae39f	enh(stream): add quota limitation for sink task.	2023-09-26 23:29:54 +08:00
Haojun Liao	890d658aea	refactor: do some internal refactor.	2023-09-26 14:11:45 +08:00
Haojun Liao	eb4078b7f3	fix(stream): record the tasks started info, and do some internal refactor.	2023-09-25 09:59:05 +08:00
Haojun Liao	17586af0ce	refactor: do refactor the sink task.	2023-09-21 13:32:57 +08:00
Haojun Liao	9f9b712332	fix(stream): disable token bucket.	2023-09-21 01:19:58 +08:00
Haojun Liao	6633fb971b	fix(stream): update logs.	2023-09-20 18:18:31 +08:00
Haojun Liao	2c9d54af37	fix(stream): fix memory leak.	2023-09-18 19:58:46 +08:00
Haojun Liao	2bfd6e3355	refactor: do some internal refactor.	2023-09-15 09:25:22 +08:00
Haojun Liao	fce5be0eb4	fix(stream): fix dead lock.	2023-09-14 14:09:05 +08:00
Haojun Liao	09a15bf340	refactor: do some internal refactor.	2023-09-12 22:07:52 +08:00
Haojun Liao	e457d94ac6	refactor: do some internal refactor.	2023-09-12 18:09:02 +08:00
Haojun Liao	78a5680cf4	fix(stream): add some logs.	2023-09-12 15:59:09 +08:00
Haojun Liao	f602aa965f	fix(stream): fix coverity scan issues.	2023-09-12 09:16:18 +08:00
Haojun Liao	50ef500f51	refactor(stream): do sink module refactor.	2023-09-11 10:09:31 +08:00
Haojun Liao	a9321248a9	fix(stream): set the correct flag when there is one token existed.	2023-09-10 18:34:03 +08:00
Haojun Liao	4ffb4a5b1f	refactor: disable some logs.	2023-09-10 11:02:32 +08:00
Haojun Liao	35b97cbd19	fix(stream): set correct token in bucket.	2023-09-08 23:50:41 +08:00
Haojun Liao	328377c25f	refactor: add some logs.	2023-09-08 23:04:39 +08:00
Haojun Liao	dc821057e5	fix(stream): update the log.	2023-09-07 10:33:38 +08:00
Haojun Liao	e407d7dc6b	fix(stream): update log.	2023-09-07 10:09:05 +08:00
Haojun Liao	956047a441	fix(stream): count down the token in bucket.	2023-09-07 10:02:13 +08:00
Haojun Liao	b240e91c91	enh(stream): add token bucket to limit the rate of sink operation.	2023-09-07 09:58:48 +08:00
Haojun Liao	c86eeb3938	fix(stream): add task status check when waiting for the table create.	2023-09-06 10:58:33 +08:00