Commit graph

140 commits

Author SHA1 Message Date
adishM98 Bot
c81e58edee fix EOF 2025-11-24 13:00:52 +05:30
adishM98 Bot
441f9eb8d2 fix: update entrypoint script to use ce-preview.sh for PostgreSQL initialization 2025-11-24 12:58:42 +05:30
adishM98 Bot
7e988c6d7d fix(redis): Reformat RDB snapshot configuration for clarity 2025-11-13 15:41:08 +05:30
adishM98 Bot
c940bcba25 fix(docker): Install Redis from official repository for BullMQ compatibility 2025-11-13 15:04:48 +05:30
Akshay
18b831f783
Refactor: Workflows with BullMQ (#14275)
* refactor(workflows): migrate core modules from Temporal to BullMQ

Update main application modules to support BullMQ-based workflow scheduling:

- Remove Temporal worker bootstrap code from main.ts
- Migrate from @nestjs/bull to @nestjs/bullmq
- Add Bull Board dashboard at /jobs with basic auth
- Register BullMQ queues in WorkflowsModule
- Add IWorkflowScheduler interface for scheduler abstraction
- Create CE stubs for WorkflowSchedulerService and ScheduleBootstrapService
- Remove workflow dependencies from AppsModule (moved to WorkflowsModule)
- Add proper route exclusion for /jobs dashboard
- Support WORKER env var for conditional processor registration

This commit completes the migration from Temporal to BullMQ for workflow
scheduling, enabling simpler deployment and better horizontal scaling.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* chore: remove unused Temporal imports and commented code

Clean up migration artifacts:
- Remove unused imports from main.ts (TOOLJET_EDITIONS, getImportPath, ITemporalService, getTooljetEdition)
- Remove commented TemporalService references from WorkflowsModule
- Remove temporal.service from getProviders path array
- Add missing newlines at EOF for IWorkflowScheduler.ts and schedule-bootstrap.service.ts

This cleanup prepares the codebase for complete Temporal code removal in a future commit.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* build: add BullMQ and Bull Board dependencies

Add required packages for BullMQ-based workflow scheduling:

- @nestjs/bullmq: NestJS integration for BullMQ
- @bull-board/api, @bull-board/express, @bull-board/nestjs: Queue dashboard
- bullmq: Core BullMQ library
- express-basic-auth: Authentication for Bull Board dashboard

Note: @nestjs/bull is kept for backward compatibility during migration.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* chore: remove Temporal service files from CE

Remove deprecated Temporal-based workflow implementation files:
- server/src/modules/workflows/interfaces/ITemporalService.ts
- server/src/modules/workflows/services/temporal.service.ts

These files are replaced by IWorkflowScheduler interface and BullMQ-based
WorkflowSchedulerService implementation.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* feat: add comprehensive Redis configuration support for BullMQ

* refactor: remove Temporal setup and configuration from entrypoint scripts and Dockerfiles (#14294)

* refactor: remove Temporal setup and configuration from entrypoint scripts and Dockerfiles

* feat: integrate Redis support for BullMQ in preview environment

* remove worker execution logic from setup script

* Refactor: Centralise workflow execution through BullMQ (#14321)

* refactor: run all workflows through bullmq

* refactor: update imports

* chore: update subproject commit reference in server/ee

* feat: ablity to cancel workflow

* feat: implement workflow cancellation functionality with Redis support

* feat: add optional timeout parameter to requestCancellation method

* refactor: clean up formatting and add maintenance toggle event emission in AppsService

* feat: ability to cancel multiple inprogress executions

* feat: implement execution state management and display logic

* chore: update submodule commit reference

---------

Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Adish M <44204658+adishM98@users.noreply.github.com>
2025-11-05 17:54:38 +05:30
adishM98 Bot
4c8c5381dd Fix: add rsyslog directory for audit logs with proper permissionsin Dockerfile 2025-10-21 18:00:24 +05:30
adishM98 Bot
f0bd076b0f fix: update plugin build process to use install and separate prune step 2025-09-26 21:42:43 +05:30
adishM98 Bot
30fc0fea6b remove Neo4j installation and configuration from Dockerfiles and entrypoint scripts 2025-09-12 15:54:25 +05:30
adishM98 Bot
c3902da28a fix: add repository URL as build argument and improve branch checkout logic in Dockerfile 2025-09-12 14:45:50 +05:30
Adish M
86dccc69d2
Feat: Implement cloud review app deployment workflow with fork handling and submodule management (#13985) 2025-09-08 11:03:15 +05:30
Adish M
434446df1b
refactor: streamline Neo4j setup and connection validation messages (#13897) 2025-08-21 11:35:26 +05:30
Adish M
3568ff7ff6
fix: downgrade PostgreSQL version from 16 to 13 in Dockerfile (#13859) 2025-08-19 15:57:02 +05:30
Adish M
b10adfee98
Merge pull request #13757 from ToolJet/feat/potgresql-13-16
Update PostgreSQL to 16 and Neo4j versions in Dockerfiles and entrypoint scripts
2025-08-18 16:12:03 +05:30
Adish M
c020056bc7
fix: set group write permissions for frontend build files in dockerfile to support RedHat user assignment (#13845)
* fix: set group write permissions for frontend build files to support RedHat user assignment

* version bump from 3.16.8-lts to 3.16.9-lts

* revert: downgrade version from 3.16.9-lts to 3.16.8-lts across all components
2025-08-18 15:06:40 +05:30
adishM98 Bot
441430cbf4 fix: improve submodule handling in render preview app 2025-08-15 16:44:30 +05:30
Adish M
14b4bab5ed Update PostgreSQL to 16 and Neo4j versions in Dockerfiles and entrypoint scripts 2025-08-11 17:25:15 +05:30
Adish M
5f3ffad6bf
Changing folder for LTS and pre-release (#13666)
* Changing folder for LTS and pre-release

* correction in entrypoint path in pre-release dockerfile

* made change to render PR workflow to pickup the dockerfile according to branch
2025-08-05 12:28:01 +05:30
Adish M
b113015084
Fix: Post release automation corrections (#13662)
* Fix: Post release automation corrections

* automation fix for merging submodules PRs

* remove the extra slack notification in the docker CE release job

* adding the branch fall to cloud dockerfile
2025-08-05 11:07:48 +05:30
Adish M
dc77751ce8
fix: postgresql issue in try tooljet (#13626) 2025-08-03 13:56:01 +05:30
Adish M
eddb8bd414
Fix: Postgresql dependence issue in try tooljet dockerfile (#13624) 2025-08-03 12:44:43 +05:30
Adish M
e18a14738c
remove unnecessary SSH setup for GitHub in Dockerfiles (#13489) 2025-07-18 15:30:36 +05:30
Rohan Lahori
4ae677e30c
Added open ssh client to docker file (EE and Cloud) (#13465)
* added open ssh client to docker file

* added openssh-client to Dockerfiles for SSH support

---------

Co-authored-by: Adish M <adish.madhu@gmail.com>
2025-07-17 13:56:36 +05:30
Adish M
79ac1fe132
feat: install git in Dockerfiles for simplified git commands (#13455) 2025-07-17 00:38:42 +05:30
Adish M
67fa14ad05 Add SSH support for GitHub and install Git in Dockerfile 2025-07-16 21:18:55 +05:30
Adish M
891b8dd181 Add SSH support for GitHub and install Git in Dockerfile 2025-07-16 21:14:52 +05:30
Adish M
a931fc878e
Improve submodule checkout logic to fallback to main if branch not found (#13402) 2025-07-15 11:45:07 +05:30
Adish M
09b2f89cf8
fix git issue cloud server dockerifle (#13299) 2025-07-09 23:41:59 +05:30
Adish M
19eab65c40 Add the fallback and ai path changes to cloud dockerfile 2025-07-09 18:54:59 +05:30
Adish M
f9f37804b5 adding condition to fallback to main if submodule branch is not found 2025-07-09 18:27:43 +05:30
Adish M
90a28e6ea0 changing it back to main 2025-07-09 18:24:29 +05:30
Adish M
f7f7ec4702 hardcoding main branch 2025-07-09 17:56:20 +05:30
Adish M
e96da4597a Update new ai assest path in dockerfile 2025-07-09 17:38:58 +05:30
Adish M
8695c63af7
Enhance Neo4j configuration and installation in Try tooljet Dockerfiles with APOC plugin support (#13248)
* Enhance Neo4j configuration and installation in Try tooljet Dockerfiles with APOC plugin support

* fix: Update Dockerfile to use the latest ToolJet image version
2025-07-08 13:09:41 +05:30
Adish M
317f1e913f
fix: Update path for server keys in Dockerfile (#13184) 2025-07-03 20:58:10 +05:30
Adish M
b8aceb2e7a
fix: Update server installation steps in Dockerfile for consistency (#13183) 2025-07-03 20:49:15 +05:30
Adish M
890161738e
refactor: streamline workflow worker setup and command determination (#13152)
* refactor: streamline workflow worker setup and command determination

* consolidate plugin build and prune commands in Dockerfile
2025-07-02 17:35:53 +05:30
Adish M
abae4dc009
feat: update Dockerfiles and entrypoint for PostgreSQL and Temporal integration (#13144)
* feat: update Dockerfiles and entrypoint for PostgreSQL and Temporal integration

* fix: update Docker image tags for ee-latest versioning

* fix: remove default Dockerfile path and update tag generation logic

* fix: remove unnecessary newline in manual Docker build workflow

* fix: remove duplicate TOOLJET_EDITION environment variable declaration

* fix: update PostgreSQL source list for compatibility and enhance entrypoint script for improved logging and error handling

* update PostgreSQL source list to use bookworm for compatibility
2025-07-02 12:35:22 +05:30
Midhun G S
90e7c4cab9
Cloud licensing related changes (#13033)
* added all pending cloud migration

* restrict cloud migrations

* added cloud data-migrations

* Added cloud entities

* keep tables across all

* cloud licensing initial changes

* fix

* payments module

* license counts updates

* update

* Added all pending cloud migration to pre-release + Payments module (#13006)

* added all pending cloud migration

* restrict cloud migrations

* added cloud data-migrations

* Added cloud entities

* keep tables across all

* payments module

* license counts updates

* update

* migration fixes

* pass orgId

* movement

* added cloud instance settings

* org id to license terms

* before merge

* dockerfile changes for cloud

* migration fixes

* subscription

* merge main

* posthog-js package

* fix

* selhostcustomer migration timestamp update

* fix

* fixes

* fix

* fix

* Adding cloud dockerfile changes

* migration fix

* fix

* fix

* fix

* fixes

* added migration progress

* fix

* added migration files for cloud

* fix

* added migrations for cloud

* add organizationId for pages controller

* fixes for plugins script

* fix

* final

* added cloud licensing envs

* UI WRAPPER BUG

* fix

* orgId groups fix

* lint check fixes

* Refactor Dockerfiles to use dynamic branch names for builds

* Feature/promote release permission management (#13020)

* migration and entity changes

* removed extra migration

* added default group permissions

* basic ui changes

* added promote and release permissions

* fixed tooltips for promote and release buttons

* fix

* fixed app promote ability check

* ce compatibility ui change

* ui fixes

* removed console.log

* removed comments

* updated ee-preview.Dockerile

* using base img node:22.15.1-bullseye

* fix for ce render

* Update ce-preview.Dockerfile

* Update ee-preview.Dockerfile

* ui fix

* fix

* fixes

* fixes

* fixes

* fixes

* minor fixes

* fix

---------

Co-authored-by: Souvik <psouvik260@gmail.com>
Co-authored-by: Adish M <44204658+adishM98@users.noreply.github.com>

* Bugfix/git sync pre release (#13098)

* bugfixes

* ui fixes for disabled states in version creation

* minor fixes

* removed unused imports

* fixes

* removed comments

* module file fixes

* module fixes

* white-labelling fixes

* login-configs

* fix for migration for ce

* Fix for app count guard (#13131)

* fix for app count guard

* added check

* for debug

* license key

* Modules : Platform Functionality  (#12994)

* init

* mod

* app import-export

* licensing and UI

* review and permissions

* update

* updates

* update

* update

* fix breadcrumb

* fix app builder error

* remove launch button for modules

* fixed homepage

* fix permission check

---------

Co-authored-by: platform-ops123 <platformops545@gmail.com>
Co-authored-by: gsmithun4 <gsmithun4@gmail.com>

* reverted logs

* tjdb guard and dark mode (#13137)

* ui fixes

* added modules module

* removed unused imports

* fix

* fix

* Cypress fix

* fixes for cloud instance level licensing (#13146)

---------

Co-authored-by: platform-ops123 <platformops545@gmail.com>
Co-authored-by: Rudra deep Biswas <rudra21ultra@gmail.com>
Co-authored-by: Adish M <adish.madhu@gmail.com>
Co-authored-by: Rudhra Deep Biswas <98055396+rudeUltra@users.noreply.github.com>
Co-authored-by: Vijaykant Yadav <vjy239@gmail.com>
Co-authored-by: Rohan Lahori <64496391+rohanlahori@users.noreply.github.com>
Co-authored-by: Souvik <psouvik260@gmail.com>
Co-authored-by: Adish M <44204658+adishM98@users.noreply.github.com>
Co-authored-by: rohanlahori <rohanlahori99@gmail.com>
Co-authored-by: ajith-k-v <ajith.jaban@gmail.com>
2025-07-02 10:57:36 +05:30
Adish M
356cab0035
Update Dockerfile to use dynamic branch name for checkout (#13126) 2025-06-30 20:35:12 +05:30
Adish M
9ba1ca375e
Update Dockerfile to checkout specific branch and separate server build commands (#13124) 2025-06-30 20:25:24 +05:30
Adish M
817c371f17
Refactor Dockerfile for improved build efficiency and dependency management (#13110)
* Refactor Dockerfile for improved build efficiency and dependency management

* Update Dockerfile to include copyfiles installation and correct key path

* Enhance Dockerfile and entrypoint script for improved setup and functionality

- Install grpcurl in the Dockerfile and entrypoint script if not already present
- Add installation steps for Temporal Server and UI Server binaries
- Register Temporal namespace if it doesn't exist
- Update environment variables for Temporal configuration

* Update Dockerfile to use dynamic branch name for checkout

* Update Dockerfile to set BRANCH_NAME as a build argument

* Fix Dockerfile to correct unzip command for Oracle Instant Client zip file
2025-06-30 19:38:44 +05:30
Adish M
d2b8220ab5
fix node version in the preview dockerfile (#13043)
* fix node version in the preview dockerfile

* extra whitespace
2025-06-18 22:30:22 +05:30
Midhun G S
175345479a
Node upgrade 18->22 (#12836)
* node upgrade initial commit

* Removed node-saas and added saas. Fixed the CSS warnings from saas

* add node version 22 to dockerfile and AMI setup script

* change the base image to debian 12

* Update the node version (#12860)

* correction in builder image

* Update ce-production.Dockerfile

* upgrade node to 22.15.1

* server package lock

* package upgrade

* package upgrade

* base directory package upgrade

* revert sentry package upgrade

* fix

* added copy files

* fix dockerfile for copywrite package issue

* removed copy files package

* fix dockerfile for copywrite package issue

---------

Co-authored-by: Kavin Venkatachalam <kavin.saratha@gmail.com>
Co-authored-by: Adish M <adish.madhu@gmail.com>
Co-authored-by: Ajith KV <ajith.jaban@gmail.com>
Co-authored-by: Adish M <44204658+adishM98@users.noreply.github.com>
Co-authored-by: Muhsin Shah C P <muhsinshah21@gmail.com>
2025-06-17 13:01:46 +05:30
Adish M
52191c9625
Adding dockerfile change for cloud and ee file (#12987)
* Adding dockerfile change for cloud and ee file

* fix EOF
2025-06-05 17:25:35 +05:30
Adish M
c7b8981c55
Fix ce render pr app (#12867) 2025-05-14 10:55:28 +05:30
Adish M
6d7733c9da
testing EE PR preview app (#12851)
* testing PR app on render preview

* fix volume issue on ee pr app

* fix postgresql.conf issue

* fix postgresql.conf issue

* fix postgresql.conf issue (#12856)
2025-05-12 16:16:51 +05:30
Adish M
648cc2c247
Adding volume for render PR app (#12795)
* Adding volume for render PR app

* correction mountPath

* dummy PR for testing

* correction in mount path

* correction in mount path

* correction disk size

* correction disk size

* correction disk size

* correction disk size

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue

* postgres starting issue and volume issue fixed

* fix postgresql start up issue in ee edition

* fix postgresql start up in ee edition

* fix postgresql start up in ee edition

* fix postgresql start up in ee edition

* fix postgresql start up in ee edition

* fix postgresql start up in ee edition

* fix postgresql start up in ee edition

* clean up

* clean up

* fix EOF

* changed the instance spec for ee edition
2025-05-08 01:37:20 +05:30
Adish M
c16c6dc84e clean up entrypoint.sh 2025-04-29 09:47:06 +05:30
Adish M
f696d15355 remove redis ce-preview dockerfile 2025-04-29 09:45:00 +05:30
Adish M
c60e75a067 adding dockerfile and boot.sh file change for postgresql 2025-04-29 07:57:51 +05:30