Commit graph

158 commits

Author SHA1 Message Date
Adish M
10cfb5f98d
Enhance Dockerfile with nsjail and Redis setup
Added installation of nsjail for Python sandboxing and updated Redis configuration.
2026-03-05 11:52:19 +05:30
Adish M
d3eed2a8f3 feat: enhance Dockerfile with nsjail and Python runtime setup 2026-02-24 10:55:58 +05:30
Akshay Sasidharan
897f1f1928 fix: update nsjail permissions to setuid for enhanced security 2026-02-10 20:37:52 +05:30
Akshay Sasidharan
d5b672eb49 fix: update capabilities for nsjail to include setuid and setgid 2026-02-10 18:19:09 +05:30
Akshay Sasidharan
7b7741312b fix: add python3-pip to Render preview Dockerfile
The bundle generation service uses pip3 to install Python dependencies
when TOOLJET_WORKFLOW_SANDBOX_BYPASS=true. The runtime image was missing
python3-pip, causing "pip3: not found" errors on Render.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-02-03 15:28:13 +05:30
Akshay Sasidharan
3388644626 Merge branch 'lts-3.16' into feature/wf-python-execution 2026-02-03 13:50:58 +05:30
Adish M
2690478408
Merge pull request #14870 from ToolJet/fix/docker-local
feat: Update Docker configurations and entrypoint script for improved service management and environment setup
2026-01-23 16:59:54 +05:30
Akshay Sasidharan
579d380268 fix(docker): enhance nsjail permissions 2026-01-19 23:33:19 +05:30
Souvik
9fe4042527 Few changes 2026-01-19 23:31:13 +05:30
Adish M
021b284402 fix: update gitsync directory permissions for RedHat/OpenShift UID support 2026-01-19 13:30:54 +05:30
Adish M
b14ec10456 fix: update gitsync directory permissions for RedHat/OpenShift support 2026-01-19 13:04:53 +05:30
Akshay Sasidharan
5e2d18af35 fix(docker): use workflows nsjail config in ee-production
Copy python-execution.cfg from server/ee/workflows/nsjail/ (via builder)
instead of docker/nsjail/ to match ee-preview.Dockerfile and use the
same config source.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-16 18:22:04 +05:30
Akshay Sasidharan
8c08ac656c refactor(docker): move nsjail/Python build to builder stage in ee-preview
- Move nsjail compilation to builder stage (matches ee-production pattern)
- Move Python venv creation to builder stage
- Copy pre-built binaries in final stage instead of building there
- Add runtime deps: libprotobuf23, libnl-route-3-200, python3
- Use chmod 1777 (sticky bit) for /tmp/python-exec
- Remove decorative banner comments

This reduces final image size by excluding build tools (gcc, autoconf, etc.)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-16 18:13:23 +05:30
Adish M
05efcd622f
feat(nsjail): add Python execution configurations (#14816)
* feat(nsjail): add Python execution configurations

* enhance Python security mode detection and configuration

* consolidate Python execution configurations and remove USERNS mode
2026-01-16 13:06:06 +05:30
Adish M
6c9c83821f
Add gitsync directory with proper permissions for RedHat/OpenShift support (#14901) 2026-01-16 11:16:12 +05:30
Akshay Sasidharan
394d89103e feat(docker): add Python/nsjail to LTS preview, revert from pre-release
- Add nsjail build and Python installation to LTS ee-preview Dockerfile
- Include pre-installed packages (numpy, pandas, requests, httpx, pydantic)
- Copy nsjail config for Python sandboxing
- Revert pre-release Dockerfile to original (shipping to LTS first)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-09 13:34:09 +05:30
Akshay Sasidharan
0fa56301a8 feat(docker): enable Python execution on Render preview deployments
- Add Python 3 and nsjail to EE preview Dockerfile
- Pre-install common packages (numpy, pandas, requests, httpx, pydantic)
- Add TOOLJET_WORKFLOW_SANDBOX_BYPASS=true to Render workflow
- Document bypass env var in .env.example

Render doesn't support SYS_ADMIN capability, so nsjail sandboxing won't
work. The bypass env var explicitly opts-in to unsandboxed execution
for cloud platforms with restricted capabilities.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-09 11:25:20 +05:30
Adish M
ea81b62bc2 feat: Update Docker configurations and entrypoint script for improved service management and environment setup 2025-12-24 15:25:52 +05:30
adishM98 Bot
c81e58edee fix EOF 2025-11-24 13:00:52 +05:30
adishM98 Bot
441f9eb8d2 fix: update entrypoint script to use ce-preview.sh for PostgreSQL initialization 2025-11-24 12:58:42 +05:30
adishM98 Bot
7e988c6d7d fix(redis): Reformat RDB snapshot configuration for clarity 2025-11-13 15:41:08 +05:30
adishM98 Bot
c940bcba25 fix(docker): Install Redis from official repository for BullMQ compatibility 2025-11-13 15:04:48 +05:30
Akshay
18b831f783
Refactor: Workflows with BullMQ (#14275)
* refactor(workflows): migrate core modules from Temporal to BullMQ

Update main application modules to support BullMQ-based workflow scheduling:

- Remove Temporal worker bootstrap code from main.ts
- Migrate from @nestjs/bull to @nestjs/bullmq
- Add Bull Board dashboard at /jobs with basic auth
- Register BullMQ queues in WorkflowsModule
- Add IWorkflowScheduler interface for scheduler abstraction
- Create CE stubs for WorkflowSchedulerService and ScheduleBootstrapService
- Remove workflow dependencies from AppsModule (moved to WorkflowsModule)
- Add proper route exclusion for /jobs dashboard
- Support WORKER env var for conditional processor registration

This commit completes the migration from Temporal to BullMQ for workflow
scheduling, enabling simpler deployment and better horizontal scaling.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* chore: remove unused Temporal imports and commented code

Clean up migration artifacts:
- Remove unused imports from main.ts (TOOLJET_EDITIONS, getImportPath, ITemporalService, getTooljetEdition)
- Remove commented TemporalService references from WorkflowsModule
- Remove temporal.service from getProviders path array
- Add missing newlines at EOF for IWorkflowScheduler.ts and schedule-bootstrap.service.ts

This cleanup prepares the codebase for complete Temporal code removal in a future commit.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* build: add BullMQ and Bull Board dependencies

Add required packages for BullMQ-based workflow scheduling:

- @nestjs/bullmq: NestJS integration for BullMQ
- @bull-board/api, @bull-board/express, @bull-board/nestjs: Queue dashboard
- bullmq: Core BullMQ library
- express-basic-auth: Authentication for Bull Board dashboard

Note: @nestjs/bull is kept for backward compatibility during migration.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* chore: remove Temporal service files from CE

Remove deprecated Temporal-based workflow implementation files:
- server/src/modules/workflows/interfaces/ITemporalService.ts
- server/src/modules/workflows/services/temporal.service.ts

These files are replaced by IWorkflowScheduler interface and BullMQ-based
WorkflowSchedulerService implementation.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* feat: add comprehensive Redis configuration support for BullMQ

* refactor: remove Temporal setup and configuration from entrypoint scripts and Dockerfiles (#14294)

* refactor: remove Temporal setup and configuration from entrypoint scripts and Dockerfiles

* feat: integrate Redis support for BullMQ in preview environment

* remove worker execution logic from setup script

* Refactor: Centralise workflow execution through BullMQ (#14321)

* refactor: run all workflows through bullmq

* refactor: update imports

* chore: update subproject commit reference in server/ee

* feat: ablity to cancel workflow

* feat: implement workflow cancellation functionality with Redis support

* feat: add optional timeout parameter to requestCancellation method

* refactor: clean up formatting and add maintenance toggle event emission in AppsService

* feat: ability to cancel multiple inprogress executions

* feat: implement execution state management and display logic

* chore: update submodule commit reference

---------

Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Adish M <44204658+adishM98@users.noreply.github.com>
2025-11-05 17:54:38 +05:30
adishM98 Bot
4c8c5381dd Fix: add rsyslog directory for audit logs with proper permissionsin Dockerfile 2025-10-21 18:00:24 +05:30
adishM98 Bot
f0bd076b0f fix: update plugin build process to use install and separate prune step 2025-09-26 21:42:43 +05:30
adishM98 Bot
30fc0fea6b remove Neo4j installation and configuration from Dockerfiles and entrypoint scripts 2025-09-12 15:54:25 +05:30
adishM98 Bot
c3902da28a fix: add repository URL as build argument and improve branch checkout logic in Dockerfile 2025-09-12 14:45:50 +05:30
Adish M
86dccc69d2
Feat: Implement cloud review app deployment workflow with fork handling and submodule management (#13985) 2025-09-08 11:03:15 +05:30
Adish M
434446df1b
refactor: streamline Neo4j setup and connection validation messages (#13897) 2025-08-21 11:35:26 +05:30
Adish M
3568ff7ff6
fix: downgrade PostgreSQL version from 16 to 13 in Dockerfile (#13859) 2025-08-19 15:57:02 +05:30
Adish M
b10adfee98
Merge pull request #13757 from ToolJet/feat/potgresql-13-16
Update PostgreSQL to 16 and Neo4j versions in Dockerfiles and entrypoint scripts
2025-08-18 16:12:03 +05:30
Adish M
c020056bc7
fix: set group write permissions for frontend build files in dockerfile to support RedHat user assignment (#13845)
* fix: set group write permissions for frontend build files to support RedHat user assignment

* version bump from 3.16.8-lts to 3.16.9-lts

* revert: downgrade version from 3.16.9-lts to 3.16.8-lts across all components
2025-08-18 15:06:40 +05:30
adishM98 Bot
441430cbf4 fix: improve submodule handling in render preview app 2025-08-15 16:44:30 +05:30
Adish M
14b4bab5ed Update PostgreSQL to 16 and Neo4j versions in Dockerfiles and entrypoint scripts 2025-08-11 17:25:15 +05:30
Adish M
5f3ffad6bf
Changing folder for LTS and pre-release (#13666)
* Changing folder for LTS and pre-release

* correction in entrypoint path in pre-release dockerfile

* made change to render PR workflow to pickup the dockerfile according to branch
2025-08-05 12:28:01 +05:30
Adish M
b113015084
Fix: Post release automation corrections (#13662)
* Fix: Post release automation corrections

* automation fix for merging submodules PRs

* remove the extra slack notification in the docker CE release job

* adding the branch fall to cloud dockerfile
2025-08-05 11:07:48 +05:30
Adish M
dc77751ce8
fix: postgresql issue in try tooljet (#13626) 2025-08-03 13:56:01 +05:30
Adish M
eddb8bd414
Fix: Postgresql dependence issue in try tooljet dockerfile (#13624) 2025-08-03 12:44:43 +05:30
Adish M
e18a14738c
remove unnecessary SSH setup for GitHub in Dockerfiles (#13489) 2025-07-18 15:30:36 +05:30
Rohan Lahori
4ae677e30c
Added open ssh client to docker file (EE and Cloud) (#13465)
* added open ssh client to docker file

* added openssh-client to Dockerfiles for SSH support

---------

Co-authored-by: Adish M <adish.madhu@gmail.com>
2025-07-17 13:56:36 +05:30
Adish M
79ac1fe132
feat: install git in Dockerfiles for simplified git commands (#13455) 2025-07-17 00:38:42 +05:30
Adish M
67fa14ad05 Add SSH support for GitHub and install Git in Dockerfile 2025-07-16 21:18:55 +05:30
Adish M
891b8dd181 Add SSH support for GitHub and install Git in Dockerfile 2025-07-16 21:14:52 +05:30
Adish M
a931fc878e
Improve submodule checkout logic to fallback to main if branch not found (#13402) 2025-07-15 11:45:07 +05:30
Adish M
09b2f89cf8
fix git issue cloud server dockerifle (#13299) 2025-07-09 23:41:59 +05:30
Adish M
19eab65c40 Add the fallback and ai path changes to cloud dockerfile 2025-07-09 18:54:59 +05:30
Adish M
f9f37804b5 adding condition to fallback to main if submodule branch is not found 2025-07-09 18:27:43 +05:30
Adish M
90a28e6ea0 changing it back to main 2025-07-09 18:24:29 +05:30
Adish M
f7f7ec4702 hardcoding main branch 2025-07-09 17:56:20 +05:30
Adish M
e96da4597a Update new ai assest path in dockerfile 2025-07-09 17:38:58 +05:30