* fix: update workflow query endpoint to use correct URL
* chore: update subproject commits for frontend and server
* fix: add request parameter to triggerWorkflow method in controller and interface
* feat: implement workflow query validation guard and add static data source retrieval method
* chore: update subproject commits for frontend and server
* refactor: remove ValidateWorkflowQuerySourceGuard as part of code cleanup
* fix: correct data_source_id property assignment in createWorkflowQuery function
* fix: update endpoint for createWorkflowQuery to use correct URL for workflow nodes
* fix deps
* Modularisation changes for Build with AI feature
* New app loading UI for Build with AI feature & added animation for chat messages
* Fix Error using AI feature
* add missing services and logic
* fix app gen
* update submodules
* EE frontend submodule updated
* update submodules
* EE frontend submodule updated post sync
* Added Artifact Preview component to ee moddules list
* Updated ai slice code
* app gen changes
* Resolved fix with AI bugs
* Resolved AI Copilot bugs
* app gen changes and query fixes
* fix query generation bugs
* update copilot
* Resolved ChatMode dropdown & popover bug fix
* Resolved PR suggestions & PreviewBox component in CE edition
* Synced frontend/ee with main
* Synced server/ee with main branch
* Enhance submodule checkout process to handle branch existence and fallback to main (#13218)
* Enhance submodule checkout process to handle branch existence and fallback to main
* Improve submodule checkout process to handle branch validation and fallback to main
* chore: Comment out Node.js setup, dependency installation, and build steps in cloud frontend workflow
* refactor: Enhance submodule checkout process to include submodule name in logs
* Update submodule checkout process to use the correct submodule name extraction method
* fix: Update submodule checkout script to use correct submodule path variable
* Improve submodule checkout process to correctly handle branch names and fallback to main
* chore: Uncomment Node.js setup, dependency installation, and build steps in cloud frontend workflow
* fix: Update branch checkout logic to use correct syntax and improve fallback handling
* fix: Update git checkout command to use -B flag for branch creation
* fix: Improve submodule checkout process to explicitly fetch branch ref before checkout
* fix: Enhance submodule checkout process with improved branch validation and error handling
* fix: Improve branch checkout logic by enhancing fetch command and validating branch existence
* fix: Enhance manual Git checkout process with improved fetch and error handling
* fix: Restore Node.js setup, dependency installation, and Netlify deployment steps in workflow
* 🔄 chore: update submodules to latest main after auto-merge
* Took sync of fix/appbuilder-02 in frontend/ee
---------
Co-authored-by: Kartik Gupta <gupta.kartik18kg@gmail.com>
Co-authored-by: Adish M <44204658+adishM98@users.noreply.github.com>
Co-authored-by: adishM98 Bot <adish.madhu@gmail.com>
* Added controller and service for fetching logs and nodes seperately
* Add inifinte scroll pagination for workflow logs
* Fix "All Nodes" not renderd on Nodes column
* Fix reducer to append logs on Logs column
* Fix: incorrect code placement
* Fix reducer to append logs on Nodes column
* Prepend execution log on workflow run
* Fix node ordering
* Decouple logs panel from workflow editor
* Update execution nodes when log panel is opened
* Reset log selection on workflow run
* Added 'updatePreviewState' function
* Update ee-server submodule reference
Migrate hotfix for workflow blockers including:
- Feature: Ability to call workflow within a workflow
- Feature: Preview query node with other previewed node results
- Fix: startTrigger input accepts string values instead of code/JSON
Frontend changes:
- Add workflow-in-workflow support in FlowBuilder and QueryNodeConfiguration
- Enhance query node preview with upstream node state management
- Implement preview state cleanup with deleteNodePreviewState calls
- Replace TestParameter input with CodeHinter for better JSON editing
- Add workflow node type support and error styling
- Update WorkflowEditor components for nested workflow handling
Backend changes:
- Update workflow execution controller to handle state parameter
- Enhance PreviewWorkflowNodeDto with optional state field
- Modify workflow services for state-aware query execution
- Update triggers listener and webhooks service
Migration follows composition pattern for frontend EE modules and
inheritance pattern for backend services.
Co-authored-by: Akshay Sasidharan <akshaysasidrn@tooljet.com>
Co-authored-by: Shah <shah21@tooljet.com>
Co-authored-by: Devanshu <devanshu052000@tooljet.com>
What's changed?
🚀 Features
Feature: Configurable workflow execution in #3663 by @akshaysasidrn
Feature: Duplicate the workflow node in #3616 by @manishkushare
🛠️ Fixes
Fix: Resolve workspace constants and secrets in workflow context in #3659 by @akshaysasidrn
Overview
This PR implements real-time workflow execution monitoring using Server-Sent Events (SSE) as part of our LTS feature support. The implementation allows for tracking long-running workflows without requiring deployment changes.
Technical Changes
1. Server Components
Added WorkflowStreamService to manage persistent SSE streams with automatic cleanup
Implemented @sse endpoint in WorkflowExecutionsController for streaming status updates
Created WorkflowTriggersListener to emit workflow execution events with EventEmitter2
Added workflow execution status constants to identify different states in the execution lifecycle
2. Client-side Components
Implemented AsyncQueryHandler to manage SSE connections and parse event streams
Enhanced queryPanelSlice with methods to create async handlers and trigger workflows
Added support for non-blocking workflow execution with real-time status updates
3. Workflow Integration
Modified workflow triggering to use the SSE-based monitoring approach
Maintained same-server architecture to avoid deployment changes
Added automatic reconnection handling and error recovery for client connections
Architecture Decisions
Selected Same Server Approach: Chose to implement workflows within the same HTTP server to maintain the existing deployment setup for LTS users
Real-time Updates with SSE: Leveraged Server-Sent Events for their simplicity, efficiency, and compatibility with existing infrastructure
Future Extension Path: Implementation can be extended to Worker Threads or Microservice architecture later if needed
