Overview
This PR implements real-time workflow execution monitoring using Server-Sent Events (SSE) as part of our LTS feature support. The implementation allows for tracking long-running workflows without requiring deployment changes.
Technical Changes
1. Server Components
Added WorkflowStreamService to manage persistent SSE streams with automatic cleanup
Implemented @sse endpoint in WorkflowExecutionsController for streaming status updates
Created WorkflowTriggersListener to emit workflow execution events with EventEmitter2
Added workflow execution status constants to identify different states in the execution lifecycle
2. Client-side Components
Implemented AsyncQueryHandler to manage SSE connections and parse event streams
Enhanced queryPanelSlice with methods to create async handlers and trigger workflows
Added support for non-blocking workflow execution with real-time status updates
3. Workflow Integration
Modified workflow triggering to use the SSE-based monitoring approach
Maintained same-server architecture to avoid deployment changes
Added automatic reconnection handling and error recovery for client connections
Architecture Decisions
Selected Same Server Approach: Chose to implement workflows within the same HTTP server to maintain the existing deployment setup for LTS users
Real-time Updates with SSE: Leveraged Server-Sent Events for their simplicity, efficiency, and compatibility with existing infrastructure
Future Extension Path: Implementation can be extended to Worker Threads or Microservice architecture later if needed
* Added set-default API
* Setting default workspace for super-admin onboarding
* Seperated the migrations
* Added nestjs init
* removed nestjs init
* Added: default workspace case to signup
* Fixed: instance signup
* Fixed: existed non-active user instance signup
* Added: SSO default workspace support
* Added: Default workspace chooser
* Moved some scss changes to ee folder
* Added: disable workspace default organization check
* updated the migration
* Fixing .env issue
* Removed the logs
* Remove personal workspace check from enable signup
* Fixing sign-in cases
* Fixing workspace invited user's instance signup cases
* Fixing sso workspace invited user's instance signup cases
* fixing the workspace signup issue
* Adding ee server and frontend file
* Adding ee server and frontend file
* Adding active check
* Added query fix for the migration
* Added migration logic fix
* Removed/Commented the ENABLE_ONBOARDING_QUESTIONS_FOR_ALL_SIGN_UPS env support from EE and CE
* Adding server and frontend files
* Added frontend file
* Bump version
* [white-labelling] Logo related pending issues (#12243)
* Working on refactoring and fixing white-labelling for modularisation
* Working on fixes
* Fixed: app builder logo issue
* Refactored default state behaviour
* Removed console logs
* Added workspace slug
* Adding single image changes from ee lts (#12272) (#12285)
Co-authored-by: Adish M <44204658+adishM98@users.noreply.github.com>
* Moving Vulnerability CI from EE (#12288)
* CE modularisation bugs (#12278)
* Working on refactoring and fixing white-labelling for modularisation
* Working on fixes
* Fixed: app builder logo issue
* Refactored default state behaviour
* Removed console logs
* Added workspace slug
* Fixed: Able to update group name with space
* Adding single image changes from ee lts (#12272)
* Fixed: Able to add a user 2 times to the group
* Fixed: Builder isn't able to datasiurces
* Fixed: updated the builder check
* Refactored the changes
---------
Co-authored-by: Adish M <44204658+adishM98@users.noreply.github.com>
* Add data-cy for components in modularisation branch (#12296)
* [modularisation-bugs] Fixing rest of the priority bugs (#12301)
* Fixed: custom logout url issue
* Fixed: fixed all workspace redirection issue
* Fixed: made the datsource access same for ce and ee-basicplan builders
* Fixed: sample db connection issue
* Fixed: sample database query issue
* Fixed: page isn't showing the organization list for user whose current organization is archived
* Fixed: granular permission datasource page
* remove license check for oidc login
---------
Co-authored-by: Muhsin Shah C P <muhsinshah21@gmail.com>
Co-authored-by: Adish M <44204658+adishM98@users.noreply.github.com>
Co-authored-by: Ajith KV <ajith.jaban@gmail.com>
Co-authored-by: Anantshree Chandola <anantshreechandola23@gmail.com>
* Added modules folder to the source code
* Added some changes to the APIs and removing unwanted files
* fixed: slug and padding issue
* Fixed invitations page issue
* cleaning up and modularising the store code
* Refactoring the SSOAuthModule
* Onboarding bug fixes (#2072)
* Added the enter event hook
* Added link to the header icon
* removed the pointer from the parent class and added to the child
* reset password button fixes and minor type fixes
* fixed validations for password
* handled reset password scenarios (might need some refactoring)
* modified email component to take custom placeholders
* fixed css error in submig button in disabled state
* added handle submit in the setup page
* added seprate component for resend email button to prevent re-rendering of component
* Added clearPageHistory
* Added forgot password create account CTA issue
* Added css fix for the page scroll issue
* review changes
* removed duplicate component
* fixed the placeholder issue
* Added consultation banner fix
* overlapping of email success info page and dark theme fixes
* Added maxWidth to the toast
* minor css fix
* white labelling changes
* fixed: black dot issue
* Added dark-theme fix for the submit-btn
* fixed margin related issue for mozilla firefox
* added seprator component and minor css fix
* css fixes for password success info screen
* css fix
---------
Co-authored-by: rohanlahori <rohanlahori99@gmail.com>
* refactoring the server side code
* removed onboarding status
* Added pr changes
---------
Co-authored-by: rohanlahori <rohanlahori99@gmail.com>
* Added a fix for the blank page of the app url if the user is redirected from the invitation page
* Added workspace signup changes
* fix: could able to access sso only enabled workspace if switch b/w workspace after the flow completed
* fix: Getting something went wrong error when personal workspace is disabled
* Fix: logging with super-admin creds while ongoing session of another user making issue for a workspace switch
* fix: Resend workspace signup email is not working
* Added new changes to the resend-invite API
* Updating the source to invite while unarchiving the user
* Added forgot password fix (#447)
* Fixed import errors
* fixed invite flow sso error fallBack flow
---------
Co-authored-by: Midhun G S <gsmithun4@gmail.com>
* add ability to run TJDB queries from public apps
* make TJDB query run similar to other datasources
* add result key for backward compatibility
* throw query error on postgrest request failures
