Commit graph

347 commits

Author SHA1 Message Date
parthy007
d1f62405a4 fix: configure body correctly for token call
fix: add hubspot in querymanager auth flow
2025-10-23 15:44:51 +05:30
Parth
249d7a1135
Feature: Validate and save datasource OAuth creds in multi-tenant mode (#14043)
* fix: change schema to hide save button & add default value

* enhance: Show connect button in UI at data-config

* fix: extract source_options correctly

enhance: add userID in cache logic for snowflake

* enhance: add backend logic to save tokens correctly

fix: change IDataSourcesUtilService interface

* fix: add read docs button for oauth plugins

fix: shrink the connect button

* fix: remove extra code and fix comments

* fix: generate cache key correctly
2025-10-22 17:19:46 +05:30
Parth
03505b0174
fix: token headers & client-auth dropdown (#14082) 2025-10-22 15:19:20 +05:30
Ganesh Kumar
ac5a65179d Merge branch 'lts-3.16' into release-lts/marketplace-sprint-13 2025-10-22 14:12:14 +05:30
Priyansh Rai
beb8bcfc65
Fix: Capitalisation inconsistencies in labels (#14174)
* fixed capitalization issue

Signed-off-by: thesynthax <kushagra1403@gmail.com>

* updated changes

Signed-off-by: thesynthax <kushagra1403@gmail.com>

* fix: standardize label casing and formatting in plugin manifests

* fix: standardize label casing in plugin manifests

---------

Signed-off-by: thesynthax <kushagra1403@gmail.com>
Co-authored-by: thesynthax <kushagra1403@gmail.com>
2025-10-22 13:59:18 +05:30
Ajith KV
7d28810652
Add cypress test cases for enterprise user groups and permissions (#14340)
* Add cypress test cases for enterprise user groups and permissions

* update constants

* update user groups test cases

* update spec

* update groups cases

* update lock.json

* update custom group cases

* update docker file

* update first user onboarding and platform commands

* add case for UI  promote and release permission
2025-10-17 12:38:44 +05:30
Pratush Sinha
e8f51f91cd
Fix: Error handling in Elastic Search test connection (#14308)
* error Handeling in Elastic Search Test Connection

* added requestTimeout
2025-10-13 16:23:58 +05:30
Parth
2db7909a7c
fix: decode the base64 string (#14138) 2025-10-10 13:21:47 +05:30
Ganesh Kumar
35a343d813
Hotfix: MariaDB datasource connection handling (#14277)
* Mariadb graceful connection handling

* fixed review comments
2025-10-08 14:37:43 +05:30
Ganesh Kumar
0f00162fcc
Feat: Support for service account authentication in google sheet datasource (#14209)
* working on google sheet service account flow

* service account flow logic added

* for service account flow skip the Oauth error flow

* added datamigration to backfill the authentication option for GoogleSheets
2025-10-08 14:34:05 +05:30
Ganesh Kumar
69bb50ad48
Feature : AWS Default Credential Provider Chain as an authentication option in AWS S3 datasource (#14171)
* added default credential chain flow

* Bump version to 3.20.5-lts across all components and add tag-and-push script for releases

---------

Co-authored-by: gsmithun4 <gsmithun4@gmail.com>
2025-09-26 20:48:25 +05:30
Parth
9167b950ae
Fix: Snowflake input rendering (ClientId & Client-secret) in cloud & OAuth plugin failure due to undefined environmentId (#14167)
* fix: use selectedEnvironment instead of currentAppEnvironmentId

* fix: clientid and secret rendering
2025-09-26 20:45:13 +05:30
Akshay
ca2e70de82
Fix: gRPC reflection client and adds fuzzy search for gRPC service (#14067)
* refactor: use service descriptor retrieval and pass callOptions

* refactor: remove redundant comments

* refactor:  use sdk methods to get appropriate proto definition on reflection

* fix: changes not save immediately

* fix: improve loading state handling in GRPCv2 component

* feat: add filesystem support for loading proto files

* feat: implement fuzzy search and debounce functionality
2025-09-26 20:30:02 +05:30
gsmithun4
f40be5b1b5 feat(logging): integrate transaction logging across various guards and services
- Updated `AbilityGuard` to utilize `TransactionLogger` for logging execution time and errors.
- Enhanced `ResponseInterceptor` to include transaction metadata in logs.
- Modified `QueryAuthGuard`, `ValidateQueryAppGuard`, and `ValidateQuerySourceGuard` to log completion times and transaction IDs.
- Introduced `TransactionLogger` service for structured logging with transaction context.
- Added transaction ID and route information to request context in `RequestContextMiddleware`.
- Updated `JwtStrategy` to log validation completion times.
- Refactored logging configuration in `AppModuleLoader` to support pretty printing in non-production environments.
- Removed console logs in favor of structured logging for better traceability.
2025-09-19 02:08:49 +05:30
Akshay Sasidharan
88fa169af8 refactor: make code more strict in typing 2025-09-12 14:23:19 +05:30
Akshay Sasidharan
d44f755df9 refactor: revise function names for clarity 2025-09-12 11:26:29 +05:30
Akshay Sasidharan
1026593b40 fix: send metadata not in call options 2025-09-12 02:18:15 +05:30
Ganesh Kumar
abf26d6439 Merge branch 'release-lts/marketplace-plugin-set6' of https://github.com/tooljet/tooljet into release-lts/marketplace-plugin-set6 2025-09-10 13:54:26 +05:30
Ganesh Kumar
2e069f5af8 Merge branch 'lts-3.16' into release-lts/marketplace-plugin-set6 2025-09-10 13:54:02 +05:30
Akshay Sasidharan
e234c5a66f refactor: remove deadcode 2025-09-09 12:19:37 +05:30
Akshay
186d9db5f5
Apply suggestion from @Copilot
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-09-08 23:37:12 +05:30
Akshay Sasidharan
3d61aad3e9 refactor: simplify non-TLS execution by consolidating metadata handling 2025-09-08 23:16:03 +05:30
Akshay Sasidharan
37a308c9a7 refactor: streamline gRPC call execution and metadata handling 2025-09-08 23:07:40 +05:30
Akshay Sasidharan
e61b90ac64 fix: remove lowercase conversion 2025-09-08 20:35:58 +05:30
Akshay Sasidharan
509afde5e5 refactor: enhance gRPC call handling with unified call options for metadata 2025-09-08 19:43:37 +05:30
Priyansh Rai
96cc85943b
fix: correct placeholder and description text in postgresql, notion, and mssql plugins operations schemas (#13643) 2025-09-08 15:01:10 +05:30
Priyansh Rai
ea656b422f
fix(cosmosdb): add partition key placeholder in cosmosdb operations (#13642) 2025-09-08 14:51:37 +05:30
Ganesh Kumar
ba71d2fe99 Merge branch 'lts-3.16' into release-lts/marketplace-plugin-set6 2025-09-08 12:32:48 +05:30
Priyansh Rai
94e4a13043
Feat: Add Gmail plugin (#13843)
* ee commit

* merge commit

* feat: updated openapi operation component

* updated query operation sepctype

* fix: updated query dropdown style

* feat: config dropdown update

* feat: add Gmail plugin with API integration and initial setup

* refactor: enhance type definitions

* refactor: clean up code and refactor variable names

* fix: update Gmail OAuth scope to allow full access to Gmail

* feat: standardize error handling for Gmail plugin

* fix: include oauth_type handling in Gmail plugin for cloud environment

* fix: update spec_url for Gmail operations

* refactor: remove unused fields in gmail manifest.json

* fix: update Content-Type header to application/x-www-form-urlencoded for token requests

* feat: add environment variable prefix for Gmail in OAuth handling

* fix: remove encryption requirement for client_id in Gmail manifest

* fix: update Gmail plugin to use form data for token requests and simplify response handling

* fix: add Gmail to OAuth data sources in DataSourceManager

* fix: encode path parameters in Gmail plugin URL construction

* fix: add back margin to Client ID label in CommonOAuthFields component

* fix: adjust width of input field in RenderParameterFields for better alignment

* fix: set response type to 'json' in requestOptions for Gmail service

---------

Co-authored-by: Devanshu Gupta <devanshuguptaknp@gmail.com>
2025-09-08 12:20:32 +05:30
Akshay Sasidharan
31a9749a66 fix: gRPC credentials flow 2025-09-02 22:48:42 +05:30
Ganesh Kumar
d7dd384d37 info 2025-09-01 13:51:13 +05:30
Ganesh Kumar
0936a97217 grpcv2 now added metadata to list services and methods 2025-09-01 13:48:29 +05:30
Ganesh Kumar
6e4b0c9db5
stringified array and object in url params (#13784) 2025-08-29 16:52:27 +05:30
Parth
118188cb9e
Enhance: Abstract common OAuth component for OpenApi (#13809)
* refactor: Abstract common oauth component for openapi

* chore: comment out redis-server startup in preview script

* fix: update PostgreSQL version from 16 to 13 in Dockerfile

* fix: update PostgreSQL directory paths from version 16 to 13 in Dockerfile

* fix: edit button on encrypted fields

* fix: conditionally render dropdowns

* fix: Change helpertext for redirect uri in oauthwrapper

* fix: query response to display json

* fix: copywriting & optional chaining

* fix: handle client credentials correctly

---------

Co-authored-by: adishM98 Bot <adish.madhu@gmail.com>
2025-08-29 16:51:56 +05:30
Devanshu Gupta
6f572315c1
feat: added hubspot (#13854)
* feat: added hubspot

* fix: updated name

* feat: updated spec url

* fix: added options in manifest

* fix: resolved comments

* fix: added kind

* fix: updated query options check

* fix: kind index
2025-08-21 18:54:05 +05:30
Akshay
ca71355d8e
Feature[LTS]: GRPC Plugin revamp (#13894)
* feat: Add new gRPC v2 plugin

- Enhanced DataSourcesController to support invoking methods on data sources.
- Introduced InvokeDataSourceMethodDto for method invocation requests.
- Added WhitelistPluginGuard to restrict method invocation based on data source kind.
- Updated IDataSourcesController and IDataSourcesService interfaces to include invoke method functionality.
- Implemented invokeMethod in DataSourcesService to handle method calls for gRPC v2.
- Added method whitelisting for gRPC v2 in the service layer.

* refactor: invokeMethod to use method dispatch pattern

* fix: improve error handling in testConnection method

* Apply suggestion from @Copilot

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Apply suggestion from @Copilot

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Apply suggestion from @Copilot

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* refactor: update types and interface

* fix: remove unnecessary border styles for improved UI consistency

* refactor: simplify error handling

- Introduced a new SCSS file for styling the gRPC v2 query editor components.
- Styled request sections, server URL input, dropdown menus, and method buttons for better user experience.

refactor(grpcv2): enhance error handling and type safety

- Updated error handling in gRPC query service to use a new `toError` utility function for consistent error conversion.
- Improved type definitions for gRPC client and service methods to ensure better type safety.
- Refactored method existence validation and gRPC call execution to handle errors more gracefully.

fix(grpcv2): improve service discovery and proto file loading

- Enhanced service discovery logic to handle reflection and proto file clients more robustly.
- Added checks for valid service constructors and improved error messages for better debugging.
- Updated the `loadProtoFromRemoteUrl` function to handle HTTP errors more effectively.

chore(grpcv2): add utility functions for type checks

- Introduced utility functions `isRecord`, `hasProperty`, and `toError` for better type checking and error handling throughout the codebase.

* feat: add LegacyBanner component for gRPC legacy tag display

* fix: styling changes

* fix: correct text in LegacyBanner component

* feat: enhance GRPCv2 component with request handling and state management improvements

* refactor: update metadata handling in GRPCv2 component and service

* refactor: update GRPCv2 component to use raw_message instead of requestData

* fix: Styling issues and labels

* refactor: gRPC test connection checks for proto file and url

* fix: improve error handling in service discovery

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-08-21 16:39:31 +05:30
Parth
61b7902b10
Hotfix: Render OAuth component dropdowns and correct labels (#13808)
* fix: Render OAuth component dropdowns and correct labels

* fix: Hide dropdowns and fix CSS
2025-08-14 17:13:12 +05:30
Devanshu Gupta
cb0a87e1a1
Feat/ms graph pre release (#13581)
* ee commit

* merge commit

* feat: updated openapi operation component

* updated query operation sepctype

* fix: updated query dropdown style

* init plugin

* init plugin

* feat: config dropdown update

* feat: added ms plugin

* fix: plugin connection name

* submodule reference updated

* plugin label updated

* added back margin top class

---------

Co-authored-by: Ganesh Kumar <ganesh8056234@gmail.com>
2025-08-11 18:59:49 +05:30
Ganesh Kumar
b8b0d57504
Fix: ApiEndpointInput component used for rendering OpenAPI spec where values are stored in cache for respective operation. (#13732)
* apiendpoint component used for rendering openapi spec value are persisted

* Fix/stripe old component (#13737)

* fix: integrated old component

* removed log

---------

Co-authored-by: Devanshu Gupta <devanshuguptaknp@gmail.com>
2025-08-08 22:28:57 +05:30
Ganesh Kumar
9ce8ec386a
Fix: Postgresql datasource statement timeout is added to connection string method (#13598) 2025-08-01 19:41:47 +05:30
Ganesh Kumar
321c16b9bd
Hotfix: REST API datasource values given in body section is been skipped (#13576)
* REST API changes from LTS and new changes

* Fix: Response, Request and Metadata coming out to be undefined on query failure and success inside Inspector

---------

Co-authored-by: devanshu052000 <devanshu.rastogi05@gmail.com>
2025-08-01 18:39:33 +05:30
Pratush Sinha
5208167f3d
feat(mongodb): add createCollection operation with options (#13482) 2025-07-25 12:13:05 +05:30
Ganesh Kumar
f46340b477
Enhance: Extract OAuth 2.0 flow for Salesforce & Snowflake (#13529)
* salesforce & snowflake changes added to prerelease

* module import error fixes

* optional parameter for getAuthUrl method
2025-07-23 22:18:50 +05:30
Ganesh Kumar
0eb2440023
Release: Marketplace sprint 12 (#13207)
* Feature: Prometheus plugin (#13161)

* prometheus plugin

* added existing props

* Host and database can be dynamically configured in query builder for PostgreSQL and MySQL data sources (#13163)

* Fix: Postgresql datasource tries to connect via ssl even when ssl toggle is off (#13167)

* The ability to provide a partition key for deleting items in CosmosDB datasource has been enabled (#13166)

* Feature: Ability to configure the database name in Redis datasource (#13165)

* Fix: Avoid setting Content-Type header for requests without body and configure different host for all environments in OpenAPI [PRE-RELEASE] (#13230)

* Send content-type only with body in request

* Persist OpenAPI parameters per operation only

* Configure different host

* Add disable styles to the select input

* Feat: New fields 'client id' and 'client secret' have been introduced in the Slack datasource configuration page in pre-release (#13162)

* Update slack frontend

* Update slack backend to handle custom creds

* Add backfill migrations

* Dynamically change dropdown according to versions

* Change migration file name

* Correctly access scope in chat:write logic

---------

Co-authored-by: Akshay Sasidharan <akshaysasidharan93@gmail.com>
Co-authored-by: Parth <108089718+parthy007@users.noreply.github.com>
Co-authored-by: Akshay <akshaysasidrn@gmail.com>
2025-07-11 12:15:39 +05:30
parthy007
bbf42ddaf6 Merge branch 'release/marketplace-sprint-12' into fix/workspace-constants-mapping 2025-07-04 14:17:25 +05:30
Midhun G S
90e7c4cab9
Cloud licensing related changes (#13033)
* added all pending cloud migration

* restrict cloud migrations

* added cloud data-migrations

* Added cloud entities

* keep tables across all

* cloud licensing initial changes

* fix

* payments module

* license counts updates

* update

* Added all pending cloud migration to pre-release + Payments module (#13006)

* added all pending cloud migration

* restrict cloud migrations

* added cloud data-migrations

* Added cloud entities

* keep tables across all

* payments module

* license counts updates

* update

* migration fixes

* pass orgId

* movement

* added cloud instance settings

* org id to license terms

* before merge

* dockerfile changes for cloud

* migration fixes

* subscription

* merge main

* posthog-js package

* fix

* selhostcustomer migration timestamp update

* fix

* fixes

* fix

* fix

* Adding cloud dockerfile changes

* migration fix

* fix

* fix

* fix

* fixes

* added migration progress

* fix

* added migration files for cloud

* fix

* added migrations for cloud

* add organizationId for pages controller

* fixes for plugins script

* fix

* final

* added cloud licensing envs

* UI WRAPPER BUG

* fix

* orgId groups fix

* lint check fixes

* Refactor Dockerfiles to use dynamic branch names for builds

* Feature/promote release permission management (#13020)

* migration and entity changes

* removed extra migration

* added default group permissions

* basic ui changes

* added promote and release permissions

* fixed tooltips for promote and release buttons

* fix

* fixed app promote ability check

* ce compatibility ui change

* ui fixes

* removed console.log

* removed comments

* updated ee-preview.Dockerile

* using base img node:22.15.1-bullseye

* fix for ce render

* Update ce-preview.Dockerfile

* Update ee-preview.Dockerfile

* ui fix

* fix

* fixes

* fixes

* fixes

* fixes

* minor fixes

* fix

---------

Co-authored-by: Souvik <psouvik260@gmail.com>
Co-authored-by: Adish M <44204658+adishM98@users.noreply.github.com>

* Bugfix/git sync pre release (#13098)

* bugfixes

* ui fixes for disabled states in version creation

* minor fixes

* removed unused imports

* fixes

* removed comments

* module file fixes

* module fixes

* white-labelling fixes

* login-configs

* fix for migration for ce

* Fix for app count guard (#13131)

* fix for app count guard

* added check

* for debug

* license key

* Modules : Platform Functionality  (#12994)

* init

* mod

* app import-export

* licensing and UI

* review and permissions

* update

* updates

* update

* update

* fix breadcrumb

* fix app builder error

* remove launch button for modules

* fixed homepage

* fix permission check

---------

Co-authored-by: platform-ops123 <platformops545@gmail.com>
Co-authored-by: gsmithun4 <gsmithun4@gmail.com>

* reverted logs

* tjdb guard and dark mode (#13137)

* ui fixes

* added modules module

* removed unused imports

* fix

* fix

* Cypress fix

* fixes for cloud instance level licensing (#13146)

---------

Co-authored-by: platform-ops123 <platformops545@gmail.com>
Co-authored-by: Rudra deep Biswas <rudra21ultra@gmail.com>
Co-authored-by: Adish M <adish.madhu@gmail.com>
Co-authored-by: Rudhra Deep Biswas <98055396+rudeUltra@users.noreply.github.com>
Co-authored-by: Vijaykant Yadav <vjy239@gmail.com>
Co-authored-by: Rohan Lahori <64496391+rohanlahori@users.noreply.github.com>
Co-authored-by: Souvik <psouvik260@gmail.com>
Co-authored-by: Adish M <44204658+adishM98@users.noreply.github.com>
Co-authored-by: rohanlahori <rohanlahori99@gmail.com>
Co-authored-by: ajith-k-v <ajith.jaban@gmail.com>
2025-07-02 10:57:36 +05:30
parthy007
956e6b4534 Merge branch 'main' into fix/workspace-constants-mapping 2025-07-01 17:01:08 +05:30
Parth
f6f0b6fa8d
Fix MariaDB saving issue (#12952) 2025-05-29 00:06:11 +05:30
Parth
afb27b8673
Feature: Add Clickup plugin (#12703)
* initialize clickup plugin, add getConnection and testConnection

Signed-off-by: thesynthax <kushagra1403@gmail.com>

* including the openapi yaml

Signed-off-by: thesynthax <kushagra1403@gmail.com>

* trying to attach the openapi spec

Signed-off-by: thesynthax <kushagra1403@gmail.com>

* Fix key casing mismatch

* Update copywriting

* Fix clickup logic

* Filter limited operation request

* Add error standardisation

* Fix asterik symbol position

* Fix copywriting

* Fix wrong URL

* Fix asterisk gapping

* Handle array types

* Update marketplace package-lock.json

* Add the same package-lock as release branch

* chore: update package-lock.json

---------

Signed-off-by: thesynthax <kushagra1403@gmail.com>
Co-authored-by: thesynthax <kushagra1403@gmail.com>
Co-authored-by: Akshay Sasidharan <akshaysasidharan93@gmail.com>
2025-05-27 21:03:15 +05:30
parthy007
fd1d0becf4 Merge branch 'release/marketplace-sprint-11' into fix/workspace-constants-mapping 2025-05-27 16:58:11 +05:30