ToolJet/server/src
namanmathur372 ad23daeca1
Integrate Pinecone Plugin with Core Operations for Advanced Vector Management (#11188)
* Initialize ToolJet plugin with default files and installed dependencies

Created the folder structure and default files for the pinecone plugin
the server/src/assets/marketplace/plugins.json file also got updated automatically and added an entry for the Pinecone plugin.
Installed the specified versions of @grpc/grpc-js@^1.12.0 and @pinecone-database/pinecone@^3.0.3 packages into the project.

* Update Pinecone plugin manifest with API key authentication

Updated Pinecone plugin manifest to include API key authentication as an encrypted string.
Added API key field with description and help text for generating the key via the Pinecone Console.
Marked apiKey as a required field in the schema.

* Enhance Pinecone operations.json with vector management options

Amended operations.json to support various vector management operations for the Pinecone plugin.
Added new fields for index, operation, and specific properties for operations like get_index_stats, list_vector_ids, fetch_vectors, upsert_vectors, update_vector, and delete_vectors.
Introduced support for vector ID management, metadata, namespace, and filter options in JSON format.
Updated the schema type from api to database to better reflect the plugin's functionality.

* Add query operations and enhance types for Pinecone plugin

Created query_operations.ts to handle Pinecone operations: getIndexStats, listVectorIds, fetchVectors, upsertVectors, updateVector, and deleteVectors.
Added error handling, namespace support, and consolidated vector deletion logic.
Updated types.ts with detailed SourceOptions and QueryOptions, including fields like index, ids, vectors, and pagination.
Introduced types for Vector, SparseValues, and an enum for available operations, ensuring type safety.
Functions for getIndexStats and listVectorIds work correctly, but other operations are not functioning as expected.

* Implement Pinecone service with query operations and connection handling

Updated index.ts with PineconeService to handle operations: getIndexStats, listVectorIds, fetchVectors, upsertVectors, updateVector, and deleteVectors.
Added connection testing and API key handling functions.
Error handling for invalid operations included.
Only getIndexStats and listVectorIds are working correctly; other operations need debugging.

* Fix operations and add query vector operation

* Update placeholders for boolean fields

Set placeholders for delete_all, include_values, and include_metadata to indicate "true (false by default)" for clearer defaults.

---------

Co-authored-by: parthy007 <parthadhikari1812@gmail.com>
2024-11-08 11:35:07 +05:30
..
assets Integrate Pinecone Plugin with Core Operations for Advanced Vector Management (#11188) 2024-11-08 11:35:07 +05:30
controllers Updated workspace signup flow & fixes (#9893) 2024-06-18 15:09:54 +05:30
decorators [Enhancement] Improve Workspace Invitation Flow (#8873) 2024-02-22 15:09:11 +05:30
dto Updated workspace signup flow & fixes (#9893) 2024-06-18 15:09:54 +05:30
entities Updated workspace signup flow & fixes (#9893) 2024-06-18 15:09:54 +05:30
events [chore] Node-module vulnerabilities (#8226) 2023-12-21 11:55:35 +05:30
filters Shortcut keys for all drawers (#9791) 2024-06-03 21:06:55 +05:30
helpers Updated workspace signup flow & fixes (#9893) 2024-06-18 15:09:54 +05:30
interceptors [feature] Make workspace urls more readable (#6698) 2023-10-18 13:00:17 +05:30
mails Fixed: Sign in CTA, Expired Link back button, invite user email content 2024-05-02 00:31:14 +05:30
middlewares [Improvement] URLs scoped with workspace id (#5487) 2023-04-06 16:42:58 +05:30
models [Improvement] URLs scoped with workspace id (#5487) 2023-04-06 16:42:58 +05:30
modules Chore: Setup Polly.js for recordable stubs on TJDB specs (#10275) 2024-07-16 20:46:49 +05:30
repositories Feature/multi page applications (Task ID - CU-2h1bfvw) (#4729) 2022-12-08 17:51:09 +05:30
schedulers Release Platform v17 (v2.39.0) (#9502) 2024-04-30 21:49:37 +05:30
services Chore: Setup Polly.js for recordable stubs on TJDB specs (#10275) 2024-07-16 20:46:49 +05:30
app.module.ts Hotfix: TJDB connection on feature disabled flag (#9579) 2024-05-01 23:24:50 +05:30
main.ts add gstatic to CSP whitelist (#9858) 2024-05-24 16:27:30 +05:30