ToolJet/server
namanmathur372 ad23daeca1
Integrate Pinecone Plugin with Core Operations for Advanced Vector Management (#11188)
* Initialize ToolJet plugin with default files and installed dependencies

Created the folder structure and default files for the pinecone plugin
the server/src/assets/marketplace/plugins.json file also got updated automatically and added an entry for the Pinecone plugin.
Installed the specified versions of @grpc/grpc-js@^1.12.0 and @pinecone-database/pinecone@^3.0.3 packages into the project.

* Update Pinecone plugin manifest with API key authentication

Updated Pinecone plugin manifest to include API key authentication as an encrypted string.
Added API key field with description and help text for generating the key via the Pinecone Console.
Marked apiKey as a required field in the schema.

* Enhance Pinecone operations.json with vector management options

Amended operations.json to support various vector management operations for the Pinecone plugin.
Added new fields for index, operation, and specific properties for operations like get_index_stats, list_vector_ids, fetch_vectors, upsert_vectors, update_vector, and delete_vectors.
Introduced support for vector ID management, metadata, namespace, and filter options in JSON format.
Updated the schema type from api to database to better reflect the plugin's functionality.

* Add query operations and enhance types for Pinecone plugin

Created query_operations.ts to handle Pinecone operations: getIndexStats, listVectorIds, fetchVectors, upsertVectors, updateVector, and deleteVectors.
Added error handling, namespace support, and consolidated vector deletion logic.
Updated types.ts with detailed SourceOptions and QueryOptions, including fields like index, ids, vectors, and pagination.
Introduced types for Vector, SparseValues, and an enum for available operations, ensuring type safety.
Functions for getIndexStats and listVectorIds work correctly, but other operations are not functioning as expected.

* Implement Pinecone service with query operations and connection handling

Updated index.ts with PineconeService to handle operations: getIndexStats, listVectorIds, fetchVectors, upsertVectors, updateVector, and deleteVectors.
Added connection testing and API key handling functions.
Error handling for invalid operations included.
Only getIndexStats and listVectorIds are working correctly; other operations need debugging.

* Fix operations and add query vector operation

* Update placeholders for boolean fields

Set placeholders for delete_all, include_values, and include_metadata to indicate "true (false by default)" for clearer defaults.

---------

Co-authored-by: parthy007 <parthadhikari1812@gmail.com>
2024-11-08 11:35:07 +05:30
..
data-migrations Release: Appbuilder 1.7 (#9875) 2024-05-30 18:12:10 +05:30
ee Updated workspace signup flow & fixes (#9893) 2024-06-18 15:09:54 +05:30
lib fixes: able to import olders apps with no components (#5016) 2022-12-20 12:35:43 +05:30
migrations Updated workspace signup flow & fixes (#9893) 2024-06-18 15:09:54 +05:30
scripts Release Platform v17 (v2.39.0) (#9502) 2024-04-30 21:49:37 +05:30
src Integrate Pinecone Plugin with Core Operations for Advanced Vector Management (#11188) 2024-11-08 11:35:07 +05:30
templates Fix manifests of templates (#9605) 2024-05-03 18:16:41 +05:30
test Chore: Setup Polly.js for recordable stubs on TJDB specs (#10275) 2024-07-16 20:46:49 +05:30
.eslintignore Fix linting errors across the app (#785) 2021-09-21 19:18:28 +05:30
.eslintrc.js Chore: eslint checkup (#5887) 2023-04-10 11:26:23 +05:30
.gitignore Initial commit for nestjs 2021-07-08 11:10:27 +05:30
.node-version Revise node and npm version (#408) 2021-07-19 12:38:44 +05:30
.npmrc specify node and npm version for server (#405) 2021-07-19 08:48:59 +05:30
.version Merge branch 'main' of https://github.com/ToolJet/ToolJet into perf/0.1 2024-06-27 11:41:33 +05:30
data-migration-config.ts lint fixes and sso configs save bug fix (#5425) 2023-01-25 12:50:22 +05:30
entrypoint.sh fix db url parse 2024-01-09 00:17:59 +05:30
jest.config.ts Chore: Setup Polly.js for recordable stubs on TJDB specs (#10275) 2024-07-16 20:46:49 +05:30
nest-cli.json Revamp: user journey emails (#9223) 2024-04-01 18:11:42 +05:30
ormconfig.ts Add query validation for TJDB join (#7854) 2023-11-17 12:18:41 +05:30
package-lock.json Chore: Add jest types dependency (#10419) 2024-07-22 17:29:52 +05:30
package.json Chore: Add jest types dependency (#10419) 2024-07-22 17:29:52 +05:30
README.md Initial commit for nestjs 2021-07-08 11:10:27 +05:30
tsconfig.build.json Chore: Add jest types dependency (#10419) 2024-07-22 17:29:52 +05:30
tsconfig.json Chore: Setup Polly.js for recordable stubs on TJDB specs (#10275) 2024-07-16 20:46:49 +05:30

Nest Logo

A progressive Node.js framework for building efficient and scalable server-side applications.

NPM Version Package License NPM Downloads CircleCI Coverage Discord Backers on Open Collective Sponsors on Open Collective Support us

Description

Nest framework TypeScript starter repository.

Installation

$ npm install

Running the app

# development
$ npm run start

# watch mode
$ npm run start:dev

# production mode
$ npm run start:prod

Test

# unit tests
$ npm run test

# e2e tests
$ npm run test:e2e

# test coverage
$ npm run test:cov

Support

Nest is an MIT-licensed open source project. It can grow thanks to the sponsors and support by the amazing backers. If you'd like to join them, please read more here.

Stay in touch

License

Nest is MIT licensed.