* Application cannot be installed with None as schedule type
* MINOR: Add / Fix GCS and ADLS - docs, bugs (#15502)
Add GCS and ADLS docs
* Add stack trace while throwing an error to debug (#15522)
* Fix#15533: Fix name & display name for kafka json schema parser (#15534)
* MINOR: postgres add ssl options in yaml (#15538)
* Small change to fix the Glossary TErm Tasks not fetching Owner automatically (#15535)
* remove the DataInsightAlert spec as the alerts test are covered in ObservabilityAlerts spec (#15531)
* MINOR: fix help dropdown item font and icon sizes (#15511)
* fix help dropdown item font and icon sizes
* added unit test for navbarUtils
* fix sonar failure
* changes as per comments
* minor fixes
* Minor: fixed DQ edit test case issue and searchIndexDetails typescript issue (#15528)
* Minor: fixed DQ edit test case issue and searchIndexDetails typescript issue
* fixed failing unit test
* fixed unit test for Data quality test
* reverting e2eLabeler changes
* chore(ui): separate routes as per categories (#15512)
* chore(ui): seprate routes as per categories
* add tests
* fix test
* domain path fix
* [MINOR] GX logging hierarchy (#15542)
* fix: GX module logging hierarchy
* style: ran python linting
* - Use Entity Type (#15546)
* removed docs 1.4.x (#15550)
* Suggestions Alert new design (#15532)
* update ux of suggestions alert
* locales
* minor changes
* fix descriptions
* minor css fixes
* Fix#11868: Duplicated queries cannot be created (#15519)
* Fix#11868: Duplicate query should throw an error of entityExists
* Fix#11868: Duplicate query should throw an error of entityExists
* fix test
* fix test
* Fix uniquee constraint for checksum in Postgres
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* added OpenMetadataApplication.getDao (#15549)
* Add the entityUrl to the header for ThreadMessages (#15552)
* feat: AppResource (#15555)
forbid modification of system app
* MINOR: Skip source hash generation for service (#15516)
* sync the documentation roadmap page with the getcollate roadmap (#15551)
* Application cannot be installed with None as schedule type
* None type should not register in scheduler
* scheduleTimeline fix
* fix payload of schedule type none and change it to scheduleTimeline
* fix unit test
---------
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: IceS2 <pjt1991@gmail.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Imri Paran <imri.paran@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
* Fix#11868: Duplicate query should throw an error of entityExists
* Fix#11868: Duplicate query should throw an error of entityExists
* fix test
* fix test
* Fix uniquee constraint for checksum in Postgres
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* chore: clean up TestCaseResource tests
* fix: added status and type query params for test cases
* style: ran java linting
* fix: refactor addCondition method in ListFilter
* style: ran java linting
* - Added Jdbc Store for Quartz Job
- Added tables schema for Mysql and Postgresql
* Catch Object Already Exists
* Drop tables extra statements
* Use Proper Dialects
* format cron from unix to quartz for internal apps , for others use unix
* Add Migration Files for 131
* Add Migrations
* Fix Json Issue and Add Exception Handling for force
---------
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
* Fix#14786: Suggestions API
* Handle suggestions in ometa
* Minor: Optimise Databricks Client (#14776)
* MINOR - Fix SP topology context & Looker usage context (#14816)
* MINOR - Fix SP topology context & Looker usage context
* MINOR - Fix SP topology context & Looker usage context
* Fix tests
* Fixes#14598: Fix Tags / Labels ingestion on includeTags as False (#14782)
* fix(ui): password error message for char limits (#14808)
* fix(ui): password error message for char limits
* fix java side code
* Fixes#13556: Support for Salesforce table description ingestion (#14733)
* ISSUE-13556: Add suport for Salesforce table description ingestion
* ISSUE-13556: Remove unnecessary blank line
* ISSUE-13556: Fix to get description for each table
---------
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
* MINOR - Better handling of Ingestion Pipeline Status (#14792)
* MINOR - Better handling of Ingestion Pipeline Status
* format
* format
* MINOR: Added table validation for cost analysis data (#14793)
* Added validation for cost analysis source
* centralized life cycle logic
* CYPRESS: simplify side navigation click in cypress (#14818)
* simplify side navigation click in cypress
* make sidbar item uses common enum
* fix cypress failure of outside import
* fix(#14326): tier dropdown is not working in advance search (#14780)
* improvement in advance search based on custom property
* fix a reading undefined property issue
* wip: advance search based on tier
* some code cleanup and improvement
* some fixes
* fix: ui flicker when advanceSearched is apply and refresh the page
* some cleanup
* no need to call customproperty api call, if entity not suppport customProperties
* minor change
* fix: autocomplete not working in tier search option in advance search modal
* added unit test for advance search provider component
* some cleanup
* added testcase for open modal
* added testcase for resetAllFilters method
* removed unwanted code
* added e2e test for testing tier advance search
* fix: e2e search flow for single field
* fix: string field not working after giving listValues in TierSearch
* fix: group query e2e test fix
* used asyncFetch way to get the tierOptions synchronously
* some cleanup
* remove unwanted lines
* some cleanup
* fix: selected option show option value instead of option title
* fix(minor): update skip icon for executions (#14809)
* Fixes#14803: ignore capitalization when confirming deletes (#14804)
* ignore case when confirming deletes
* Test confirmation of deletes works when case differs
Added test case for 'delete' as the confirmation text.
* minor(config): update openmetadata-ui code reviewers (#14823)
* Add Tests
* Add list/accept/reject apis
* initial ui changes
* localisation
* show suggestion for empty description
* ui feedbacks
* Fix permission check for entities without owner
* Fix entityLink and add tests
* Add update suggestion WIP
* Fix test
* Fix PUT and Pagination
* Fix styling
* update test
* Update status
* add OM server connection in apps
* add permissions check
* Fix CI
* Remove TODO
* Fix feedResourceTest
* fix unit tests
* add private configs for apps
* add private configs for apps
* fix update application icons
* minor center align icon
* add private configs for apps
* Format
* Fix pydantic gen
* Remove token
* Update name
* Rework private conf
* Fix apps
* Fix apps
* Format
* Format
* show metapilot only if its installed
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: kwgdaig <18678754+kwgdaig@users.noreply.github.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Abhishek Porwal <80886271+Abhishek332@users.noreply.github.com>
Co-authored-by: Carlo Q <carlo@machina.bio>
Co-authored-by: karanh37 <karanh37@gmail.com>
* Centralize EventType
* Format better for readability
* Add Handling for Thread as Change Event
* Centralize logic for Entity Message Creation
* Add Thread Parent Message in Conversation
* Add Task and Announcement
* Support for multiple destinations
* Delete existing alerts for schema changes
* Delete all tables data for event subscription
* Centralize logic for Notifications and Observability
* Change Field Name and Remove redundant code
* Test Fixes
* Add more fields
* Add Optional
* Logical Test Case Addition Chnage Event
* Add Filter By Owner
* Fix Email Entity Url
* added data observability settings page
* localization changes for other languages
* Handler closure and cleanup
* complete create observibility flow
* fix searchIndex method error
* Update Entity Observability Filter
* working observability creation
* complete creation flow
* fix action with arguments
* fix form validations and form data formulation for 'input.actions' field
* localization changes for other languages
* Fixes for Data Observability
* Add mention notification
* Only apply mention to conversation
* fIx test case
* bug fixes for add and edit observability alert form functionality
* fIx test case
* add feature to config internal along with external destinations in alert form
* Fix Formatting
* Fix Url Redirection
* add observability alert details page
* localization changes for other languages
* remove filter and action required rules
* fix styling for observability form and details page
* add delete functionality on observability alert details page
* update view page layout and add a warning in configure destination step
* localization changes for other languages
* feat(ui): support notification with new flow (#14848)
* feat(ui): support notification with new flow
* fix notifications
* add missing filters for notification alert creation flow
* update the filter hiding logic to show at the start always
* add check to show Actions section in observability alert creation form
* code cleanup and improvements
* add breadcrumb to add notification alert page
* Add General Metadata Filters
* remove code smells and code cleanup for add notification page
* add new filter
* show activity feed alert on notifications list page
* add notification alert details page changes
* localization changes for other languages
* show icons for all the entities in the alert trigger dropdown
* redirect to notification alert listing page after deleting the notification alert
* change add alert page title
* add logic to disable all destinations except email for users
* fixed unit tests
* code improvements and cleanups
---------
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
* Centralize EventType
* Format better for readability
* Add Handling for Thread as Change Event
* Centralize logic for Entity Message Creation
* Add Thread Parent Message in Conversation
* Add Task and Announcement
* Support for multiple destinations
* Delete existing alerts for schema changes
* Delete all tables data for event subscription
* Centralize logic for Notifications and Observability
* Change Field Name and Remove redundant code
* Test Fixes
* Add more fields
* Add Optional
* Logical Test Case Addition Chnage Event
* Add Filter By Owner
* Fix Email Entity Url
* Handler closure and cleanup
* Remove unnecessary field
* Remove unnecessary field
* Support query comments in MSSQL
* Remove unnecessary field
* Format
* Add external type
* Add MSSQL SP support
* Remove LMAX Disruptor , use queue and Quartz
* Spotless Fix
* Spotless formatting
* Review Comments
* Improvements
* Improvements to add Retry and DLQ
* Spotless fix
* Update Stats
* Fix stats
* Fix delete Failures
* Fix Failing Tests
* Fix Failing Tests
* Fix Failing Tests
* Postgres Fix
* Fix Schema Change for Change Event Table
* Failing test
* Fix Error for non ChangeDescriptions
* Adds Observability On Top of Event Subscription
* Make List Separate
* Add more filters for Test Suite
* Populate Default Schema Updates to Look for
* typo
* Add matchFieldChange and other in paramAdditionalContext
* Review Comments
* Spotless fix
* Merge issue
* Update Filter as per new Syntax
* Fix Failing Test
* Add field and index
* MINOR - Move test case incident to the top of the data_quality_data_time_series table
* Fix test
* Fix compile
* Format
* Update incidentId
* Rename field
* Fix patch
* Add new OpenMetadataSetup command line application to migrate/deploy and re-index
* Add new OpenMetadataSetup command line application to migrate/deploy and re-index
* Add deployPipelines option
* Add reIndex option
* add subcommands
* add provision to store upgrade metrics
* rename bootstrap script
* fix styling checks
* Add changelog and store metrics into SERVER_CHANGE_LOG
* Cast jsonb
* Cast jsonb
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* feat: add test case resolution task workflow
* chore: add migration for test case resolution feature
* fix: removed required field for object compatibiity in older migrations
* fix: minor testCaseResolution status logic
* chore: revert migration for test case incident
* chore: update migration file
* style: renamed variables
* feat: added logic to compute failed/passed rows
* feat: add support for row level computation in schema
* chore: add test definition migration
* feat: add logic to explicitly compute row level failure
* chore: clean up code
* style: fix java
* style: fix pyton format
* fix: unhidde API for incident manager
* style: fix java styling
* feat: add test case resolution task workflow
* chore: add migration for test case resolution feature
* fix: removed required field for object compatibiity in older migrations
* fix: minor testCaseResolution status logic
* chore: revert migration for test case incident
* chore: update migration file
* chore: clean up code
* style: fix java stylecheck
* Fix supported characters in SM
* Update SM
* Fixes
* Fixes
* Improve class conversion exceptions
* Comments
* Rename noop to db secrets manager providee
* Update sm
* Fix
* db SM
* db SM
* Fix test
* UI
* Update openmetadata-ui/src/main/resources/ui/src/mocks/IngestionListTable.mock.ts
* update default
* refactor: entityFQN as ListFilter condition
* feat: implement resolution entity timeseries
* fix: rename to testCaseResolutionStatus
* ref: extracted ES query builder into private method
* ref: extract OS query builder in its own method
* ref: remove ingestion logic for test case resolution
* fix: reorganize json schemas to fix circular import in Python
* ref: object names in typescript code
* feat: added indexing of test case resolution
* feat: added test case resolution sample data
* fix: test case resolution api logic
* fix: audit logger for entityTimeSeriesInterface
* fix: DDL generation
* style: python linting
* fix: skip UI test case resolution tests
* fix: remove extension field
* fix: renamed testCaseFailureStatus to testCaseResolutionStatus
* fix: remove reviewer
* fix: rename sequenceId to stateId
* fix: re adjust search weights
* fix: removed InReview status
* style: ran python linting
* Clean Airflow Lineage Backend and migrate status to millis
* Format
* chore(ui): update executions startTs and endTs to millis
* Remove lineage providers
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* Remove duplicates from entity_extension_time_series and add the constraing if missing
* Add sort buffer and work mem
* Revert "Add sort buffer and work mem"
This reverts commit fcfff5feb6.
* Fix#12655: Customizable Landing Page - Add Personas
* Add Knowledge Panels
* Add Doc Store to store KnowledgePanels and Pages
* Add Doc Store to store KnowledgePanels and Pages schemas
* Fix tests
* Add Multiple Persona support for a user
* add more elaborate tests for docstore
* Fix Page and KnowledgePanel required fields
* Fix Page and KnowledgePanel required fields
* Fix Page and KnowledgePanel required fields
* Fix build
* Rename sandboxDomain to instanceDomain
* Test Get Charts in DomoDashboard
* Fix schemas
* Fix test
* Fix test
* Rename to Auto Tag PII
* Fix query test
* Fix query test
* Fix query test
* Fix LifeCycle inconsistencies in Schema; Add DELETE api
* set autocommit to true for non transactional
* make lifecycle common field for entities
* Add LifeCycle as common entity field
* Fix python life cycle code
* Fix search indexes
* remove unnecessary constant
* Add test back to entity resource test
* Fix lint
* Fix lint
* Fix lint
* Fix lint
* Add missing schema
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* Minor fix: Do not re-run migration for properly formed native test suites
* rename 1.1.3 to 1.1.5
* rename 1.1.3 to 1.1.5 and add 1.1.4
* Fix table -> native testsuite migration
* Fix#12494: Jdbi Transactions opens a new connection per DAO causing recursive delete to not to rollback
* Fix#12494: Jdbi Transactions opens a new connection per DAO causing recursive delete to not to rollback
* rebase with main
* Fix styling
* Add jdbiUnitOfWork
* Improvements for Change Event Repository and missing Annotations
* Add connection commit/rollback
* push schemaChange fix
* Improvements for Change Event Repository and missing Annotations
* Pass wrapped collectionDAO everywhere
* Pass wrapped collectionDAO everywhere
* Separate event handlers transactions
* Fix checkstyle
* Wrap PUT , POST, and DELETE in transactions
* Add Patch for transactions
* Add primary key to tag.id
* Proxy internal @CreateSQLObjects
* Fix exception handling in ManagedHandleInvocationHandler
* Java typo
* Update schema files
* Checkstyle fix and conflicts resolve issue
* Remove @JdbiUnitOfWOrk from Feed Repository
* remove unnecessary @JdbiUnitOfWork annotation
* Test Failures fix
* Test Failures fix
* Increase wait time , changeEventDAO takes time due to handle.commit()
* commit change
* No need to use commit in ChangeEventHandler
* Add a lookup for avoiding transaction that are not started and should not be rolled back
* remove JdbiUnitOfWork.java
---------
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* fix: updated ingestion to delete existing data for the ingestion day
* fix: added delete endpoint for the report data
* fix: added migration to delete duplicate data + added tables creation & data deltion logic in a transaction
* fix: made deletion SQL engine aware
* fix: added ES deletion logic back while we work on DI event publisher
* fix: write testCase result testSuite to compute summary
* fix: empty commit to trigger CI
* fix: extracted report data out of entity_extension_time_series and into report_data_time_series
* fix: split profiler data from entity_extension_time_series
* fix: split data quality data time series table
* fix: updated migration file
* Add Stored Procedure Entity
* Stored Procedure repository
* Stored Procedure repository
* Fix#12998: Support for Stored Procedures as another entity under Database Schema
* Fix#12998: Support for Stored Procedures as another entity under Database Schema
* Add ascii_bin for fqnhash, Add Constraints on timeseries
* Attemp of moving migrations to files
* Deprecate Flyway and use Native migrations
* Deprecate Flyway and use Native migrations
* Deprecate Flyway and use Native migrations
* Deprecate Flyway and use Native migrations
* Deprecate Flyway and use Native migrations
* Deprecate Flyway and use Native migrations
* Deprecate Flyway and use Native migrations
* Deprecate Flyway and use Native migrations
* Move upstream migrations to new path
* Fix#12779: Add support for SearchIndexes for ElasticSearch and OpenSearch
* Fix#12779: Add support for SearchIndexes for ElasticSearch and OpenSearch
* Fix#12779: Add support for SearchIndexes for ElasticSearch and OpenSearch
* Rebase fixes with main
* Add Sample Data
* lint fix
* remove unused import
* Fix service count test
---------
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
* interfaces for db migrations
* Add Data Migration for entities to 1.1
* Migration for FQN hash
* Added Tag Usage And Fixed some transaction issue in testing
* Added SERVER_CHANGE_LOG validations
* Update Path for files
* Added Postgres Migration
* Test Suite Migration [WIP]
* remove ingestion pipeline
* moved Migration to Table Initializer
* init Data source config in TableInitializer
* make checksum ignore configurable
---------
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
* Fix fqn hash
* Add name & fqnHash and remove generated columns from top level
* Add name & fqnHash and remove generated columns from top level
* Add name & fqnHash and remove generated columns from top level
* Add name & fqnHash and remove generated columns from top level
* Add name & fqnHash and remove generated columns from top level
* Add name & fqnHash and remove generated columns from top level
* Add name & fqnHash and remove generated columns from top level
* Add name & fqnHash and remove generated columns from top level
* Add name & fqnHash and remove generated columns from top level
* merge commits
* merge commits
* merge commits
* Fix glossary import/export
* Fix BotResource Tests
* Fix BotResource Tests
* Fix Glossary Term tests
* Fix Glossary Term tests
* Fix Glossary Import/Export tests
* All backend tests are fixed.
* merge with main
* Fix tests and revert local changes
* Fix tests and revert local changes
* Fix NullPointerException for Glossary and Query
* Fix Tests
---------
Co-authored-by: Ayush Shah <ayush@getcollate.io>
* Refactor Data Insight Chart for Reusability
* Data Insight Reporting
* Add Schedule Info
* Add Error Handling
* Add Profile Field
* Remove Endpoint as required field
* Missing Language
* Reformat
* Remove Task and Test Result Settings
* Fix test
* fix: typescript errors
* fix: send alertType for subscriptions request
* feat: add alert data insights report page
* Fix test
* fix: alert type typescript error
* fix: loading flicker on alerts page
* chore: add placeholders for data insight report alert page
* fix: alert icon styling
* fix: confirmation is not showing up for delete operation for subscription.
* fix: delete operation is not working from alert details page
* fix Activity Feed Errors on update
* fix: test
* chore: change the description text area to the markdown editor
* Data Insight Reporting should be created on system startup
* Restrict DataInsight Report to only one
* Review Comments
* feat: show the default DataInsightReport data
* sonar fixes
* sonar fixes
* deprecate ConfirmationModal
* trigger should be updated
* feta: add edit flow for data insight report
* remove custom option for schedule info
* chore: update data insight report icon
* test: add unit test for add data insight alert form
* fix: update cypress tests
* update local message
* test: add unit tests
* move sql changes to a different file
* spacing issues
* add tag provider in createRequest
* chore: send provider in create and update alert request.
* fix: code smells
* fix: comment typo
* fix: permission issue for event subscription
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* Snowflake, Bigquery & Azuresql docs with superset migrations
* Superset Docs
* Auto PII is not a part of ingestion
* bigquery docs
* Azure SQL Docs
* Snowflake Docs
* Superset Docs
* Url to URL
* replace hr with ---
* Deprecate location and old storage service
* Format
* Fix test
* Refactor
* Clean location
* Rename object store to storage
* Rename object store to storage
* Rename object store to storage
* Format
* Format
* Refactor object store for storage
* Refactor object store for storage
* Rename object store to storage
* Fix test
* Fix test
* Format
* chore(ui): change Objectstore to Storage
* Fixes
* Fix test
* Remove storage service from Glue cypress
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* Fix: remove 'audience' field from OM metadata service security config
* Remove extra space
* Update bootstrap/sql/com.mysql.cj.jdbc.Driver/v009__create_db_connection_info.sql
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* Update bootstrap/sql/org.postgresql.Driver/v009__create_db_connection_info.sql
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* added query as an entity
* changed name of the variables and methods
* Added Resource Descriptors
* testcase bug fix
* addressing comments
* added script for table query migration
* added script for table query migration postgresql
* bug fix
* db change for script test
* added current timestamp
* change db config from postgresql to mysql
* added extension to use fucntion gen_random_uuid()
* solving maven ci
* added queryUsage and change is migration script
* addressing comments
* addressing comments
* added queryUsage relation and testcase
* added api to insert queries in bulk
* .
* fix a test case which was failing due to latest changes
* Ingestion Changes for Query as Entity
* move query changes to latest sqls
* added tags and owner
* update PR for Query as Entity
* update type
* fixed pagination
* fix path param
* fix TestCases
* add validation criteria
* removed exisitng query apis
* checkstyle fix
* remove vote from put
* remove vote from put
* Query As Entity Ingestion Changes
* Remove unused func
* update Review Comments
* update Review Comments
* remove previous changes for Query and Update Tests
* moved Checksum to Query Util Class
* update python api
* fix python checkstyle
* Fixed Tests
* Fix pytest
* remove space changes
* remove space changes
* Fixed put_addFollowerDeleteEntity_200
* Fix usage ingestion
* Update Python SDK and tests
* pylint fix
---------
Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
* Do not store OM connection
* Migration to remove the server connection
* Update tests
* Add workflow masking and secrets manager
* Fix failing test
---------
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
* Prep the skeleton
* Add DAO and tables
* Add Test Connection Definition Resource
* Format
* Add ResourceDescriptors & missing props
* Simplify APIs to scope for GET and LIST
* First cut of the store service model
* Second cut of the store service model
* reverted accidental rename of property
* Third version for the object container schema definition.
* final draft version for container and object store service related entities
* final first draft of api's and entities for the object store service and container
* formatting
* removed test file
* formatting
* test fixes
* formatting
* more fixed tests
* fixed tests, addressed PR comments
* added type for object store connections
* addressed PR comments
* formatting
* renamed objectstoreservice to service in schemas. Changed type to fullyQualifiedEntityName in createContainer schema
* Docs #8973: Superset with SSO docs
* Superset support for mysql & postgres db
* remove unwanted field from yaml
* Fix pylint
* Fix superset tests
* Fix sample data connection
* ci fix & review comments
* cypress & defualt provider fix
* Fixes#9618 Allow apostrophe in entity names
* Add support for space in entity names (with exception) and column names
* Add regex checks to entity names, table column names to allow only required characters
* fix: allowed characters in entityName
* Add all the allowed special characters in the entity name in tests
* Allow '&', '/', ':' only for the table
* Override basic entityName by defining entity specific entityName for Python code gen
* fix: dagster migration + json schema path
* fix: python style check
* Fix test failure
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
* Removed Redundant Code + Removed Unnecessary Triggers, Activity Feed Filterin
* all should have intersecting filters
* updated by should have entities index
* Schema for Alerts #9248
* 1. Api for alerts
2. Api for alertAction
API for Alert and AlertAction #9266
* missing file
* fix ui failures
* Added Api to give function parameter type and additional Context for UI
* Added default Triggers in Alerts
* checkstyle fix
* docs update
* function names updated
* added timestamp for alert status update
* receiver should be unique in json schema and alerts publishers
* updated bootstrap filters
* updatated review comments
* added functions to match eventType for entities
* added migrations for alerts
* added alert config in alertACtionConfig
* Fix issue in sending mails
* removed commented part
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* staging commit
* updated terms to french
* fix(dataInsight): updated ES response to get entityType and total non tiered entities
* fix(dataInsight): removed fields=*
* fix(dataInsight): Added entity migration
* cleaned up branch
* Fix#8933: Add fixes to initSeedData from 0.12 upgrade
* Fix#8933: Add fixes to initSeedData from 0.12 upgrade
* Fix#8933: Add fixes to initSeedData from 0.12 upgrade
* Fix#8933: Add fixes to initSeedData from 0.12 upgrade
* Added SystemServices for creating DataInsight and ElasticSearch Reindexing Pipeling with Sink config
* Add Amundsen config
* Changed SystemService to MetadataService
* Change to MetadataConnection
* Fixed failing test
* Fixed Failing test
* Added Metadata Service Test
* Bootstrapped Openmetadat service
* checkstyle fix
* Fixed: dagster to connect to cloud
* Fixed: changed test_cases
* Fixed: lineage between the assets and jobs
* Changes as per comments
* Fix python checkstyle
* Fix as per comments
* Fix added migration scripts
* minor fixes
* Moved webanalytics type in its own folder
* Added data insight chart api endpoint
* Jave formatting
* Added resource descriptor
* Added metadata entity endpoint
* Added aggregation endpoint for dataInsight
* Fix tag name
* Added logic to ingestion pipeline resource to add ES config info if pipeline type is dataInsight
* Fix pageViewEvent import issue
* Changed dataType to PERCENTAGE and NUMBER
* Cleaned up PR by removing metadata resource and ingestionPipeline sink logic
* Update openmetadata-service/src/main/resources/json/data/dataInsight/totalEntitiesByTier.json
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* Update openmetadata-service/src/main/resources/json/data/dataInsight/totalEntitiesByType.json
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* Initial implementation of report endpoint
* Modified model files
* Added migration
* Added tests for analytics/report endpoint
* Finalized implementation of the reports endpoint
* Fixed maven test failure
* Fixed java style
* Added policy for reportDefinition
* Fixed minor typos in code
* Added database migration for web analytic event type
* Added logic for collect endpoint
* Added JSON Schema for collect endpoint
* Added index on table columns + added resource description for web event entities
* Fixed policy tests
* Updated add web analytic function to return the body of the request + updated test
* Added referer URL to PageView event
* Changed collection name to align with API endpoint
* updated initSeed method to initializeEntity
* cleaned up PR by removing unused filed from branch
* Fixed requested changes from review
* Clean up names
* Fixed comma in SQL statement
* Updated json schema to support dataType filter
* Added migration for test definition support of data type filtering
* Added backend logic to support filter on data type for testdefinitions
* Added migration for:
- supported test types
- renaming of certain tests from starting uppercase to lowercase
* removed openmetadata_db from migration
* added datatype filter in column test
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
* Added migration steps to delete profiler pipeline from entity relationship
* Added migration to remove rows from entity_relationship with profiler pipelines
* Fixed sample data TestDefinition name after renaming testDefinition
* Added user_tokens table to v005
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
* Added SQL to clean up profile and test data when migrating from 0.11 to 0.12
* Added deletion query for ingestion pipeline mysql
* Added logic to delete profiler ingestion pipeline from DB
* Update v004__create_db_connection_info.sql
added semicolon
* Fix#6936: testPlatforms is required field in testSuite and createTestSuite schema
* Fix#6936: testPlatforms is required field in testSuite and createTestSuite schema
* Fix#6936: testPlatforms is required field in testSuite and createTestSuite schema
* Fix#6936: testPlatforms is required field in testSuite and createTestSuite schema
* Fix#6936: testPlatforms is required field in testSuite and createTestSuite schema
* fixed glossary test
* Fixed sample data ingestion
* Add filters for testCaseResultSuccess
testCaseResultFailed, testCaseResultAborted
* Fix#6936: fix testcase listing
* Fix#6936: fix java style
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
* Fix#6571: Add EntityLink for the testCase to ID columns
* Fix#6571: Add EntityLink for the testCase to ID columns
* Fix#6782: Separate TableProfile and ColumnProfile api calls
* Fix#6782: Separate TableProfile and ColumnProfile api calls - fix tests
* Fix#6782: Separate TableProfile and ColumnProfile api calls - fix tests
* Fix setFields
* Fix tests
* Update pipeline status endpoint
* updated ui side as per new schema for profiler tab
* updated profiler details with new API
* Fix Profiler tests and validation errors (#6827)
* add profilerSample field in TableProfile
* add profilerSample field in TableProfile
* get columnProfile with field profile
* get columnProfile with field profile
* Fixed sample data and python tests
* fixed date range filter change issue
* handled empty profiler case
* Added column level test case and results
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
* Fix#6571: Add EntityLink for the testCase to ID columns
* Fix#6571: Add EntityLink for the testCase to ID columns
* added entityLink to python tests
* Fix tests
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
* Adding different team types for supporting organization team hierarchy
* Add support for team hierarchy
* Create organization during initalization
* Team hierachy test for POST methods
* Add PUT and PATCH support for changing team hiearchy
* Added tests for the team hiearchy feature
* Restored v003 sql files and added v004
* Merge conflicts with main and adopt new JSON based configuration
* Remove configuration Organization name to simplify user MUST do configurations
* Snowflake Make Query tag Optional (#6114)
* Snowflake make query tag optional
* Modified Description
* [Backend][UsageResource] Add PUT to enable updating Usage #6117 :::::: and allow adding space to tagCAtegory and Tags (#6119)
* [Backend][UsageResource] Add PUT to enable updating Usage #6117
* [Backend][UsageResource] Allow space in tags category and primary tags #6121
* [Backend][UsageResource] Update in more genric way to make use of space in resourcePath
* ui changes for allowing space in tag and tag category name
* [Backend][Improvement]add test for put and post
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
* Adding different team types for supporting organization team hierarchy
* Add support for team hierarchy
* Create organization during initalization
* Team hierachy test for POST methods
* Add PUT and PATCH support for changing team hiearchy
* Added tests for the team hiearchy feature
* Restored v003 sql files and added v004
* Merge conflicts with main and adopt new JSON based configuration
* Remove configuration Organization name to simplify user MUST do configurations
* Python jsonSchema code generation not respecting defaults
* fixed failing cypress
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: mohitdeuex <105265192+mohitdeuex@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
* Make mysql bootstrap file consistent with postgres
* Adding a java code change to trigger all the precommit checks
* Set test container reuse flag to true
* Make Postgres bootstrap files consistent with MySQL
* Test pagination using random jump of limit between 1-5 instead of 1 to reduce test time
* Starting the test container outside @BeforeAll in a static block for container reuse
* Comment printing out list output in pagination tests
* Move starting the test container to @BeforeAll setup method instead of static initialization
* Remove unnecessary tests in PolicyResourceTest to speed up tests
* Add test container reuse for github workflows
* Add test container reuse for github workflows
* Add test container reuse for github workflows
* Change timeouts for the TestContainer
* Add test container reuse for github workflows
* Add test container reuse for github workflows (#4563)
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* Add postgres support
* Add testing for postgresql databases
Split surefire tests into: unit-tests, postgres-integration-tests, mysql-integration-tests
Integration tests get db information from system properties
All tests ending in ResourceTests.java are integration tests, all other are unit tests
Move to using testscointainers, remove embeded mysql
* Fix some tests
* Fix webhook and table tests
* Fix random name generation in tests, remove parallelism
* Fix style
* Add headers, fix config files
* Apply formatting
* Fix tag ussage query for postgres
* Replace references to mysql with generic database
* Fix postgres migration file
* Fix postgres migration script
* Fix#3659 Refactor Service Connection String to be specific to per service
* Simplify and centralize Airflow Pipeline info for REST (#3740)
* Remove code
* Modified Configs based on refactoring schema (#3816)
* Clean WorkflowContext
Co-authored-by: pmbrull <peremiquelbrull@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
* Support swapping default roles
Pseudocode:
```
A. patchRole(role1, default=True):
B. set role1.default = True
for all users:
add role1 to user.roles
C. for role in roles if role != role1:
set role.default = False
for all users:
delete role from user.roles
```
This ensures that changeDescription for the role(s) and user(s) are updated accordingly.
Potential optimization:
Adding role1 and removing role from user.roles could be considered/implemented as one change.
However, increases code complexity.
* Set DataConsumer as default role
* Fix tests
* Fix code smell
* Fix#2340: Ingestion pipeline deployment refactor - update ingestion
* Fix#2355: Upgrade scripts, handle entity_extension updatedAt and dbservice jdbc field , Fix#2353: Add API to AirflowPipelines filter based on service
* Fix#2355: Upgrade scripts, handle entity_extension updatedAt and dbservice jdbc field , Fix#2353: Add API to AirflowPipelines filter based on service
* Add support for webhook secret key
* Fixes#2194 - Change dateTime field to unix epoch timestamp milliseconds and add support for webhook secret key
* Fixes#2194 - Added support for upgrading existing metadata to move dateTime attributes to timestamp
* Fix#1327: rename Model to DBTModel and provide indexing support
* Fix#1327: update dbt connector
* Fix#1327: add search index for dbt models
* Fix#1327: Address checkstyle issues
* Fix#1151: Refactor Model to MLModel
* Fix#1151: Refactor Model to MLModel
* Fix#1151: Refactor Model to MLModel
* Fix#1151: Refactor Model to MLModel
* Prepare schemas and model resource
* Add references to model and missing Task Feed ref
* Prepare tests
* Fix Entity name
* Fix schema class for create op
* Java style check
