Commit graph

21 commits

Author SHA1 Message Date
Mayur Singal
60a2e6546e
Migrate Databricks from sqlalchemy-databricks to databricks-sqlalchemy (#26896)
Some checks are pending
Integration Tests - MySQL + Elasticsearch / Detect Changes (push) Waiting to run
Integration Tests - MySQL + Elasticsearch / integration-tests-mysql-elasticsearch (push) Blocked by required conditions
Integration Tests - PostgreSQL + OpenSearch / Detect Changes (push) Waiting to run
Maven Collate Tests / maven-collate-ci (push) Waiting to run
Integration Tests - PostgreSQL + OpenSearch / integration-tests-postgres-opensearch (push) Blocked by required conditions
Java Checkstyle / java-checkstyle (push) Waiting to run
OpenMetadata Service Unit Tests / Detect Changes (push) Waiting to run
OpenMetadata Service Unit Tests / openmetadata-service-unit-tests (mysql) (push) Blocked by required conditions
OpenMetadata Service Unit Tests / openmetadata-service-unit-tests (postgresql) (push) Blocked by required conditions
OpenMetadata Service Unit Tests / k8s_operator-unit-tests (push) Blocked by required conditions
OpenMetadata Service Unit Tests / openmetadata-service-unit-tests-status (push) Blocked by required conditions
Publish Package to Maven Central Repository / publish-maven-packages (push) Waiting to run
* Update Databricks Dependency to databricks-sqlalchemy

* Update generated TypeScript types

* address comments and pyformat

* pyformat

* fix log filtering

* address comments

* fix static unit tests

* fix rule for static type

* pyformat

* update baseline

* revert basepyright changes

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2026-05-04 18:53:24 +05:30
Teddy
11e5ac95d4
chore: update sqlalchemy to 1.0.0 (#27776)
Some checks are pending
Integration Tests - MySQL + Elasticsearch / Detect Changes (push) Waiting to run
Integration Tests - MySQL + Elasticsearch / integration-tests-mysql-elasticsearch (push) Blocked by required conditions
Integration Tests - PostgreSQL + OpenSearch / Detect Changes (push) Waiting to run
Integration Tests - PostgreSQL + OpenSearch / integration-tests-postgres-opensearch (push) Blocked by required conditions
Java Checkstyle / java-checkstyle (push) Waiting to run
Maven Collate Tests / maven-collate-ci (push) Waiting to run
OpenMetadata Service Unit Tests / Detect Changes (push) Waiting to run
OpenMetadata Service Unit Tests / openmetadata-service-unit-tests (mysql) (push) Blocked by required conditions
OpenMetadata Service Unit Tests / openmetadata-service-unit-tests (postgresql) (push) Blocked by required conditions
OpenMetadata Service Unit Tests / k8s_operator-unit-tests (push) Blocked by required conditions
OpenMetadata Service Unit Tests / openmetadata-service-unit-tests-status (push) Blocked by required conditions
Publish Package to Maven Central Repository / publish-maven-packages (push) Waiting to run
2026-04-28 11:07:26 -07:00
Sriharsha Chintalapani
bb0daa180e
RDF, cleanup relations and remove unnecessary bindings, add distributed mode for RDF reindex (#26902)
* RDF, cleanup relations and remove unnecessary bindings, add distributed mode for RDF reindex

* Update generated TypeScript types

* Address comments from copilot

* Update generated TypeScript types

* fix test issues

* Fix minor UI bugs

* Add the missing filters

* Fix RDF export API error

* Add export functionality

* Fix ui-checkstyle

* Fix java checkstyle

* Fix unit tests

* Fix and increase the coverage for KnowledgeGraph.spec.ts

* Fix tests

* Remove rdf as default in playwright and local docker

* fix ui-checkstyle

* Address comments

* Potential fix for pull request finding 'CodeQL / Artifact poisoning'

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

* Address copilot comments

* Address copilot comments

* FIx tests

* FIx docker

* Update openmetadata-service/src/main/java/org/openmetadata/service/apps/bundles/rdf/distributed/DistributedRdfIndexCoordinator.java

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Address copilot review comments: license headers, JSON escaping, type safety, border-color, stop semantics

Agent-Logs-Url: https://github.com/open-metadata/OpenMetadata/sessions/c026e52e-162b-4c9a-9874-43791d4aaac1

Co-authored-by: harshach <38649+harshach@users.noreply.github.com>

* Show error toast for unsupported export format in KnowledgeGraph

Agent-Logs-Url: https://github.com/open-metadata/OpenMetadata/sessions/c026e52e-162b-4c9a-9874-43791d4aaac1

Co-authored-by: harshach <38649+harshach@users.noreply.github.com>

* Fix docker

* Fix docker for playwright

* Fix docker for playwright

* Fix tests

* Fix tests

* Fix docker

* Fix docker

* Fix glossary and pagination spec flakiness

* update the missing translations

* Fix docker

* Fix docker

* Fix integration test

* Fix fuseki not starting

* Fixed the run local docker script

* worked on comments

* Fix flakiness in knowledge graph tests

* Fix checkstyle

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: harshach <38649+harshach@users.noreply.github.com>
2026-04-14 13:24:41 -07:00
Chirag Madlani
917a36c6a4
Potential fix for code scanning alert no. 1842: Artifact poisoning (#27220)
* Potential fix for code scanning alert no. 1842: Artifact poisoning

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

* Pin Yarn version to 1.22.18 to fix artifact poisoning alert

Agent-Logs-Url: https://github.com/open-metadata/OpenMetadata/sessions/29aebdb5-eef0-4a2a-be01-489deef48d2b

Co-authored-by: chirag-madlani <12962843+chirag-madlani@users.noreply.github.com>

* Fix artifact poisoning in update-playwright-e2e-docs.yml: replace npm install -g yarn with pinned corepack

Agent-Logs-Url: https://github.com/open-metadata/OpenMetadata/sessions/550fba5a-bb13-45da-a144-b67599c9eaa4

Co-authored-by: chirag-madlani <12962843+chirag-madlani@users.noreply.github.com>

* Remove corepack prepare to eliminate artifact poisoning: use only corepack enable (bundled yarn)

Agent-Logs-Url: https://github.com/open-metadata/OpenMetadata/sessions/90f6ed8d-3f2b-4c3d-9a34-cd1f57c4d89c

Co-authored-by: chirag-madlani <12962843+chirag-madlani@users.noreply.github.com>

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
2026-04-10 16:12:28 +05:30
Teddy
48d5c19c36
ISSUE #20036 - sqlalchemy 2.0 migration (#26031)
* chore(sqlalchemy): migrate to sql 2.0

* chore(sqlalchemy): migrate to sql 2.0

* chore: add --no-deps to python ci setup

* chore: fix failing unit tests

* chore(sqlalchemy): migrate to sql 2.0

* chore(sqlalchemy): migrate to sql 2.0

* chore(sqlalchemy): address flagged bugs from CI

* increase unit test timeout

* fix: failing CI

* fi xocnnection bug

* fix CI failures
2026-03-02 13:07:47 -08:00
IceS2
8d86663976
MINOR: Shard integration tests and other improvements (#25907)
* Shard integration tests and other improvements

* fix tests

* fix tests
2026-02-17 08:10:18 +01:00
miriann-uu
5db13f8937
GEN-4784 Add validation action for OMD dockerfile (#24335)
* Add validation pipeline for OMD dockerfile

* Add validation pipeline for OMD dockerfile

* Add validation pipeline for OMD dockerfile

* Add validation pipeline for OMD dockerfile

* Add validation pipeline for OMD dockerfile

* Add validation pipeline for OMD dockerfile

* Update diskspace step
2025-11-19 14:55:30 -05:00
Pere Miquel Brull
f5bbad9f36
CI - Fix install yarn shell (#23941) 2025-10-17 11:15:40 +02:00
Pere Miquel Brull
573dcd044b
CI - Add node dependencies (#23939)
* CI - Add node dependencies

* Add support for Java and NPM versions as a variable in setup test environment

---------

Co-authored-by: Matias Puerta <matias@getcollate.io>
2025-10-17 09:40:10 +02:00
Sriharsha Chintalapani
8bb055fc9e
Fix #21506: Upgrade to Java 21 (#21507)
* Fix #21506: Upgrade to Java 21

* Fix #1655: Upgrade to Java 21
2025-06-11 22:06:08 -07:00
Akash Jain
4eec3eddea
chore(CI): Upgrade all steps actions to latest release (#20065) 2025-03-04 14:09:53 +01:00
tarunpandey23
38a4961176
Feat: Github Workflow Action for Scanning vulnerabilities using Trivy. (#19710)
* Added trivy scan and template for Openmetadata server

* Added trivy scan and template for Openmetadata server

* Removed Commented code

* Removed Commented code

* testing the workflow

* testing the workflow

* testing the workflow

* testing the workflow

* testing the workflow

* testing the workflow

* testing the workflow

* testing the workflow

* Updated the scan file

* added files for ingestion & ingestion-base-slim

* Testing the PR comment

* Testing the PR comment

* Testing the PR comment

* Updated trivy scan files

* Added the respective path for ingestion

---------

Co-authored-by: Tarun <tarun.p@deuexsolutions.com>
Co-authored-by: safayavatsal <vatsalsafaya@gmail.com>
Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>
2025-02-16 12:02:14 -08:00
Pere Miquel Brull
9a96ddd4ae
GEN-1494 - Add CI for py-tests with Postgres and Opensearch (#17853)
* GEN-1494 - Add CI for py-tests with Postgres and Opensearch

* GEN-1410 - Improve PII Logging information

* GEN-1494 - Add CI for py-tests with Postgres and Opensearch

* allow_module_level=True
2024-09-16 09:35:38 +02:00
Akash Jain
92466c52f5
fix: Do not Update Docker Image Tags (3 digits) on RC Releases (#17218)
* fix: Do not Update Docker Image Tags (3 digits) on RC Releases

* chore(testing): Mark Push as `false`

* chore: Update Input Descriptions for ingestion publish workflows

* chore: Update Tags conditions

* chore: Update Tags conditions

* chore: Update Tags conditions

* chore: simplify docker image tags

* fix: Do not Update Docker Image Tags (3 digits) on RC Releases

* chore(testing): Mark Push as `false`

* chore: Update Input Descriptions for ingestion publish workflows

* chore: Update Tags conditions

* chore: Update Tags conditions

* chore: Update Tags conditions

* chore: simplify docker image tags

* chore: Mark Push as `true`
2024-07-29 15:38:58 +05:30
Akash Jain
06d2967a80
feat: Ingestion Docker Image Tags (#16819)
* feat: Enable Ingestion Docker Image Tags using meta step

* feat: conditional latest tag

* chore: use separator tags

* chore: refactor use of metadata-action

* test: disable push

* chore: Add env `DOCKER_BUILD_NO_SUMMARY: true`

* chore: Use flavor for `latest` tag

* chore: Enable push of docker images to DockerHub
2024-06-27 18:40:06 +05:30
Ayush Shah
fe04b0a201
Fixes #16435: Fix pyodbc error for mssql (#16800) 2024-06-27 15:46:06 +05:30
Imri Paran
3f07e85735
MINOR: use test setup action for playwright tests (#16633)
* ci: gh actions

use "Setup OpenMetadata Test Environment" in playwright tests

* added ingestion_dependency as input
2024-06-12 21:10:32 +05:30
IceS2
a4e410ba48
Fix Github Workflows for Release (#16224) 2024-05-10 12:59:44 +00:00
IceS2
b67de741e4
MINOR: Small refactor to the Make update_all scripts (#16204)
* Small refactor to the Make update_all scripts

* Extract regex update method

* decouple release from workflows

* Fix issue with docker-openmetadata-db workflow referencing non existent action
2024-05-10 11:40:30 +02:00
Pere Miquel Brull
a1404e6b4a
MINOR - Clean ingestion dependencies (#15679)
* WIP - MINOR - Clean ingestion dependencies

* test

* test

* Clean imports

* add pyiceberg for test

* Revert "add pyiceberg for test"

This reverts commit ab26942736.

* add pyiceberg for test

* Remove docker dep

* clean local docker sh

* MINOR - AKS Airflow troubleshooting docs

* Fix action

* clean local docker sh
2024-04-11 14:30:40 +02:00
IceS2
86a2930cfa
Minor: Fix E2E Ingestion Tests (#15462)
* Fix E2E Tests

* Fix E2E Tests

* Update mysql count, schema changes

* Addition to vertica e2e

* Temporary Github Action modification to test

* Fix Redshift round issue post 10 digits

* modify e2e gh file

* fix gh error

* fix matrix syntax

* Fix Redash counts

* Update py-cli-e2e-tests.yml

* Fix Redshift referenced before assignment error

* Revert Py tests e2e

* Modify Elasticsearch configuration

* Modify Elasticsearch configuration

* Update docker-compose.yml

* Test only running the python tests as e2e

* Comment side effects

* Test

* Test

* Fix name

* Add missing shell property

* Add bigquery to e2e

* Uncomment needed step

* test

* test

* test

* test

* Add control ci pipeline

* Add new e2e tests

* test

* fix

* fix

* fix

* Uncomment needed steps

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2024-03-05 16:00:22 +01:00