OpenMetadata/conf
Sriharsha Chintalapani ad9e1b7823
Some checks are pending
Integration Tests - MySQL + Elasticsearch / Detect Changes (push) Waiting to run
Integration Tests - MySQL + Elasticsearch / integration-tests-mysql-elasticsearch (push) Blocked by required conditions
Integration Tests - PostgreSQL + OpenSearch / Detect Changes (push) Waiting to run
Integration Tests - PostgreSQL + OpenSearch / integration-tests-postgres-opensearch (push) Blocked by required conditions
Java Checkstyle / java-checkstyle (push) Waiting to run
Maven Collate Tests / maven-collate-ci (push) Waiting to run
OpenMetadata Service Unit Tests / Detect Changes (push) Waiting to run
OpenMetadata Service Unit Tests / openmetadata-service-unit-tests (mysql) (push) Blocked by required conditions
OpenMetadata Service Unit Tests / openmetadata-service-unit-tests (postgresql) (push) Blocked by required conditions
OpenMetadata Service Unit Tests / k8s_operator-unit-tests (push) Blocked by required conditions
OpenMetadata Service Unit Tests / openmetadata-service-unit-tests-status (push) Blocked by required conditions
Publish Package to Maven Central Repository / publish-maven-packages (push) Waiting to run
Containers: batch container data-model column tag retrieval to avoid subtree fan-out (#27836)
* Containers with deep nesting causing performance issues due to tag fetch

* Batch derived-tag fetch across data-model columns

populateDataModelColumnTags previously called addDerivedTagsGracefully
once per flattened column, which internally batches across that column's
own tags but issues a separate derived-tag DB lookup for every column.
On data models with many columns (or struct types with deep nesting)
this becomes an N+1 pattern.

Refactor:
- Pre-compute Map<String, Column> hashToColumn once (LinkedHashMap to
  preserve column order) so we no longer hash each FQN twice — once
  for the target-hash list and again on lookup.
- After fetching tags by target hash, flatten all returned TagLabels
  into a single list and call TagLabelUtil.batchFetchDerivedTags(...)
  once for the whole data model.
- Per column, use addDerivedTagsWithPreFetched(columnTags, derivedMap)
  to avoid further DB lookups.
- Fall back to the per-column addDerivedTagsGracefully path if the
  batch derived-tag fetch raises, preserving existing semantics.

Net effect: total derived-tag DB queries drop from O(N) to 1 regardless
of column count or nesting depth.


Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
2026-04-30 20:55:55 -07:00
..
openmetadata-env.sh License header update (#1498) 2021-12-01 12:46:28 +05:30
openmetadata-s3-logs.yaml Add logging endpoint into S3 (#22533) 2025-09-15 07:22:25 -07:00
openmetadata.yaml Containers: batch container data-model column tag retrieval to avoid subtree fan-out (#27836) 2026-04-30 20:55:55 -07:00
operations.yaml Update operations.yaml (#22231) 2025-07-08 16:06:55 -07:00
private_key.der feat(ui): login via email and password - Basic auth (#7558) 2022-09-23 16:05:54 +05:30
public_key.der feat(ui): login via email and password - Basic auth (#7558) 2022-09-23 16:05:54 +05:30