OpenMetadata/ingestion/tests
Mayur Singal 9921dc1389
Fixes #28245: ingest valueless Databricks/Unity Catalog tags (#28294)
* Fixes #28245: ingest valueless Databricks/Unity Catalog tags

Databricks/Unity Catalog exposes system-generated (and some user-defined)
tags as (tag_name, tag_value=null). The connectors mapped tag_name ->
Classification and tag_value -> Tag, so an empty tag_value was either
skipped (Unity Catalog) or coerced to a "NONE" sentinel (Databricks).

When tag_value is empty, fall back to a dedicated per-connector
classification (DATABRICKS_TAGS / UNITY_CATALOG_TAGS) and use tag_name
verbatim as the tag under it (no dot-splitting). Valued tags are
unchanged: classification = tag_name, tag = tag_value.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* Address review: harden valueless-tag mapping

- Treat whitespace-only tag_value as valueless (strip-based check) so it
  falls back to the *_TAGS classification instead of being silently
  dropped downstream by get_ometa_tag_and_classification.
- Skip rows with empty/None tag_name in the Databricks connector, for
  parity with Unity Catalog, so an empty classification name is never
  sent to the API.
- Add tests for whitespace-only tag_value (both connectors) and the
  empty tag_name skip (Databricks).

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-21 19:41:03 +05:30
..
cli_e2e fix(cli-e2e): use profileSampleConfig in profiler test builders (#27947) 2026-05-07 22:35:31 +05:30
integration Fixes #4003: bulk + async restore for large entity hierarchies (#27997) 2026-05-20 17:57:40 -07:00
load chore(ingestion): drop pylint, expand ruff (#27774) 2026-04-28 07:21:59 +02:00
unit Fixes #28245: ingest valueless Databricks/Unity Catalog tags (#28294) 2026-05-21 19:41:03 +05:30
utils chore(ingestion): drop pylint, expand ruff (#27774) 2026-04-28 07:21:59 +02:00
__init__.py Add SQLGlot parser support (#24729) 2025-12-19 15:12:48 +01:00