OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
Find a file
Artiom Darie 7d2f8dc2bb
Fixes issue-11740: Added support for the om service to connect to AWS RDS using IAM roles (#11913)
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Changed intial implementation accordingly. Added better flexibility for different auth prodvider impl

* ISSUE-11740: Clean up unnecessary classes

* ISSUE-11740: Clean up unnecessary properties

* ISSUE-11740: Clean up unnecessary properties

* ISSUE-11740: Clean up unnecessary properties

* ISSUE-11740: Clean up unnecessary properties

* ISSUE-11740: Clean up unnecessary properties

* ISSUE-11740: Code formatting

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Moved docs to 1.2 version

---------

Co-authored-by: artiom.darie <artiom.darie@adswizz.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-09-27 09:59:24 -07:00
.github fix(CI): Cypress Workflow timeout-minutes to 120 (#13340) 2023-09-26 19:07:47 +05:30
.run updated es to 7.16.3 (#12218) 2023-06-29 16:03:51 +05:30
bin Remove default debug enable (#8195) 2022-10-19 11:39:14 +05:30
bootstrap Prep v1.1.7 migrations to address test cases & suites (#13345) 2023-09-27 11:49:21 +02:00
common 13188 (#13331) 2023-09-25 12:09:25 -07:00
conf Fixes issue-11740: Added support for the om service to connect to AWS RDS using IAM roles (#11913) 2023-09-27 09:59:24 -07:00
docker Fix:Updating Docker Label for version update via makefile (#13241) 2023-09-18 12:37:44 +05:30
ingestion Prep v1.1.7 migrations to address test cases & suites (#13345) 2023-09-27 11:49:21 +02:00
ingestion-core Fixes #7322 #7145 - Add ViewBasic operation and add access control to get, list, getVersion, listVersions (#7644) 2022-09-21 21:06:35 -07:00
openmetadata-airflow-apis Fix ElasticSearch Test Connection & Deploy (#13061) 2023-09-08 12:40:48 +05:30
openmetadata-clients Update dependencies (#13158) 2023-09-12 15:48:33 -07:00
openmetadata-dist Fix Pom versions (#12396) 2023-07-12 15:18:05 +02:00
openmetadata-docs Fixes issue-11740: Added support for the om service to connect to AWS RDS using IAM roles (#11913) 2023-09-27 09:59:24 -07:00
openmetadata-service Fixes issue-11740: Added support for the om service to connect to AWS RDS using IAM roles (#11913) 2023-09-27 09:59:24 -07:00
openmetadata-spec 13188 (#13331) 2023-09-25 12:09:25 -07:00
openmetadata-ui Part 2 of 3090: add glossary term approval workflow (#13324) 2023-09-27 12:17:51 +05:30
scripts Get alerted if the monitor fails due to the service (#13206) 2023-09-21 09:36:07 +02:00
.gitignore [Proposal] Playwright CI (#13248) 2023-09-19 14:44:36 +02:00
.nojekyll shahsank3t published a site update 2021-08-04 06:23:29 +00:00
.pre-commit-config.yaml Fixes issue-11740: Added support for the om service to connect to AWS RDS using IAM roles (#11913) 2023-09-27 09:59:24 -07:00
.pylintrc Part of #12998 - Prep Stored Procedures Skeleton for Snowflake (#13121) 2023-09-12 14:25:42 +02:00
.snyk Fix XSS warnings (#11620) 2023-05-18 14:51:06 +05:30
CODE_OF_CONDUCT.md Fix #412 - Add code of conduct for OpenMetadata community 2021-09-06 18:57:17 -07:00
CONTRIBUTING.md Update CONTRIBUTING.md (#10464) 2023-03-07 12:57:17 -08:00
installation_deployment_postgres_demo.md added a installation manual (postgres demo) (#5855) 2023-04-13 16:08:45 -07:00
LICENSE OpenMetadata snapshot release 0.3 2021-08-01 14:27:44 -07:00
Makefile [Proposal] Playwright CI (#13248) 2023-09-19 14:44:36 +02:00
NOTICE OpenMetadata snapshot release 0.3 2021-08-01 14:27:44 -07:00
package.json Fix OpenMetadata schema to TypeScript generation (#12335) 2023-07-09 21:12:46 -07:00
pom.xml Update dependencies (#13158) 2023-09-12 15:48:33 -07:00
README.md [Docs] - Fix readme image paths (#13165) 2023-09-13 08:04:53 +02:00
SECURITY.md Connection Doc modifications - mysql, postgres & Mysql E2E fix (#12193) 2023-06-28 13:48:10 +05:30
yarn.lock Bump semver from 5.7.1 to 5.7.2 (#12362) 2023-07-12 11:12:55 +05:30

OpenMetadata

Build Status Quality Gate Status Release GitHub commit activity Twitter Follow Join us on Slack License openmetadata

What is OpenMetadata?

OpenMetadata is an all-in-one platform for data discovery, data lineage, data quality, observability, governance, and team collaboration. It is one of the fastest growing open-source projects with a vibrant community and adoption by a diverse set of companies in a variety of industry verticals. Powered by a centralized metadata store based on Open Metadata Standards/APIs, supporting connectors to a wide range of data services, OpenMetadata enables end-to-end metadata management, giving you the freedom to unlock the value of your data assets.

OpenMetadata includes the following:

  • Metadata Schemas - Defines core abstractions and vocabulary for metadata with schemas for Types, Entities, and Relationships between entities. This is the foundation of the Open Metadata Standard. Also supports the extensibility of entities and types with custom properties.

  • Metadata Store - Stores metadata graph that connects data assets, user, and tool-generated metadata.

  • Metadata APIs - For producing and consuming metadata built on schemas for User Interfaces and Integration of tools, systems, and services.

  • Ingestion Framework - A pluggable framework for integrating tools and ingesting metadata to the metadata store, supporting about 55 connectors. The ingestion framework supports well know data warehouses like Google BigQuery, Snowflake, Amazon Redshift, and Apache Hive; databases like MySQL, Postgres, Oracle, and MSSQL; dashboard services like Tableau, Superset, and Metabase; messaging services like Kafka, Redpanda; and pipeline services like Airflow, Glue, Fivetran, Dagster, and many more.

  • OpenMetadata User Interface - A single place for users to discover and collaborate on all data.

Features

Here are some of the supported features in a nutshell:

  • Data Collaboration - Get event notifications with Activity feeds. Send alerts & notifications using webhooks. Add Announcements to notify the team of upcoming changes. Add Tasks to request descriptions or glossary term approval workflows. Add user mentions and collaborate using conversation threads.

  • Data Quality and Profiler - Standardized tests and data quality metadata. Groups related tests as Test Suites. Supports custom SQL data quality tests. Has an interactive dashboard to drill down to the details.

  • Data Lineage - Supports rich column-level lineage. Effectively filters queries to extract lineage. Edit lineage manually as required and connect the entities with a no-code editor.

  • Comprehensive Roles and Policies - Handles complex access control use cases and hierarchical teams.

  • Webhooks - Supports webhook integrations. Integrate with Slack, Microsoft Teams and Google Chat.

  • Connectors - Supports 55 connectors to various databases, dashboards, pipelines, and messaging services.

  • Glossary - Add a Controlled Vocabulary to describe important concepts and terminologies within your organization. Add Glossaries, Terms, Tags, Descriptions, and Reviewers.

  • Data Security - Supports Google, Okta, custom OIDC, Auth0, Azure, Amazon Cognito, and OneLogin as identity providers for SSO. Also, supports SAML-based authentication for AWS SSO and Google.

  • Secrets Manager Interface - Communicates with any key management store.

  • And lots more...

Check out for more here

Try our Sandbox

Take a look and play with sample data at http://sandbox.open-metadata.org

Install and Run OpenMetadata

Get up and running in a few minutes. See the OpenMetadata documentation for installation instructions.

Documentation and Support

Check out OpenMetadata documentation for a complete description of OpenMetadata's features.

Join our Slack Community to get in touch with us, want to chat, need help, or want to discuss about a new feature requirement.

Or join the group at https://groups.google.com/g/openmetadata-users

We're here to help and make OpenMetadata even better!

Contributors

We ❤️ all contributions, big and small! Check out our CONTRIBUTING guide to get started and let us know how we can help.

Don't want to miss anything? Give the project a 🚀

A HUGE THANK YOU to all our supporters!

Stargazers repo roster for @open-metadata/OpenMetadata

License

OpenMetadata is released under Apache License, Version 2.0