Commit graph

298 commits

Author SHA1 Message Date
Pere Miquel Brull
d1cc3e880c
Fix e2e test and add slack alert (#8817)
* Fix mysql test

* Run alarm on failed test

* Force failure for testing
2022-11-16 17:43:48 +01:00
Pere Miquel Brull
c2983e8606
Trigger maven and py-tests on all PRs (#8791) 2022-11-16 08:48:55 +01:00
Pere Miquel Brull
11ad9192a4
Fix CI condition for gatekeeping (#8769) 2022-11-15 17:37:30 +01:00
Akash Jain
fb8cfca6af
Run Maven CI on JSON Schema Changes (#8748) 2022-11-15 16:06:25 +05:30
Pere Miquel Brull
34ba9d95c5
Ingestion Pipeline deployed, Athena tests and pydantic extras (#8682)
* Always run python tests

* Fix athena tests and types

* Update deployed prop in IngestionPipeline

* Fix #8554

* Format

* Use true as default deployed migration

* Remove repeated req

* Pydantic wiggle room
2022-11-13 11:59:43 +01:00
Pere Miquel Brull
dae85e92bd
Do not check labels on push (#8672) 2022-11-11 12:13:23 +01:00
Pere Miquel Brull
03c1c005cf
Add Workflow label verification for CI (#8653)
* Add labeler

* Update verify with comment

* Add label verification

* Add label verification

* Update .github/teams.yml
2022-11-11 11:25:59 +01:00
Pere Miquel Brull
3e3cf971c2
Add maven CI permissions (#8646) 2022-11-10 13:32:17 +01:00
Pere Miquel Brull
d5ac72c591
Revert "Add PR approval wait (#8640)" (#8644)
This reverts commit cc2973e61c.
2022-11-10 11:21:59 +01:00
Pere Miquel Brull
cc2973e61c
Add PR approval wait (#8640) 2022-11-10 10:53:48 +01:00
Pere Miquel Brull
33b395a6f7
Remove approval check (#8637) 2022-11-10 09:19:04 +01:00
Pere Miquel Brull
f7cdd31a15
Fix Workflows approval permissions (#8636)
* Add permissions and approval flow

* Approval fmt
2022-11-10 09:12:56 +01:00
Pere Miquel Brull
8a73d7e855
Add permissions and approval flow (#8625) 2022-11-10 09:03:08 +01:00
Pere Miquel Brull
acac1c1dcc
Java checkstyle add missing ref (#8622)
* Add approval workflow

* Add approval workflow

* Add java checkstyle ref

* Remove depth
2022-11-09 17:34:45 +01:00
Pere Miquel Brull
a45728cf02
Add approval CI workflow (#8620)
* Add approval workflow

* Add approval workflow
2022-11-09 16:47:27 +01:00
Pere Miquel Brull
f064ab1e89
Test Java checkstyle pull request write (#8616)
* Test PR write permissions

* Test PR write permissions
2022-11-09 16:18:43 +01:00
Pere Miquel Brull
7b2d224b2d
Test PR write permissions (#8615) 2022-11-09 16:17:30 +01:00
Pere Miquel Brull
ccf16cbfac
Fix permissions (#8614) 2022-11-09 16:07:06 +01:00
Pere Miquel Brull
c07f636e88
Test workflow permissions fix syntax (#8613)
* Test workflow permissions

* Fix permissions
2022-11-09 16:02:54 +01:00
Pere Miquel Brull
09ac3be112
Test workflow permissions (#8611) 2022-11-09 15:53:10 +01:00
Nahuel
6e1f4fdd92
Schedule security scan every Monday midnight (#8558) 2022-11-07 15:01:01 +01:00
Nahuel
dae7f8c5b4
Update py-test workflow (#8394) 2022-10-27 17:43:35 +02:00
Nahuel
e277392124
Fix sonar cloud python coverage (#8386) 2022-10-27 16:18:57 +02:00
Vj-L
693579c2fc
Updated the tags (#8266) 2022-10-19 21:29:50 +05:30
Akash Jain
3774f31ac4
fix: Conditions and missing packages for Release process (#8262) 2022-10-19 20:50:22 +05:30
Nahuel
37f06034dd
Sonar coverage test run only for Python 3.9 (#8151) 2022-10-14 17:39:29 +02:00
Nahuel
b69581299f
Fix SonarCloud coverage for Python code (#8144) 2022-10-14 15:17:40 +02:00
Pere Miquel Brull
2f9dd10a25
Allow manual image pushing (#8073) 2022-10-11 12:39:47 +05:30
Pere Miquel Brull
339abc5bf3
Prepare Ingestion Base Docker image (#8065)
Prepare Ingestion Base Docker image (#8065)
2022-10-11 07:50:49 +02:00
Nahuel
37105e09df
Add CLI e2e tests workflow dispatch (#8053)
* Add CLI E2E tests for MySQL

* Fix setup.py and pylint

* Add missing doc and update code after pylint refactor

* Add manual trigger for py-cli-e2e-tests GH action
2022-10-10 11:50:20 +02:00
Nahuel
5c499d2a7a
Add CLI E2E tests for MySQL (#8041)
* Add CLI E2E tests for MySQL

* Fix setup.py and pylint

* Add missing doc and update code after pylint refactor
2022-10-10 11:36:20 +02:00
Nahuel
7358c14906
Doc: Add missing docs for Bots configuration (#7958)
* Add missing docs for Bots configuration

* Remove unused images
2022-10-07 12:47:43 +02:00
Ashok Mokshagundam
23f6e18a17
Running All the CI workflows on Release branches along with main branch (#7691)
* Update airflow-apis-tests-3_9.yml

Updated workflows to run on main branch and also on all release branches

* Update cypress-integration-tests-mysql.yml

Updated workflows to run on main branch and also on all release branches

* Update cypress-integration-tests-postgresql.yml

Updated workflows to run on main branch and also on all release branches

* Update docs-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update java-checkstyle.yml

Updated workflows to run on main branch and also on all release branches

* Update maven-build.yml

Updated workflows to run on main branch and also on all release branches

* Update openmetadata-ingestion-core-version-comment.yml

Updated workflows to run on main branch and also on all release branches

* Update py-checkstyle.yml

Updated workflows to run on main branch and also on all release branches

* Update py-generate.yml

Updated workflows to run on main branch and also on all release branche

* Update py-ingestion-core-publish.yml

Updated workflows to run on main branch and also on all release branches

* Update py-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update selenium-noIngestion-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update sync-docs.yml

Updated workflows to run on main branch and also on all release branches

* Update yarn-coverage.yml

Updated workflows to run on main branch and also on all release branches

* Update airflow-apis-tests-3_9.yml

Updated workflows to run on main branch and also on all release branches

* Update cypress-integration-tests-mysql.yml

Updated workflows to run on main branch and also on all release branches

* Update cypress-integration-tests-postgresql.yml

Updated workflows to run on main branch and also on all release branches

* Update docs-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update java-checkstyle.yml

Updated workflows to run on main branch and also on all release branches

* Update maven-build.yml

Updated workflows to run on main branch and also on all release branches

* Update openmetadata-ingestion-core-version-comment.yml

Updated workflows to run on main branch and also on all release branches

* Update py-checkstyle.yml

Updated workflows to run on main branch and also on all release branches

* Update py-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update selenium-noIngestion-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update sync-docs.yml

Updated workflows to run on main branch and also on all release branches
2022-09-26 16:47:35 +05:30
Shailesh Parmar
7cb23e3f89
Fixed issue where Cypress is not running properly in PR (#7687) 2022-09-23 19:11:01 +05:30
Shailesh Parmar
6c07a4ffbf
Added group name in cypress config yaml (#7667) 2022-09-22 21:07:29 +05:30
Akash Jain
169ad3c687
split cypress integrations tests to mysql and psql CI (#7665) 2022-09-22 19:10:00 +05:30
Mayur Singal
680a186209
Added Exception Handling for Bigquery Tags & Fix py-test CI (#7649) 2022-09-22 14:08:04 +05:30
Shailesh Parmar
e02cc31010
Fixed mysql and data quality cypress is failing in postgresql db docker #7638 (#7639)
* Fixed mysql and data quality cypress is failing in postgresql db docker #7638

* addressing comment
2022-09-21 22:25:33 +05:30
Ashok Mokshagundam
0b0d1c51d9
Merging PyTests with Github Actions CI with matrix strategy into a single file (#7628)
* Delete py-tests-3_10.yml

Merging PyTests with Github Actions CI with matrix strategy into a single file #7355

* Delete py-tests-3_8.yml

Merging PyTests with Github Actions CI with matrix strategy into a single file #7355

* Delete py-tests-3_9.yml

Merging PyTests with Github Actions CI with matrix strategy into a single file #7355

* Merging PyTest files into a single file

Merging PyTests with Github Actions CI with matrix strategy into a single file #7355
2022-09-21 17:51:39 +05:30
Akash Jain
bb66105545
Added matrix to run cypress integrations tests with postgresql (#7594) 2022-09-21 10:57:11 +05:30
Akash Jain
fc8312c5fb
feat: Refactor openmetadata/ingestion docker image (#7456)
* centralize openmetadata/ingestion docker image

* update volume mappings; fix ingestion tag!

* fix PR comments

* fix cypress mysql tests!
2022-09-19 09:20:54 +05:30
Sriharsha Chintalapani
656b50dd3a
Fix #7469: Refactor OpenMetadata code modules (#7474) 2022-09-14 23:14:02 -07:00
Shailesh Parmar
3e81bd0df0
Fix #7400 UI : Upgrade cypress version to 10.7.0 (#7423)
Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
2022-09-13 11:59:20 -07:00
Akash Jain
f2fc45ea41
feat: prepare-for-next-release-0-13-0 (#7348) 2022-09-09 01:25:41 +05:30
Mayur Singal
3c1c93c842
Replace Sample Data with Mysql in CI (#7346) 2022-09-08 22:52:25 +05:30
Onkar Ravgan
9833578064
Remove airflow dependency git workflow (#7340)
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-08 19:32:16 +05:30
Nahuel
ed58c27f76
Remove unused property extra_hosts from docker-compose files (#7096)
* Remove unused properties from docker-compose files

* Minor fix in run_local_docker script
2022-08-31 21:30:24 +02:00
Pere Miquel Brull
2238bc2466
Do not push ingestion dir (#7008) 2022-08-29 14:20:32 +02:00
Ayush Shah
f8e8d2f7ab
Modfied github workflow, fix antrl4 not found (#6839) 2022-08-22 15:56:43 +05:30
Ayush Shah
3d4684c60b
Change installation of antlr (#6774) 2022-08-18 17:34:58 +05:30
Ayush Shah
a3dfde97ce
Fix Indentation for Yarn Coverage (#6769) 2022-08-17 19:53:42 +05:30
Ayush Shah
e1799e47d4
Add Antlr support in workflows (#6757) 2022-08-17 14:37:23 +05:30
Nahuel
e321008cd0
Snyk report uploaded as HTML files (#6674) 2022-08-09 21:54:08 +02:00
Vj-L
e4aa443b65
Added new workflow for postgres package (#6646)
Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-08-09 19:17:13 +05:30
Nahuel
cfc3568c19
Fix: wrong sed command in Airflow APIs test GH workflow (#6510) 2022-08-02 14:15:03 +02:00
Nahuel
550b4645cf
Do 'mvn clean install' when running security-scan GH workflow (#6492) 2022-08-01 16:04:35 -07:00
Pere Miquel Brull
f8f9836a77
Fix snyk workflow (#6422)
Fix snyk workflow (#6422)
2022-07-29 08:02:31 +02:00
Pere Miquel Brull
824d05ac84
Install deps (#6419) 2022-07-29 07:06:06 +02:00
Pere Miquel Brull
ea918495ff
Fix #6382 - Snyk workflows (#6413)
Fix #6382 - Snyk workflows (#6413)
2022-07-28 23:06:33 +02:00
Nahuel
30ff470922
Reduce the CI times for py-tests (#6352)
* Testing if we can reduce the CI times

* Update POM and run_local_docker script
2022-07-26 17:47:03 +02:00
Pere Miquel Brull
f97902392d
Add install_all (#6246) 2022-07-21 16:51:46 +02:00
Pere Miquel Brull
385b7edac9
Prepare CI for Airflow APIs (#6240)
Prepare CI for Airflow APIs (#6240)
2022-07-21 12:29:57 +02:00
Rabi Narayan Sahoo
0190456f3d
Removed test environment (#6214) 2022-07-20 14:47:56 +05:30
Nahuel
dfb017008b
Fix missing SonarCloud decorator in PR when triggering GH workflow for py3.9 (#6220) 2022-07-20 10:28:18 +02:00
Nahuel
f0aab78295
Fix workflow GH for py3.9 (#6198) 2022-07-20 07:07:04 +02:00
Nahuel
ee21d6b10e
Fix error in workflow YAML file and update ingestion-core version (#6193) 2022-07-19 15:41:21 +02:00
Nahuel
0602e8c894
Fix#5924: Implement secret manager for Airflow REST Plugin (#6128)
Fix#5924: Implement secret manager for Airflow REST Plugin (#6128)
2022-07-19 14:51:44 +02:00
Pere Miquel Brull
0793e69752
Fix automated schema generation & Add Docs CI (#6084)
Fix automated schema generation & Add Docs CI (#6084)
2022-07-14 14:13:00 +02:00
Pere Miquel Brull
3e8f3d1b7c
Always trigger py ci (#6075) 2022-07-14 08:28:03 +02:00
Akash Jain
2258a7d737
fix: add quotes; fix make recipes call generate (#6073) 2022-07-14 10:13:49 +05:30
Pere Miquel Brull
d19ec6f43d
Update cypress CI timeout (#6046) 2022-07-12 16:04:13 +02:00
Vj-L
845ab4f7f4
Fix inputvariables (#5961)
* Updated the input variable in workflows

* Updated the input variables

* Revert the change of ingestion python script

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-07-08 15:53:46 +05:30
Pere Miquel Brull
44fa4712d7
Update python CI order (#5934) 2022-07-07 18:40:04 +02:00
Rabi Narayan Sahoo
d3e91a87c1
[Fix] - Publish python package 2022-07-01 01:22:30 -07:00
Pere Miquel Brull
e580af1143
Docs Sync CI - Add on-demand trigger (#5695)
* Add on-demand trigger

* Add doc request template
2022-06-30 10:39:37 +02:00
Rabi Narayan Sahoo
65a3872173
[Issue - 5426] Automatically publish openmetadata-airflow-apis (#5698)
Co-authored-by: Rabi Narayan Sahoo <106670146+Robby30ies@users.noreply.github.com>
2022-06-28 18:37:32 +05:30
Pere Miquel Brull
aba8a0e5f3
Fix docs sync CI with key (#5668)
Fix docs sync CI with key (#5668)
2022-06-27 15:42:54 +02:00
Pere Miquel Brull
1d369c47bd
Update docs and CI (#5666) 2022-06-27 15:29:13 +02:00
Pere Miquel Brull
0bb246dadb
Init docs and documentation sync CI (#5662)
* Prep docs migration

* Fix destination username
2022-06-27 15:14:04 +02:00
Rabi Narayan Sahoo
049e4a5a91
[Issue - 5027] Removed input tag. (#5655) 2022-06-27 14:27:10 +05:30
Rabi Narayan Sahoo
3e18f842e1
[Issue-5029] Added manual trigger and input tag. (#5623) 2022-06-24 18:37:42 +05:30
Vivek Ratnavel Subramanian
84a28ea78f
Cypress: Change Cypress browser to Chrome (#5383) 2022-06-08 16:54:51 -07:00
yug-shah0106
ce8a317059
Fix #5348 UI: css fix (#5378)
Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
2022-06-08 16:20:22 -07:00
Vivek Ratnavel Subramanian
0148aed710
Fix Cypress test failures (#5351)
* Fix Cypress test failures

* addendum fixes

* increase wait time for follow

* fixed failing cypress test

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-06-08 17:20:07 +05:30
Pere Miquel Brull
f121698d96
generate models (#5288) 2022-06-03 12:07:31 +02:00
Pere Miquel Brull
8fbac82196
Sonar Base Path (#5189) 2022-05-27 13:31:10 +02:00
Pere Miquel Brull
aec9ba2ddb
Sonar Project Settings (#5183) 2022-05-27 10:35:52 +02:00
Pere Miquel Brull
4bbe4ef63d
fix unshallow (#5180) 2022-05-27 10:09:42 +02:00
Pere Miquel Brull
04ede3b05b
Fix #3395 - Profiler linting (#5177)
Fix #3395 - Profiler linting (#5177)
2022-05-27 09:50:08 +02:00
Pere Miquel Brull
02c2dd9494
Fix #4689 - Rename FQDN to FQN and clean unused code (#5165) 2022-05-26 21:00:18 +02:00
Pere Miquel Brull
35e67890b8
Fix #5141 - Iterate over all Entities in the profiler workflow (#5146)
Fix #5141 - Iterate over all Entities in the profiler workflow (#5146)
2022-05-26 07:35:23 +02:00
Pere Miquel Brull
7310dda620
Remove pom from python GHA (#5147)
Remove pom from python GHA  (#5147)
2022-05-25 16:30:08 +02:00
Pere Miquel Brull
ecbedf521a
Test GA Sonar with updated projectBaseDir (#5145)
Test GA Sonar with updated projectBaseDir (#5145)
2022-05-25 15:35:06 +02:00
Pere Miquel Brull
a26d1b15a2
Use GA for sonar (#5142) 2022-05-25 14:40:07 +02:00
Vivek Ratnavel Subramanian
ee05e33bc9
Cypress: workflow should run only with a 'safe to test' label (#5109) 2022-05-23 20:21:12 -07:00
Vivek Ratnavel Subramanian
9035762362
Cypress: Fix workflow (#5105) 2022-05-23 22:27:40 +02:00
Ayush Shah
e54ef3f83e
Fixes concurrent memory consumption (#5096) 2022-05-23 19:41:50 +05:30
Pere Miquel Brull
3de705c912
Add antlr install for cypress CI (#5094) 2022-05-23 09:59:55 +02:00
Pere Miquel Brull
cd35447792
Fix #4688 - Python FQN with ANTRL & ES (#5073)
Fix #4688 - Python FQN with ANTRL & ES (#5073)
2022-05-23 09:51:34 +02:00
Vivek Ratnavel Subramanian
ec755f1187
Cypress: Enable chrome instead of Electron (#5086) 2022-05-21 01:27:57 -07:00
Vivek Ratnavel Subramanian
0b713f37bf
Revert "Cypress: Use Chrome headless instead of electron (#5084)" (#5085)
This reverts commit ab1876c551.
2022-05-21 00:18:26 -07:00
Vivek Ratnavel Subramanian
ab1876c551
Cypress: Use Chrome headless instead of electron (#5084) 2022-05-21 00:07:05 -07:00
Shailesh Parmar
8be4507006
Fix: Cypress failing tests (#5078) 2022-05-20 14:33:55 -07:00
Vivek Ratnavel Subramanian
7c07391c06
Cypress: Fix any flakiness and add Kafka schema registry url (#5063) 2022-05-20 01:20:50 -07:00
Ayush Shah
b6fc33cda2
Fix compatibility issue with get_args (#5012) 2022-05-18 10:55:39 +05:30
Ayush Shah
93c32ad801
Removed Ingestion Core dependency (#5006) 2022-05-18 00:01:20 +05:30
Ayush Shah
a74047c8a0
Modified workflows and ingestion-core package (#5005) 2022-05-17 21:46:49 +05:30
Ayush Shah
8cc91c3405
Modified Ingestion to support 3.6 and later (#5003) 2022-05-17 21:38:57 +05:30
Vivek Ratnavel Subramanian
d3c7330692
Cypress: Add Kafka, Metabase, Superset, and Glue (#4955) 2022-05-14 15:44:02 -07:00
HabibRahman
cfab77c854
Issue-4790 (#4800) 2022-05-13 14:26:10 +05:30
Vivek Ratnavel Subramanian
2a380c39d3
Cypress: Add Bigquery and Redshift ingestions (#4903) 2022-05-11 23:35:13 -07:00
Vivek Ratnavel Subramanian
af8b95091a
Cypress Integration (#4859) 2022-05-10 22:47:04 -07:00
Akash Jain
18194e374e
Docker image and CI for Airflow Image (#4791) 2022-05-09 14:09:46 +02:00
Pere Miquel Brull
8aa88b1efc
Fix #4636 - CLI: Remove --skip-sample-data and add --ingest-sample-data (#4646) 2022-05-03 18:54:43 -07:00
Pere Miquel Brull
5751b8d75f
Issue template roadmap (#4625)
* Check project label

* Check project label

* Add GA to add issue to roadmap

* Add roadmap url
2022-05-02 16:56:31 +02:00
Akash Jain
792c67a8f1
Arguments to provide ingestion depenedency. defaults to 'all' (#4613) 2022-05-02 16:09:44 +05:30
Akash Jain
81dc942370
fix: CI for Maven Builds on main branch (#4592) 2022-04-29 14:01:42 +02:00
Sriharsha Chintalapani
cf3fc89c27
Add test container reuse for github workflows (#4563) 2022-04-28 00:17:32 -07:00
Akash Jain
55e1be9ca4
feat: Prepare 0.11.0-snapshot version changes (#4505)
* updated version to 0.11.0-SNAPSHOT

* updated version to 0.11.0.dev* for ingestion

* docker version updates for metadata docker cli

* OM Server Env Variables from #4197 #4261 #4473
2022-04-27 00:41:17 +05:30
Vj-L
869a4a193f
Issue1421 (#4092) 2022-04-19 11:43:08 +05:30
Pere Miquel Brull
63da7c7556
Fix install (#4139) 2022-04-14 11:54:02 +02:00
Pere Miquel Brull
21f84b3f42
Prepare ingestion release workflow (#4127)
* Prepare ingestion release workflow

* Use manual trigger
2022-04-14 11:33:17 +02:00
Alberto Miorin
735cc54614
Bump nodejs to 16.x (#4132) 2022-04-14 14:39:19 +05:30
Akash Jain
954bbca383
fix: Ability to run CI from forked Repository (#3874)
* Ability to run CI from forked Repository

* Update yarn-coverage.yml
2022-04-06 11:34:03 +05:30
Akash Jain
f410a1b563
fix:SonarCloud UI builds on main branch (#3795) 2022-04-01 12:26:42 +05:30
Akash Jain
4e1b44d696
feat: Add Workflow CI for SonarCloud OpenMetadata UI (#3708)
* Adding Workflow CI for SonarCloud OpenMetadata UI

* Adding sonar project properties and reporter for UI

* Added mock and test exclusions

* Minor changes

* fix node version to 12.x in CI

* Test CI workflow

* fixed syntax

* remove yarn caching

* test docker on steps

* remove jobs container

* test out args

* update path

* check with yarn

* fix typo

* fix typo

* fix typo

* fix typo

* use npm -g command

* removed project base dir

Co-authored-by: darth-coder00 <aashit@getcollate.io>
2022-04-01 10:31:45 +05:30
Ayush Shah
2eccd711f1
Modifying Timeout for PyTests (#3587)
Tests are failing because of timeout being too near to the threshold
2022-03-22 18:37:30 +05:30
codingwithabhi
ccb96b3ea7
makefile-updated-to-install-all-packages-for-unittest (#3550) 2022-03-21 16:02:34 +05:30
Akash Jain
211a8a55e8
feat: Prepare 0.9.1-SNAPSHOT (#3297)
* prepare snapshot version for 0.9.1

* prepare dev version for ingestion 0.9.1

* prepare dev version for ingestion-core 0.9.1

* prepare Docker CI workflows for 0.9.1
2022-03-09 12:08:42 +05:30
Matt
09082ec988
Publish mvn test report to PR (#3135) 2022-03-03 23:08:47 -08:00
Matt
6cdd90f7b2
Add mvn test report publish (#3086) 2022-03-03 22:24:08 -08:00
Pere Miquel Brull
e96ac838ff
Fix #3084 - Implement missing tests (#3117)
Fix #3084 - Implement missing tests
2022-03-04 06:59:47 +01:00
Pere Miquel Brull
6ea6f0c43d
Fix #2383 - Multiple validation workflows (#2500)
* Clean duplicated validation

* Move black dep to dev

* Fix black version for ingestion core

* Validate core generated in the same workflow
2022-01-30 12:26:41 -08:00
Pere Miquel Brull
548a82aa22
[issue-2384] - Entity version return body (#2428) 2022-01-25 11:18:24 -08:00
Pere Miquel Brull
b39b698eb7
Fix #2345 - Make bump & unify (#2359)
* Add installing instructions

* Unify makefile and automate bump version setup

* Update submake call

* Mark targets as phony

* Add help to recipes

* Update core publish

* Do not trigger install from echo

* Run make from root

* Prepare py_format from isort and black

* Run py_format

* Check black and isort formatting

* Update comment msg
2022-01-23 09:47:06 -08:00
Pere Miquel Brull
1eb3f1ad41
[issue-2322] - Backup CLI (#2349)
* Prepare cli module

* Check call

* Prepare backup

* Run pytest on schema changes

* Remove traces

* Add backup plugin

* run generate during CI

* Install after generate

* Address logger hotspot
2022-01-22 12:08:14 -08:00
Pere Miquel Brull
6693b4ae40
[issue-2262] - Simplify sample data DAG (#2337)
* Simplify sample data DAG

* Remove mkdir

* Generate sources before running compose

* Generate sources to install models to ingestion image

* Add python-on-whales for docker --start

* Remove python-on-whales from base

* Install venv

* Setup python
2022-01-22 16:37:56 +05:30
Matt
2d44e11f8a
Update py-ingestion-core version control and publish workflows (#2330) 2022-01-21 08:58:24 -08:00
Pere Miquel Brull
979bad18d9
Update python checkstyle (#2315) 2022-01-20 16:18:18 -08:00
Akash Jain
14c7ae4af5
Run ingestion-core publish on version bump (#2273)
Ability to run ingestion-core publish on version bump as well.
2022-01-19 11:39:02 +05:30
Pere Miquel Brull
de3b3e4abc
[issue-2239] - Update core publish to push (#2240)
* Update core publish to push

* Rename jobs to be py explicit

* Upload to testpypi
2022-01-17 10:29:55 -08:00
Akash Jain
6350cbb68b
CI for py-ingestion-core comment workflow (#2252)
Part 1 of the py-ingestion-publish CI revamp. This will comment on PR's opened with schema changes and let the Pull requestor notify of version bump to publish dev package in test.pypi.org. See #2239  and #2240 for reference.
2022-01-17 20:35:45 +05:30
Pere Miquel Brull
9194b8e4ba
[issue-2108] - Fix PR base and add repo slug (#2109)
* Fix PR base and add repo slug

* Add SCM revision
2022-01-08 13:13:24 +01:00
Pere Miquel Brull
74e9038b92
[issue-997] - More pylint fixes (#2107)
* Update naming and disable false positives

* Rename for naming convention

* Fix linting issues

* Moved pylint to pylintrc

* Moved pylint to pylintrc

* Rename CI

* Check sonar properties

* Fix pull_request_target checkout
2022-01-07 19:50:53 +01:00
Pere Miquel Brull
48ebcffbd0
[issue-1976] - Ingestion SonarCloud (#2085)
* Update path

* Prepare sonar properties

* Prepare coverage recipes

* Add coverage

* Simplify pytest

* Organise integration tests

* Update path

* Use setup instead of reqs

* Update recipes

* Fix PR event to target

* Update event_name

* Prepare sonar

* Run tests & sonar

* Use sonarcloud host

* Fix compose

* Use ingestion token
2022-01-07 10:28:38 +01:00
Alberto Miorin
dd813a28f0
Fix #2088, fix #2089: Java checkstyle must run always AND Better naming for Github Actions Job names (#2090) 2022-01-07 05:04:29 +01:00
Alberto Miorin
51c1228b2a
Fix #2064: Use pull_request_target in java checkstyle (#2070) 2022-01-06 11:13:54 +01:00
Alberto Miorin
57b0da7acc
Fix #2060: java-checkstyle is not working anymore (#2061) 2022-01-05 20:10:37 -08:00
Alberto Miorin
34d8664693
Fix #2038: Fix Java style tooling support for good (#2051) 2022-01-05 20:18:28 +01:00
Akash Jain
5685efd651
feat: openmetadata-ingestion-core pypi publish dev packages (#2023)
* update requirements-dev.txt

* integrate pypi incremental

* Add CI for #1875

* gitignore generated dir in ingestion-core

* update version to match ingestion package
2022-01-04 21:11:33 -08:00