WITSML Parser merge requestshttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests2023-06-27T10:55:49Zhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/125GONGR-7357-Refactor names in pipelines2023-06-27T10:55:49ZAndriy Halka [EPAM / GCP]GONGR-7357-Refactor names in pipelinesM19 - Release 0.22https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/122Cherry-pick 'Update cicd variables' into release/0.212023-05-22T21:48:03ZChad LeongCherry-pick 'Update cicd variables' into release/0.21**Original MR**: !121
### This MR is a Cherry Pick into a Release Branch.
After the release branch is first created, any subsequent changes use this process to update the release (often resulting in a new patch tag) without incorporati...**Original MR**: !121
### This MR is a Cherry Pick into a Release Branch.
After the release branch is first created, any subsequent changes use this process to update the release (often resulting in a new patch tag) without incorporating all changes in the default branch.
These MRs must be approved by the PMC before they are merged, since they alter the scope of the release.
To see more details about the change itself, look at the Original MR listed above.
#### Skipped Pipeline
Normally, pipelines are not executed on the cherry pick branch/MR prior to merging.
This optimization is accepted because the code was tested when it merged into the default branch, and will be tested again in the release branch prior to tagging.
However, if anybody feels that the MR requires further scrutiny -- whether because it had conflicts in the cherry-picking, it interfaces with some drastically altered logic between the branches, or any other reason -- we can run the pipeline here prior to merging.
#### If There's Reason to Run a Pipeline
If you want to see a pipeline result before this merges, first add a comment explaining why you'd like to see the pipeline results so the PMC and others know your thinking.
Then, mark the MR as a Draft MR (using the vertical ellipsis above, choose 'Mark as Draft').
This prevents the MR from being approved & merged accidentally by a busy release coordinator who didn't see your comment.
Finally, if you are a maintainer on the project, launch a pipeline on this branch.
Since this branch is a protected branch and the MR has ~no-detached-pipeline set, all integration tests will run and there's no need for any `trusted-*` branches.
[Launch a Pipeline for this Branch](https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/pipelines/new?ref=cherry-pick-for-121)M18 - Release 0.21David Diederichd.diederich@opengroup.orgChad LeongSrinivasan NarayananDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/121Update cicd variables2023-05-22T21:21:21ZAbhishek PatilUpdate cicd variablesUpdate cicd variablesUpdate cicd variablesM18 - Release 0.21Okoun-Ola Fabien HouetoAbhishek PatilOkoun-Ola Fabien Houetohttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/120fix: update aws build2023-05-19T18:55:03ZLong Chengfix: update aws buildM18 - Release 0.21Bill WangBill Wanghttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/119GONRG-7029: update anthos to baremetal2023-05-19T09:03:16ZYauheni Rykhter (EPAM)GONRG-7029: update anthos to baremetalM18 - Release 0.21Yauheni Rykhter (EPAM)Yauheni Rykhter (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/117Cherry-pick 'Merge branch 'master' of...' into release/0.202023-04-10T19:49:37ZDavid Diederichd.diederich@opengroup.orgCherry-pick 'Merge branch 'master' of...' into release/0.20**Original MR**: !116
### This MR is a Cherry Pick into a Release Branch.
After the release branch is first created, any subsequent changes use this process to update the release (often resulting in a new patch tag) without incorporati...**Original MR**: !116
### This MR is a Cherry Pick into a Release Branch.
After the release branch is first created, any subsequent changes use this process to update the release (often resulting in a new patch tag) without incorporating all changes in the default branch.
These MRs must be approved by the PMC before they are merged, since they alter the scope of the release.
To see more details about the change itself, look at the Original MR listed above.
#### Skipped Pipeline
Normally, pipelines are not executed on the cherry pick branch/MR prior to merging.
This optimization is accepted because the code was tested when it merged into the default branch, and will be tested again in the release branch prior to tagging.
However, if anybody feels that the MR requires further scrutiny -- whether because it had conflicts in the cherry-picking, it interfaces with some drastically altered logic between the branches, or any other reason -- we can run the pipeline here prior to merging.
#### If There's Reason to Run a Pipeline
If you want to see a pipeline result before this merges, first add a comment explaining why you'd like to see the pipeline results so the PMC and others know your thinking.
Then, mark the MR as a Draft MR (using the vertical ellipsis above, choose 'Mark as Draft').
This prevents the MR from being approved & merged accidentally by a busy release coordinator who didn't see your comment.
Finally, if you are a maintainer on the project, launch a pipeline on this branch.
Since this branch is a protected branch and the MR has ~no-detached-pipeline set, all integration tests will run and there's no need for any `trusted-*` branches.
[Launch a Pipeline for this Branch](https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/pipelines/new?ref=cherry-pick-for-116)M17 - Release 0.20David Diederichd.diederich@opengroup.orgChad LeongSrinivasan NarayananDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/116Merge branch 'master' of...2023-04-10T19:35:43Zetienne peyssonMerge branch 'master' of...Remains a unit test to make sure it worksRemains a unit test to make sure it worksM17 - Release 0.20etienne peyssonetienne peyssonhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/115GONRG-6775: [FIX] Dataset DMS client returns deprecated retrieval instructions2023-03-31T09:57:11ZBohdan Solianyk [EPAM / GCP]bohdan_solianyk@epam.comGONRG-6775: [FIX] Dataset DMS client returns deprecated retrieval instructions# Description:
The MR is needed due to this changes: https://community.opengroup.org/osdu/platform/system/dataset/-/merge_requests/319
To fix this issue `get_retrieval_instructions` deprecated method was replaced with `retrieval_instru...# Description:
The MR is needed due to this changes: https://community.opengroup.org/osdu/platform/system/dataset/-/merge_requests/319
To fix this issue `get_retrieval_instructions` deprecated method was replaced with `retrieval_instructions`
# How to test:
# Changes include:
- [ ] Refactor (a non-breaking change that improves code maintainability).
- [x] Bugfix (a non-breaking change that solves an issue).
- [ ] New feature (a non-breaking change that adds functionality).
- [ ] Breaking change (a change that is not backward-compatible and/or changes current functionality).
# Changes in:
- [ ] GCP
- [ ] Azure
- [ ] AWS
- [ ] IBM
# Dev Checklist:
- [ ] Added Unit Tests, wherever applicable.
- [ ] Updated the Readme, if applicable.
- [ ] Existing Tests pass
- [ ] Verified functionality locally
- [ ] Self Reviewed my code for formatting and complex business logic.
# Other comments:
MR with [removing deprecated functions from DatasetDmsAPI](https://community.opengroup.org/osdu/platform/system/dataset/-/merge_requests/319)M17 - Release 0.20Bohdan Solianyk [EPAM / GCP]bohdan_solianyk@epam.comBohdan Solianyk [EPAM / GCP]bohdan_solianyk@epam.comhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/105fix: updating requests python library2023-03-11T14:41:22ZAbhishek Patilfix: updating requests python libraryM16 - Release 0.19Okoun-Ola Fabien HouetoAbhishek PatilOkoun-Ola Fabien Houetohttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/111Cherry-pick '[GC] Composer 2 support Autopilots' into release/0.192023-02-15T10:31:31ZSrinivasan NarayananCherry-pick '[GC] Composer 2 support Autopilots' into release/0.19**Original MR**: !109
### This MR is a Cherry Pick into a Release Branch.
After the release branch is first created, any subsequent changes use this process to update the release (often resulting in a new patch tag) without incorporati...**Original MR**: !109
### This MR is a Cherry Pick into a Release Branch.
After the release branch is first created, any subsequent changes use this process to update the release (often resulting in a new patch tag) without incorporating all changes in the default branch.
These MRs must be approved by the PMC before they are merged, since they alter the scope of the release.
To see more details about the change itself, look at the Original MR listed above.
#### Skipped Pipeline
Normally, pipelines are not executed on the cherry pick branch/MR prior to merging.
This optimization is accepted because the code was tested when it merged into the default branch, and will be tested again in the release branch prior to tagging.
However, if anybody feels that the MR requires further scrutiny -- whether because it had conflicts in the cherry-picking, it interfaces with some drastically altered logic between the branches, or any other reason -- we can run the pipeline here prior to merging.
#### If There's Reason to Run a Pipeline
If you want to see a pipeline result before this merges, first add a comment explaining why you'd like to see the pipeline results so the PMC and others know your thinking.
Then, mark the MR as a Draft MR (using the vertical ellipsis above, choose 'Mark as Draft').
This prevents the MR from being approved & merged accidentally by a busy release coordinator who didn't see your comment.
Finally, if you are a maintainer on the project, launch a pipeline on this branch.
Since this branch is a protected branch and the MR has ~no-detached-pipeline set, all integration tests will run and there's no need for any `trusted-*` branches.
[Launch a Pipeline for this Branch](https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/pipelines/new?ref=cherry-pick-for-109)M16 - Release 0.19David Diederichd.diederich@opengroup.orgChad LeongSrinivasan NarayananDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/109[GC] Composer 2 support Autopilots2023-02-14T17:45:42ZYan Sushchynski (EPAM)[GC] Composer 2 support AutopilotsGoogle Cloud fix.
Fix issue with k8s namespace in Composer2Google Cloud fix.
Fix issue with k8s namespace in Composer2M16 - Release 0.19Yauheni Rykhter (EPAM)Yauheni Rykhter (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/107Draft: Update requirements.txt2023-02-14T11:23:34ZYan Sushchynski (EPAM)Draft: Update requirements.txthttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/87GONRG-5382: Refactor WITSML parser DAG2023-02-04T05:21:19ZYan Sushchynski (EPAM)GONRG-5382: Refactor WITSML parser DAG## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [x] AWS
- [x] Azure
- [x] GCP
- [x]...## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [x] AWS
- [x] Azure
- [x] GCP
- [x] IBM
## Updates description?
Changes:
- Delete legacy code of uploading xml files via GCP Storage
- Make using osdu_api.ini optional in the WITSML parser image. Now we can use for instantiating Python SDK Clients the following environmental variables:
`STORAGE_SERVICE_URL`, `DATASET_SERVICE_URL`, and `STORAGE_SERVICE_URL`.M16 - Release 0.19https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/106GONRG-6369 - gc rename2023-02-03T13:48:32ZAliaksandr Ramanovich (EPAM)GONRG-6369 - gc renameRename GCP to GC due to global rebrandingRename GCP to GC due to global rebrandingM16 - Release 0.19Aliaksandr Ramanovich (EPAM)Aliaksandr Ramanovich (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/104Merge branch 'GONRG-6172-Fix-Postman-Collection-Url' into 'master'2022-12-21T17:30:22ZDanylo Vanin (EPAM)Merge branch 'GONRG-6172-Fix-Postman-Collection-Url' into 'master'[GONRG-6172] Fixed url encoding for postman in gc pipeline
See merge request osdu/platform/data-flow/ingestion/energistics/witsml-parser!103
(cherry picked from commit 401573c2d7b6e667c92e0428157607c51fa22c7f)
b96b3d34 [GONRG-6172] Fi...[GONRG-6172] Fixed url encoding for postman in gc pipeline
See merge request osdu/platform/data-flow/ingestion/energistics/witsml-parser!103
(cherry picked from commit 401573c2d7b6e667c92e0428157607c51fa22c7f)
b96b3d34 [GONRG-6172] Fixed url encoding for postman in gc pipelineM15 - Release 0.18Oleksandr Kosse (EPAM)Danylo Vanin (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/102Merge branch 'aws-file-dms' into 'master'2022-10-31T19:53:49ZMarc Burnie [AWS]Merge branch 'aws-file-dms' into 'master'Fixing DAG Import Error due to Missing Env Variable
See merge request osdu/platform/data-flow/ingestion/energistics/witsml-parser!101
(cherry picked from commit 687ddc8edceb30829c07df7a71c5fb30b73820b3)
bdc8c2d7 E2E postman test chang...Fixing DAG Import Error due to Missing Env Variable
See merge request osdu/platform/data-flow/ingestion/energistics/witsml-parser!101
(cherry picked from commit 687ddc8edceb30829c07df7a71c5fb30b73820b3)
bdc8c2d7 E2E postman test changes
4002d463 Postman error update
89a3b146 updated pipeline to ref master
462efc7c Merge remote-tracking branch 'origin/master' into...
aa30773d Merge remote-tracking branch 'origin/master' into...
9c3918aa Update osdu-airflow version from 0.14.0 to 0.16.0
edb433da Update osdu-ingestion version from 0.14.0 to 0.16.0
f21c50bd Merge remote-tracking branch 'origin/master' into...
3c8b356a Merge remote-tracking branch 'origin/master' into...
d57058a1 Update osdu-airflow to from 0.16.0 to 0.16.1
380fb895 Squashed commit of the following
d7095190 Merge remote-tracking branch 'origin/master' into...
c68b4be5 Merge remote-tracking branch 'origin/master' into...
ca964449 Merge remote-tracking branch 'origin/master' into...
8d92c9ed remove file dms
7f78cbee stubbing file-dms
4e68734a stubbing file-dms
8ef3576e Merge branch 'dev' of codecommit::us-east-1://osdu-dev@os-energistics-parsers into devM14 - Release 0.17Marc Burnie [AWS]Marc Burnie [AWS]https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/97GONRG-5659: Add versioning to DAGs2022-10-24T10:12:37ZYan Sushchynski (EPAM)GONRG-5659: Add versioning to DAGs## Type of change
- [ ] Bug Fix
- [x] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GCP
- [ ]...## Type of change
- [ ] Bug Fix
- [x] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GCP
- [ ] IBM
## Updates description?
Add versioning for GCP DAGs.M15 - Release 0.18Yan Sushchynski (EPAM)Yan Sushchynski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/96GCP: Use data-partition-id from payload2022-09-26T18:14:11ZYan Sushchynski (EPAM)GCP: Use data-partition-id from payloadM14 - Release 0.17https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/94cherry-pick-d3a3f618 into release/0.162022-08-26T15:09:45ZVadzim Kulybacherry-pick-d3a3f618 into release/0.16feat: upgrade base azure pipeline and added m13 support
- Fixed azure pipeline
- Changed base images to MCR
- Small refactor azure deployment scripts
Origianl MR: https://community.opengroup.org/osdu/platform/data-flow/ingestion/energi...feat: upgrade base azure pipeline and added m13 support
- Fixed azure pipeline
- Changed base images to MCR
- Small refactor azure deployment scripts
Origianl MR: https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/90M13 - Release 0.16David Diederichd.diederich@opengroup.orgVadzim KulybaDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/92Gonrg 5529 ivalid yaml2022-08-26T14:27:16ZMaksimelyan Tamashevich (EPAM)Gonrg 5529 ivalid yamlOleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)