WITSML Parser merge requestshttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests2023-08-18T11:03:40Zhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/32Fixed pipeline logic for preprod env2023-08-18T11:03:40ZOleksii Tsyganov (EPAM)Fixed pipeline logic for preprod envM9 - Release 0.12Oleksii Tsyganov (EPAM)Oleksii Tsyganov (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/10GONRG-2106: Docker image for different providers2021-04-07T13:36:11ZYan Sushchynski (EPAM)GONRG-2106: Docker image for different providersThe main goal of the MR is to create an approach for building WITSML parser image for every coud-provider.The main goal of the MR is to create an approach for building WITSML parser image for every coud-provider.Laurent DenyLaurent Denyhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/8GONRG-1982: Update documentation2023-08-18T11:04:01ZYan Sushchynski (EPAM)GONRG-1982: Update documentationUpdate documentation according to new changes in DAGs.Update documentation according to new changes in DAGs.M5 - Release 0.8Laurent DenyLaurent Denyhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/111Cherry-pick '[GC] Composer 2 support Autopilots' into release/0.192023-02-15T10:31:31ZSrinivasan NarayananCherry-pick '[GC] Composer 2 support Autopilots' into release/0.19**Original MR**: !109
### This MR is a Cherry Pick into a Release Branch.
After the release branch is first created, any subsequent changes use this process to update the release (often resulting in a new patch tag) without incorporati...**Original MR**: !109
### This MR is a Cherry Pick into a Release Branch.
After the release branch is first created, any subsequent changes use this process to update the release (often resulting in a new patch tag) without incorporating all changes in the default branch.
These MRs must be approved by the PMC before they are merged, since they alter the scope of the release.
To see more details about the change itself, look at the Original MR listed above.
#### Skipped Pipeline
Normally, pipelines are not executed on the cherry pick branch/MR prior to merging.
This optimization is accepted because the code was tested when it merged into the default branch, and will be tested again in the release branch prior to tagging.
However, if anybody feels that the MR requires further scrutiny -- whether because it had conflicts in the cherry-picking, it interfaces with some drastically altered logic between the branches, or any other reason -- we can run the pipeline here prior to merging.
#### If There's Reason to Run a Pipeline
If you want to see a pipeline result before this merges, first add a comment explaining why you'd like to see the pipeline results so the PMC and others know your thinking.
Then, mark the MR as a Draft MR (using the vertical ellipsis above, choose 'Mark as Draft').
This prevents the MR from being approved & merged accidentally by a busy release coordinator who didn't see your comment.
Finally, if you are a maintainer on the project, launch a pipeline on this branch.
Since this branch is a protected branch and the MR has ~no-detached-pipeline set, all integration tests will run and there's no need for any `trusted-*` branches.
[Launch a Pipeline for this Branch](https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/pipelines/new?ref=cherry-pick-for-109)M16 - Release 0.19David Diederichd.diederich@opengroup.orgChad LeongSrinivasan NarayananDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/106GONRG-6369 - gc rename2023-02-03T13:48:32ZAliaksandr Ramanovich (EPAM)GONRG-6369 - gc renameRename GCP to GC due to global rebrandingRename GCP to GC due to global rebrandingM16 - Release 0.19Aliaksandr Ramanovich (EPAM)Aliaksandr Ramanovich (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/68[GONRG-4699] Refactor pipeline2023-08-18T11:03:23ZDanylo Vanin (EPAM)[GONRG-4699] Refactor pipelineM12 - Release 0.15Danylo Vanin (EPAM)Danylo Vanin (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/54[GONRG-4087] Remove unused dag from bootstrap2023-08-18T11:03:32ZDanylo Vanin (EPAM)[GONRG-4087] Remove unused dag from bootstrapRemoved unused dag from bootstrapRemoved unused dag from bootstrapM10 - Release 0.13Danylo Vanin (EPAM)Danylo Vanin (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/48GONRG-3679 bootstrap energistics2023-08-18T11:03:33ZIgor Zimovets (EPAM)GONRG-3679 bootstrap energisticsM10 - Release 0.13https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/42GONRG-3453 update GCP related CI CD2021-11-17T09:48:57ZAleksandr Spivakov (EPAM)GONRG-3453 update GCP related CI CDSome refactoring for GCP related CI CD stepsSome refactoring for GCP related CI CD stepsM10 - Release 0.13Siarhei Khaletski (EPAM)Yan Sushchynski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/40GONRG-3707 fix e2e tests2021-10-28T12:02:37ZAleksandr Spivakov (EPAM)GONRG-3707 fix e2e testsM9 - Release 0.12Siarhei Khaletski (EPAM)Yan Sushchynski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/38Using code instead of name2022-08-23T13:29:51Zetienne peyssonUsing code instead of nameCloses #43Closes #43M10 - Release 0.13https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/25Updated Python SDK version setup2021-08-19T12:50:43ZSiarhei Khaletski (EPAM)Updated Python SDK version setupM8 - Release 0.11Siarhei Khaletski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/22OSDU-GCP add configs [GONRG-2596]2023-08-18T11:03:44ZAliaksandr Ramanovich (EPAM)OSDU-GCP add configs [GONRG-2596]add config file for k8s pod operatoradd config file for k8s pod operatorM8 - Release 0.11Siarhei Khaletski (EPAM)Yan Sushchynski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/19Port to june27 schemas2023-08-18T11:03:48ZLaurent DenyPort to june27 schemasPort to the official schemas as of June 27. The change are mainly using WellLog and WellboreTrajectory 1.1.0 instead of 1.0.0.Port to the official schemas as of June 27. The change are mainly using WellLog and WellboreTrajectory 1.1.0 instead of 1.0.0.M8 - Release 0.11Laurent DenyLaurent Denyhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/14GONRG-2399: Fix wrong FileSource2023-08-18T11:03:56ZYan Sushchynski (EPAM)GONRG-2399: Fix wrong FileSourceFix wrong FileSource.
Also there is a problem with with WITSML parser. It returns `%2` instead of `/` ('FileSource': '%2F45e73ec1-706a-4843-8dea-a4d78638a0bd%2F0c06587c47b2437389fa6f3043a55ffe'). @deny please fix this partFix wrong FileSource.
Also there is a problem with with WITSML parser. It returns `%2` instead of `/` ('FileSource': '%2F45e73ec1-706a-4843-8dea-a4d78638a0bd%2F0c06587c47b2437389fa6f3043a55ffe'). @deny please fix this partM6 - Release 0.9Laurent DenyLaurent Denyhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/12GONRG-2098: automate docker image build2021-04-29T15:27:01ZYan Sushchynski (EPAM)GONRG-2098: automate docker image buildAutomate CICD docker build image.Automate CICD docker build image.Laurent DenyLaurent Denyhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/7GONRG: Energistics integration2023-08-18T11:04:03ZYan Sushchynski (EPAM)GONRG: Energistics integrationExample of Ingestion service payload
{
"FileID": "1121212121",
"DataType": "Energistics_xml_ingest",
"Context": {
"acl": {
"viewers": [
"data.default.viewers@osdu.osd...Example of Ingestion service payload
{
"FileID": "1121212121",
"DataType": "Energistics_xml_ingest",
"Context": {
"acl": {
"viewers": [
"data.default.viewers@osdu.osdu-gcp.go3-nrg.projects.epam.com"
],
"owners": [
"data.default.owners@osdu.osdu-gcp.go3-nrg.projects.epam.com"
]
},
"legal": {
"legaltags": [
"osdu-demo-legaltag"
],
"otherRelevantDataCountries": [
"US"
],
"status": "compliant"
},
"kind": "osdu:wks:dataset--File.Generic:1.0.0",
"file_name": "trace_trajectory",
"preload_file_path": "gs://test_kate/energistics_witsml_data_Well.xml",
"version": 5
}
}
}M4 - Release 0.7Siarhei Khaletski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/154standardize azure related dag implementation2024-01-19T11:41:16Zsaketh somarajustandardize azure related dag implementation## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [No]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [x] Azure
- [ ] GCP
- [ ] ...## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [No]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [x] Azure
- [ ] GCP
- [ ] IBM
## Current Configuration.
- No Azure publish job
- Dag task image naming convention is not uniform with other repositories.
- Docker image is hardcoded in dag zip artifact.
## Updates description?
- Add Azure publish job to publish dag task image to msosdu ACR.
- Update dag task image naming convention to make sure it is uniform with other dag repositories.
- Variabilize docker image in azure dag zip artifact, such that image tag is taken from airflow variables.
Related to https://community.opengroup.org/osdu/platform/ci-cd-pipelines/-/merge_requests/1044M23 - Release 0.26saketh somarajusaketh somarajuhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/153Merge branch 'gc-hotfix-image-path' into 'master'2023-12-15T10:28:30ZMikhail Piatliou (EPAM)Merge branch 'gc-hotfix-image-path' into 'master'GONRG-9006: refactored conditions for images paths
See merge request osdu/platform/data-flow/ingestion/energistics/witsml-parser!152
(cherry picked from commit 25c78db8a069b2cf452be1f9472de69ae96146b8)
1b984174 GONRG-9006: refactored ...GONRG-9006: refactored conditions for images paths
See merge request osdu/platform/data-flow/ingestion/energistics/witsml-parser!152
(cherry picked from commit 25c78db8a069b2cf452be1f9472de69ae96146b8)
1b984174 GONRG-9006: refactored conditions for images pathsM22 - Release 0.25David Diederichd.diederich@opengroup.orgChad LeongDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/152GONRG-9006: refactored conditions for images paths2023-12-15T08:04:55ZMikhail Piatliou (EPAM)GONRG-9006: refactored conditions for images pathsM22 - Release 0.25Mikhail Piatliou (EPAM)Mikhail Piatliou (EPAM)