Segy to Vds Conversion DAG merge requestshttps://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests2023-10-30T15:38:56Zhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/135Draft: updated ingestion lib2023-10-30T15:38:56ZDeepa KumariDraft: updated ingestion lib## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ]...## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Updates description?
Describe your code changes in details for reviewers (links on Gitlab issues, etc.)Deepa KumariDeepa Kumarihttps://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/140Draft: GC check oidc migration2023-10-15T20:12:40ZAliaksandr Ramanovich (EPAM)Draft: GC check oidc migration## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GCP
- [ ] IBM
## Updates description?
Changes to use OIDC tokens instead of SA keys## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GCP
- [ ] IBM
## Updates description?
Changes to use OIDC tokens instead of SA keysM22 - Release 0.25Aliaksandr Ramanovich (EPAM)Aliaksandr Ramanovich (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/137Draft: Update Azure CI variables2023-09-21T04:57:41Zsaketh somarajuDraft: Update Azure CI variables
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [Yes] Azure
- [ ] GCP
- [ ] IBM
## Updates description?
> Made changes to ...
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [Yes] Azure
- [ ] GCP
- [ ] IBM
## Updates description?
> Made changes to Azure CI variables to accommodate dev secondary environmentM21 - Release 0.24saketh somarajusaketh somarajuhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/119GC: Update README.md2023-07-11T15:39:15ZYan Sushchynski (EPAM)GC: Update README.md## Type of change
- [ ] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [No]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [x] AWS
- [x] Azure
- [x] GC
- [x] I...## Type of change
- [ ] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [No]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [x] AWS
- [x] Azure
- [x] GC
- [x] IBM
## Updates description?
Update README.mdhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/129move to 2.6 Airflow2023-06-09T08:21:36ZYan Sushchynski (EPAM)move to 2.6 Airflow## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GC
- [ ] ...## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GC
- [ ] IBM
## Updates description?
Describe your code changes in details for reviewers (links on Gitlab issues, etc.)https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/117Update output_dag_folder.py2023-03-27T19:36:18ZSumra ZafarUpdate output_dag_folder.py## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ]...## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Updates description?
Describe your code changes in details for reviewers (links on Gitlab issues, etc.)https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/81Merge branch 'fix_dag_creation_Script' into 'azure/m10-master'2023-02-04T05:19:14ZVineeth Guna [Microsoft]Merge branch 'fix_dag_creation_Script' into 'azure/m10-master'## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ]...## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Updates description?
Describe your code changes in details for reviewers (links on Gitlab issues, etc.)https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/106Draft: Update tag version2023-01-17T17:09:15ZVladyslav HundarchukDraft: Update tag version## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GCP
- [ ]...## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GCP
- [ ] IBM
## Updates description?
Describe your code changes in details for reviewers (links on Gitlab issues, etc.)Vladyslav HundarchukVladyslav Hundarchukhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/105Revert "Merge branch 'prakash/cherry-pick-m14' into 'azure/m14-master'"2022-12-27T20:19:01ZElizabeth HalperRevert "Merge branch 'prakash/cherry-pick-m14' into 'azure/m14-master'"## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ]...## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Updates description?
Describe your code changes in details for reviewers (links on Gitlab issues, etc.)https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/104ci: cherry pick: Merge branch...2022-12-26T05:14:19ZAnkur Rawatci: cherry pick: Merge branch...## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ]...## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Updates description?
Describe your code changes in details for reviewers (links on Gitlab issues, etc.)https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/103Draft: Cherry Pick m12 to m142022-12-03T04:46:54ZPrakash SivakumarDraft: Cherry Pick m12 to m14## Type of change
- [ ] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [X] Azure
- [ ] GCP
- [ ]...## Type of change
- [ ] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [X] Azure
- [ ] GCP
- [ ] IBM
## Updates description?
Describe your code changes in details for reviewers (links on Gitlab issues, etc.)M14 - Release 0.17Prakash SivakumarPrakash Sivakumarhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/77ci: migrate python images to MCR2022-08-05T18:20:05ZMarija Dukicci: migrate python images to MCR## Type of change
- [ ] Bug Fix
- [x] CI
- [ ] Feature
## Does this introduce a change in the core logic?
- [No]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [x] Azure
- [ ] G...## Type of change
- [ ] Bug Fix
- [x] CI
- [ ] Feature
## Does this introduce a change in the core logic?
- [No]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [x] Azure
- [ ] GCP
- [ ] IBM
## Updates description?
- Updated Azure [Dockerfile](https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/blob/master/deployments/scripts/azure/Dockerfile) python image to `python:3.8-slim` from Microsoft Container Registry
- Copied [DAG.Dockerfile](https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/blob/master/DAG.Dockerfile) to **deployments/scripts/azure** location and updated `FROM` in new Dockerfile to use `python:3.8-slim` image from Microsoft Container Registry (this is to avoid other cloud providers using MCR)
- Replaced `apk` package manager in both Dockerfiles to `apt-get` package manager which is available in slim tagged images
- ADO work item: [Product Backlog Item 9649: Container Security for VDS Converter images](https://dev.azure.com/OpenEnergyPlatform/Open%20Energy%20Platform/_workitems/edit/9649)
## Testing
- TBDMarija DukicMarija Dukichttps://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/78ci: update python image in azure dockerfile and DAG dockerfile to use MCR2022-08-05T18:19:49ZMarija Dukicci: update python image in azure dockerfile and DAG dockerfile to use MCR## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ]...## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Updates description?
Describe your code changes in details for reviewers (links on Gitlab issues, etc.)https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/70Changing the alpinepython3 version to 0.0.32022-07-21T05:36:39ZSwapnil PancholiChanging the alpinepython3 version to 0.0.3## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ]...## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Updates description?
Describe your code changes in details for reviewers (links on Gitlab issues, etc.)Swapnil PancholiSwapnil Pancholihttps://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/69Changing the alpinepython3 version to 0.0.32022-07-21T05:33:14ZSwapnil PancholiChanging the alpinepython3 version to 0.0.3## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ]...## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Updates description?
Describe your code changes in details for reviewers (links on Gitlab issues, etc.)Swapnil PancholiSwapnil Pancholihttps://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/27Add Segy to VDS SSDMS tests2022-07-12T15:25:28ZYan Sushchynski (EPAM)Add Segy to VDS SSDMS tests## Type of change
- [ ] Bug Fix
- [x] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ]...## Type of change
- [ ] Bug Fix
- [x] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Updates description?
Add E2E tests for Segy-Vds Conversion with DAG in SSDMS.Siarhei Khaletski (EPAM)Aleksandr Spivakov (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/53Draft: Gonrg 4896 improve pipeline2022-05-25T08:35:16ZAliaksei Kruk2Draft: Gonrg 4896 improve pipeline## Type of change
- [ ] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ]...## Type of change
- [ ] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Updates description?
Describe your code changes in details for reviewers (links on Gitlab issues, etc.)Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/50Put M8 Changes into master2022-05-23T20:48:49ZElizabeth HalperPut M8 Changes into master## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [x] Azure
- [ ] GCP
- [ ]...## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [Yes]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [x] Azure
- [ ] GCP
- [ ] IBM
## Updates description?
Describe your code changes in details for reviewers (links on Gitlab issues, etc.)Elizabeth HalperElizabeth Halperhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/47Feat: Ibm dag pipeline2022-04-22T09:45:13ZWalter DFeat: Ibm dag pipeline## Type of change
- [] Bug Fix
- [x] Feature
## Does this introduce a change in the core logic?
- [No]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [x] I...## Type of change
- [] Bug Fix
- [x] Feature
## Does this introduce a change in the core logic?
- [No]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [x] IBM
## Updates description?
Describe your code changes in details for reviewers (links on Gitlab issues, etc.)Walter DWalter Dhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/merge_requests/39IBM Segy-to-Vds DAG Pipeline2022-04-22T06:02:48ZShrikant GargIBM Segy-to-Vds DAG Pipeline## Type of change
- [] Bug Fix
- [x] Feature
## Does this introduce a change in the core logic?
- [No]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [x] I...## Type of change
- [] Bug Fix
- [x] Feature
## Does this introduce a change in the core logic?
- [No]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [x] IBM
## Updates description?
This MR contains changes specific to IBM for running DAG pipeline
https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/issues/10M12 - Release 0.15Anuj GuptaShrikant GargAnuj Gupta