WITSML Parser merge requestshttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests2021-08-19T12:50:43Zhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/25Updated Python SDK version setup2021-08-19T12:50:43ZSiarhei Khaletski (EPAM)Updated Python SDK version setupM8 - Release 0.11Siarhei Khaletski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/26Updated Python SDK version setup2021-08-19T15:25:16ZSiarhei Khaletski (EPAM)Updated Python SDK version setupM8 - Release 0.11Siarhei Khaletski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/28Aws update2021-09-07T07:55:34ZSpencer Suttonsuttonsp@amazon.comAws updateM8 - Release 0.11Spencer Suttonsuttonsp@amazon.comSpencer Suttonsuttonsp@amazon.comhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/27GONRG-3165: change imports to follow new code structure2021-08-31T12:33:03ZYan Sushchynski (EPAM)GONRG-3165: change imports to follow new code structureDue to https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-dags/-/merge_requests/67 we have to change importsDue to https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-dags/-/merge_requests/67 we have to change importsM8 - Release 0.11Siarhei Khaletski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/30Changed target to airflow2 bucket2023-08-18T11:03:41ZOleksii Tsyganov (EPAM)Changed target to airflow2 bucketM9 - Release 0.12Oleksii Tsyganov (EPAM)Oleksii Tsyganov (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/32Fixed pipeline logic for preprod env2023-08-18T11:03:40ZOleksii Tsyganov (EPAM)Fixed pipeline logic for preprod envM9 - Release 0.12Oleksii Tsyganov (EPAM)Oleksii Tsyganov (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/29GONRG-3115: add ini file for GCP2021-09-07T13:38:26ZAleksandr Spivakov (EPAM)GONRG-3115: add ini file for GCPCloses https://gitlab.opengroup.org/osdu/subcommittees/ea/projects/pre-shipping/home/-/issues/226Closes https://gitlab.opengroup.org/osdu/subcommittees/ea/projects/pre-shipping/home/-/issues/226M8 - Release 0.11Siarhei Khaletski (EPAM)Yan Sushchynski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/33Merge branch 'GONRG-3115_gcp_ini_file_generation' into 'master'2021-09-07T16:17:12ZSiarhei Khaletski (EPAM)Merge branch 'GONRG-3115_gcp_ini_file_generation' into 'master'GONRG-3115: add ini file for GCPGONRG-3115: add ini file for GCPM8 - Release 0.11Siarhei Khaletski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/31GONRG-3107: Change backward compatibility2021-09-08T10:20:13ZYan Sushchynski (EPAM)GONRG-3107: Change backward compatibilityThe DAG depends on [osdu-airflow-lib](https://community.opengroup.org/osdu/platform/data-flow/ingestion/osdu-airflow-lib) now.
Before deploying the DAG install the package
```shell
pip install 'osdu-airflow' --extra-index-url=https://c...The DAG depends on [osdu-airflow-lib](https://community.opengroup.org/osdu/platform/data-flow/ingestion/osdu-airflow-lib) now.
Before deploying the DAG install the package
```shell
pip install 'osdu-airflow' --extra-index-url=https://community.opengroup.org/api/v4/projects/668/packages/pypi/simple
```M9 - Release 0.12Siarhei Khaletski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/34GONRG-3304: Operators from osdu-airflow-libs2023-08-18T11:03:38ZYan Sushchynski (EPAM)GONRG-3304: Operators from osdu-airflow-libsThe DAG imports operators from [osdu-airflow-lib](https://community.opengroup.org/osdu/platform/data-flow/ingestion/osdu-airflow-lib) now.
Before deploying the DAG install the package
```shell
pip install 'osdu-airflow' --extra-index-u...The DAG imports operators from [osdu-airflow-lib](https://community.opengroup.org/osdu/platform/data-flow/ingestion/osdu-airflow-lib) now.
Before deploying the DAG install the package
```shell
pip install 'osdu-airflow' --extra-index-url=https://community.opengroup.org/api/v4/projects/668/packages/pypi/simple
```M9 - Release 0.12Siarhei Khaletski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/35GONRG-3249: remove redundant space in cmd2023-08-18T11:03:36ZAleksandr Spivakov (EPAM)GONRG-3249: remove redundant space in cmdRemoving redundant space in pod cmd. Space was added previously to temporary fix the issue: https://github.com/apache/airflow/issues/17186
To prevent possuble jinja errors from happening make sure that package apache-airflow-providers-c...Removing redundant space in pod cmd. Space was added previously to temporary fix the issue: https://github.com/apache/airflow/issues/17186
To prevent possuble jinja errors from happening make sure that package apache-airflow-providers-cncf-kubernetes has version >=2.0.2 (where this issue already fixed)M9 - Release 0.12Siarhei Khaletski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/37GONRG-3452: Move ingestion logic from SDK2021-10-13T10:43:10ZYan Sushchynski (EPAM)GONRG-3452: Move ingestion logic from SDKMove ingestion logic from SDKMove ingestion logic from SDKM9 - Release 0.12Siarhei Khaletski (EPAM)Aleksandr Spivakov (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/36GONRG-3411 add WITSML E2E tests2021-10-20T14:00:41ZAleksandr Spivakov (EPAM)GONRG-3411 add WITSML E2E tests- Add E2E tests pipeline step
- changes to support new Dataset API contracts
Closes #41 for GCP- Add E2E tests pipeline step
- changes to support new Dataset API contracts
Closes #41 for GCPM9 - Release 0.12Siarhei Khaletski (EPAM)Yan Sushchynski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/39GONRG-3605: Update deps version to 0.12.02021-10-27T13:03:00ZYan Sushchynski (EPAM)GONRG-3605: Update deps version to 0.12.0Update dependencies to release 0.12.0Update dependencies to release 0.12.0M9 - Release 0.12Siarhei Khaletski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/40GONRG-3707 fix e2e tests2021-10-28T12:02:37ZAleksandr Spivakov (EPAM)GONRG-3707 fix e2e testsM9 - Release 0.12Siarhei Khaletski (EPAM)Yan Sushchynski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/41GONRG-3722 fix e2e tests2021-11-02T13:05:50ZAleksandr Spivakov (EPAM)GONRG-3722 fix e2e tests- fix path for WITSML collection
- fix misstype in CI config
- add new required option to GCP osdu_api.ini config- fix path for WITSML collection
- fix misstype in CI config
- add new required option to GCP osdu_api.ini configM9 - Release 0.12Siarhei Khaletski (EPAM)Yan Sushchynski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/42GONRG-3453 update GCP related CI CD2021-11-17T09:48:57ZAleksandr Spivakov (EPAM)GONRG-3453 update GCP related CI CDSome refactoring for GCP related CI CD stepsSome refactoring for GCP related CI CD stepsM10 - Release 0.13Siarhei Khaletski (EPAM)Yan Sushchynski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/46(GONRG-3892) Refactor ci cd2021-12-07T10:16:25ZVladislav Shishko (EPAM)(GONRG-3892) Refactor ci cdGCP osdu_api.ini file now relies on environment variables from airflow_config.yamlGCP osdu_api.ini file now relies on environment variables from airflow_config.yamlM10 - Release 0.13Siarhei Khaletski (EPAM)Yan Sushchynski (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/47GONRG-3759: Add bootstrap2021-12-20T15:31:11ZYan Sushchynski (EPAM)GONRG-3759: Add bootstrapAdd bootstrap script to follow the common approach of rendering DAGsAdd bootstrap script to follow the common approach of rendering DAGsM10 - Release 0.13Siarhei Khaletski (EPAM)Vladislav Shishko (EPAM)Aleksandr Spivakov (EPAM)Siarhei Khaletski (EPAM)https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/merge_requests/48GONRG-3679 bootstrap energistics2023-08-18T11:03:33ZIgor Zimovets (EPAM)GONRG-3679 bootstrap energisticsM10 - Release 0.13