Merge requests · Data Flow

POC change to Handle all dataset schema type

osdu/platform/data-flow/ingestion/osdu-airflow-lib!77 · created Jul 21, 2023 by Priyanka Bhongade M20 - Release 0.23 eds-M20-feature-dev
updated Jul 21, 2023
Added Poc to handle nested list dataype in Data records fetched from Data provider

osdu/platform/data-flow/ingestion/osdu-airflow-lib!76 · created Jul 21, 2023 by Priyanka Bhongade M20 - Release 0.23 eds-M20-feature-dev
updated Jul 21, 2023
Cherry-pick 'Update .gitlab-ci.yml to work with CSVWorkflow_AWS_CI-CD_v2.0..postman_collection_NotRun.json' into release/0.22

osdu/platform/data-flow/ingestion/csv-parser/csv-parser!397 · created Jul 20, 2023 by David Diederich M19 - Release 0.22 release/0.22
AWS Cherry-pick no-detached-pipeline
- Merged
- 1
- Approved
updated Jul 20, 2023
Update .gitlab-ci.yml to work with CSVWorkflow_AWS_CI-CD_v2.0..postman_collection_NotRun.json

osdu/platform/data-flow/ingestion/csv-parser/csv-parser!396 · created Jul 20, 2023 by Long Cheng M19 - Release 0.22
AWS M19 no-detached-pipeline
- Merged
- Approved
updated Jul 20, 2023
Integrate master with updates from slb-master 6 of 6 checklist items completed

osdu/platform/data-flow/ingestion/segy-to-zgy-conversion!288 · created Jun 30, 2023 by Erik Dahl M19 - Release 0.22
Common Code MRNew Feature
- Merged
- 4
- Approved
updated Jul 19, 2023
Moved EDS's Python Packages from EDS repo to OSDU_airflow_lib

osdu/platform/data-flow/ingestion/osdu-airflow-lib!71 · created Jul 07, 2023 by Nisha Thakran M19 - Release 0.22
Common Code MRRefactor
- Merged
- 3
updated Jul 19, 2023
Cherry-pick 'Updating NOTICE' into release/0.22

osdu/platform/data-flow/ingestion/csv-parser/csv-parser!393 · created Jul 14, 2023 by Chad Leong M19 - Release 0.22 release/0.22
Cherry-pick MRNotice Update no-detached-pipeline
- Merged
- 1
- Approved
updated Jul 14, 2023
Updating NOTICE

osdu/platform/data-flow/ingestion/csv-parser/csv-parser!392 · created Jul 14, 2023 by Chad Leong M19 - Release 0.22
MRNotice Update
- Merged
updated Jul 14, 2023
Cherry-pick 'Upgraded core-lib-azure and related dependencies' into release/0.22

osdu/platform/data-flow/ingestion/ingestion-workflow!458 · created Jul 14, 2023 by Chad Leong M19 - Release 0.22 release/0.22
Azure Cherry-pick MRDependencies Upgrade no-detached-pipeline
- Merged
- 1
- Approved
updated Jul 14, 2023
Cherry-pick 'Fixed a bug to enable well record testing for parent data mapping' into release/0.22

osdu/platform/data-flow/ingestion/osdu-airflow-lib!74 · created Jul 14, 2023 by Chad Leong M19 - Release 0.22 release/0.22
Cherry-pick Common Code MRBugfix no-detached-pipeline
- Merged
- 1
- Approved
updated Jul 14, 2023
Cherry-pick 'Added changes for User-Context-Ingestion' into release/0.22

osdu/platform/data-flow/ingestion/segy-to-zgy-conversion!290 · created Jul 14, 2023 by Chad Leong M19 - Release 0.22 release/0.22
Azure Cherry-pick Common Code MREnhancement no-detached-pipeline
- Merged
- 1
- Approved
updated Jul 14, 2023
Added changes for User-Context-Ingestion

osdu/platform/data-flow/ingestion/segy-to-zgy-conversion!289 · created Jul 12, 2023 by Deepa Kumari M19 - Release 0.22
Azure Common Code MREnhancement
- Merged
- 17
- 1
- Approved
updated Jul 14, 2023
Upgraded core-lib-azure and related dependencies

osdu/platform/data-flow/ingestion/ingestion-workflow!445 · created Jun 13, 2023 by Deepa Kumari M19 - Release 0.22
Azure MRDependencies Upgrade
- Merged
- 1
- Approved
updated Jul 14, 2023
allowing work without ini file

osdu/platform/data-flow/ingestion/energistics/energistics-parser-lib!11 · created Jul 13, 2023 by Valentin Gauthier
- Merged
- Approved
updated Jul 14, 2023
Removing extra libs/Packages from requirements file

osdu/platform/data-flow/ingestion/external-data-sources/core-external-data-workflow!366 · created Jun 14, 2023 by Priyanka Bhongade M19 - Release 0.22
Azure
updated Jul 13, 2023
Replaced pympler with objsize to calculate json object size due to import issues

osdu/platform/data-flow/ingestion/external-data-sources/core-external-data-workflow!371 · created Jun 19, 2023 by Priyanka Bhongade M19 - Release 0.22
Azure Common Code MRRefactor
- Merged
- 1
updated Jul 13, 2023
Sys package to calculate Size of object

osdu/platform/data-flow/ingestion/external-data-sources/core-external-data-workflow!372 · created Jun 19, 2023 by Priyanka Bhongade M19 - Release 0.22
Azure Common Code MREnhancement
- Merged
- 1
updated Jul 13, 2023
Removed Bearer token from upload service API

osdu/platform/data-flow/ingestion/external-data-sources/core-external-data-workflow!374 · created Jun 20, 2023 by Priyanka Bhongade M19 - Release 0.22
Common Code MRBugfix
- Merged
- 1
updated Jul 13, 2023
POC change-WPC data handled -Manifest by reference

osdu/platform/data-flow/ingestion/external-data-sources/core-external-data-workflow!376 · created Jun 21, 2023 by Priyanka Bhongade M19 - Release 0.22
Common Code MREnhancement
- Merged
- 1
updated Jul 13, 2023
Json dump frame up to upload file

osdu/platform/data-flow/ingestion/external-data-sources/core-external-data-workflow!377 · created Jun 22, 2023 by Priyanka Bhongade M19 - Release 0.22
Common Code MRBugfix
- Merged
- 1
updated Jul 13, 2023