Open Test Data merge requestshttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests2023-08-16T22:38:52Zhttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/47Updated schemas/templates/scripts/manifests for M122023-08-16T22:38:52ZDadong ZhouUpdated schemas/templates/scripts/manifests for M12All data types are affected by this new common fieldAll data types are affected by this new common fieldM13 - Release 0.16Dadong ZhouDadong Zhouhttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/46Updated records to match file path2022-07-13T13:40:01ZCory HopperUpdated records to match file pathThese records were either missing a FileCollectionPath, FileSource, or had casing issues. Due to this, when trying to generate retrieval instructions through the dataset service, a user would receive 500s as it was unable to find the cor...These records were either missing a FileCollectionPath, FileSource, or had casing issues. Due to this, when trying to generate retrieval instructions through the dataset service, a user would receive 500s as it was unable to find the correct property or file in the cloud provider storage.Cory HopperCory Hopperhttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/45Adding docker related changes2023-08-16T18:56:23ZAkansha Rajput[Microsoft]Adding docker related changeshttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/44Update README2023-08-16T18:56:24ZKrishna Nikhil VedurumudiUpdate READMEhttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/43Add Support to upload Volve in Azure scripts2023-08-16T18:56:25ZErnesto GutierrezAdd Support to upload Volve in Azure scriptsAdd support to upload Volve data into the azure scripts.Add support to upload Volve data into the azure scripts.Ernesto GutierrezErnesto Gutierrezhttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/42Edit Scripts to be Compatible with Mac2023-08-16T18:56:27ZElizabeth HalperEdit Scripts to be Compatible with MacThis MR addresses errors users were getting when they ran the scripts from a MacBook. These changes should not be breaking for Windows users and allows Mac users to run the scripts without error. It changes `python` commands to be `pytho...This MR addresses errors users were getting when they ran the scripts from a MacBook. These changes should not be breaking for Windows users and allows Mac users to run the scripts without error. It changes `python` commands to be `python3` commands, and changes `readarray` commands, which are not supported by a Mac, to loops through an array.Elizabeth HalperElizabeth Halperhttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/41Add verification for env variables in data loader scripts2023-08-16T18:56:28ZAkansha Rajput[Microsoft]Add verification for env variables in data loader scriptsAdd verification for env variables in data loader scriptsAdd verification for env variables in data loader scriptshttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/40Environment variable verification2022-02-18T12:29:05ZAkansha Rajput[Microsoft]Environment variable verificationAdded environment variable verification in dataloader.shAdded environment variable verification in dataloader.shKrishna Nikhil VedurumudiKrishna Nikhil Vedurumudihttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/39Revert timezone change2023-08-16T22:38:54ZDadong ZhouRevert timezone changeM10 - Release 0.13Chad LeongChad Leonghttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/38Script enhancements2023-08-16T18:56:31ZKrishna Nikhil VedurumudiScript enhancementshttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/37Enhanced documentation2023-08-16T18:56:32ZKrishna Nikhil VedurumudiEnhanced documentationhttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/36Delete CIP_prestkZ_PPTime_gathers.json2023-08-16T22:38:55ZDadong ZhouDelete CIP_prestkZ_PPTime_gathers.jsonM10 - Release 0.13Chad LeongBen LasscockChad Leonghttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/35Merge M8 to master for R3 test TNO/Volve datasets data/manifests2023-08-16T22:38:56ZDadong ZhouMerge M8 to master for R3 test TNO/Volve datasets data/manifestsMerge M8 to master for R3 test TNO/Volve datasets data/manifestsMerge M8 to master for R3 test TNO/Volve datasets data/manifestsM10 - Release 0.13Chad LeongChad Leonghttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/34Add file extension to names of Documents work products2023-08-16T18:56:35ZKrishna Nikhil VedurumudiAdd file extension to names of Documents work productsKrishna Nikhil VedurumudiKrishna Nikhil Vedurumudihttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/33Data-load script updates from Master branch2023-08-16T18:56:36ZKrishna Nikhil VedurumudiData-load script updates from Master branchKrishna Nikhil VedurumudiKrishna Nikhil Vedurumudihttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/32fixes2023-08-16T18:56:38ZKrishna Nikhil VedurumudifixesChanges to `6-data-load- scripts` to support file name changes in M8 data.Changes to `6-data-load- scripts` to support file name changes in M8 data.Krishna Nikhil VedurumudiKrishna Nikhil Vedurumudihttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/31Verifying Latest test data2023-08-16T22:38:57ZKrishna Nikhil VedurumudiVerifying Latest test dataM10 - Release 0.13Krishna Nikhil VedurumudiKrishna Nikhil Vedurumudihttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/30[Azure] Improve file upload2023-08-16T22:38:59ZAalekh Jain[Azure] Improve file uploadImprove file upload scripts to improve file uploading time.
cc: @krveduruImprove file upload scripts to improve file uploading time.
cc: @krveduruM10 - Release 0.13https://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/29Batching support for WPC ingestion2023-08-16T22:39:00ZKrishna Nikhil VedurumudiBatching support for WPC ingestion- Use batch manifests to parallelize WPC ingestion
- Pipeline changes to parallelize WPC ingestion- Use batch manifests to parallelize WPC ingestion
- Pipeline changes to parallelize WPC ingestionM9 - Release 0.12Krishna Nikhil VedurumudiKrishna Nikhil Vedurumudihttps://community.opengroup.org/osdu/data/open-test-data/-/merge_requests/28Enable Work Product Component Ingestion2023-08-16T22:39:01ZKrishna Nikhil VedurumudiEnable Work Product Component IngestionChanges include
- Enabling WPC ingestion in pipeline.
- Fetch File record version in file ingestion stepChanges include
- Enabling WPC ingestion in pipeline.
- Fetch File record version in file ingestion stepM9 - Release 0.12Krishna Nikhil VedurumudiKrishna Nikhil Vedurumudi