OpenVDS cuts one char from folder name in GC path
We've found issue with OpenVDS 3.2.7 (and possible with all 3.2.*) and 3.3.1 versions in GC: first character in folder name is lost in path to SEGY file.
We have Seismic dataset:
{
"sbit_count": 0,
"last_modified_date": "Wed Sep 27 2023 18:04:33 GMT+0000 (Coordinated Universal Time)",
"created_by": "109239448567816450362",
"sbit": null,
"subproject": "fgx",
"path": "/",
"gcsurl": "osdu-data-prod-m19-ss-seismic/5a3a7d7b-3a94-4d7a-9bcb-68c133d19e77/96bd9293-3358-4716-8a04-23806f63053e",
"readonly": false,
"filemetadata": {
"md5Checksum": null,
"nobjects": 1,
"size": 277427976,
"type": "GENERIC",
"tier_class": null
},
"name": "ST0202R08_PS_PSDM_RAW_PP_TIME.MIG_RAW.POST_STACK.3D.JS-017534.segy",
"ctag": "l7nnwm4Onkcjg79Dm19;m19",
"created_date": "Wed Sep 27 2023 18:04:03 GMT+0000 (Coordinated Universal Time)",
"ltag": "m19-seismic-DDMS-Legal-Tag-PRFC",
"tenant": "m19",
"access_policy": "uniform"
}
and Seismic path is sd://m19/fgx/ST0202R08_PS_PSDM_RAW_PP_TIME.MIG_RAW.POST_STACK.3D.JS-017534.segy
.
When we run SEGY-to-VDS conversion OpenVDS is trying to download this file from https://storage.googleapis.com/osdu-data-prod-m19-ss-seismic/a3a7d7b-3a94-4d7a-9bcb-68c133d19e77/96bd9293-3358-4716-8a04-23806f63053e/0
and fails as URL is not correct and first character in folder name is missing. In this case correct path should be https://storage.googleapis.com/osdu-data-prod-m19-ss-seismic/5a3a7d7b-3a94-4d7a-9bcb-68c133d19e77/96bd9293-3358-4716-8a04-23806f63053e/0
.
As result conversion fails:
[2023-10-27, 09:36:52 UTC] {pod_launcher.py:198} INFO - Event: segy-vds-conversion.1ff9faad21db4204a03ac62025f93454 had an event of type Running
[2023-10-27, 09:36:52 UTC] {pod_launcher.py:149} INFO - [Could not open input file] sd://m19/fgx/ST0202R08_PS_PSDM_RAW_PP_TIME.MIG_RAW.POST_STACK.3D.JS-017534.segy: Http error response: 403 -> https://storage.googleapis.com/osdu-data-prod-m19-ss-seismic/a3a7d7b-3a94-4d7a-9bcb-68c133d19e77/96bd9293-3358-4716-8a04-23806f63053e/0
[2023-10-27, 09:36:53 UTC] {pod_launcher.py:198} INFO - Event: segy-vds-conversion.1ff9faad21db4204a03ac62025f93454 had an event of type Running
Conversion works with image community.opengroup.org:5555/osdu/platform/domain-data-mgmt-services/seismic/open-vds/openvds-ingestion:latest which seems to be version 3.1.41
Please check and advise as this affects M21 Pre-shipping testing.