AWS M12: Volve Data not fully populated
Not all the Volve data appears to be loaded in AWS M12 environment. We are expecting to see the following:
- work-product-component--SeismicTraceData - At least two SeismicTraceData entries with the following names:
- "ST0202R08-PS_PSDM_FULL_OFFSET_DEPTH.MIG_FIN.POST_Stack.3D.JS-017534"
- "ST0202R08_PS_PSDM_RAW_PP_TIME.MIG_RAW.POST_Stack.3D.JS-017534"
- work-product-component--SeismicHorizon - At least five SeismicHorizon entries with the following names:
- Hod_Fm
- Ty_Fm_Top
- BCU_Fm
- Balder_Fm
- SHETLAND_GP
- work-product-component--FaultSystem - Atleast one FaultSystem entry with the following name
- Volve_Official_Faults
SeismicTraceData
Regarding the SeismicTraceData records, I am only able to find the ST0202R08-PS_PSDM_FULL_OFFSET_DEPTH.MIG_FIN.POST_Stack.3D.JS-017534 SeismicTraceData when I use the following search query:
curl --location --request POST 'https://r3m12.preshiptesting.osdu.aws/api/search/v2/query' \
--header 'Content-Type: application/json' \
--header 'data-partition-id: osdu' \
--header 'Authorization: Bearer ...' \
--data-raw '{
"kind": "osdu:wks:work-product-component--SeismicTraceData:*",
"returnedFields":["id", "data.Name", "data.Datasets"],
"limit":10
}
'Response:
{
"results": [
{
"data": {
"Datasets": [
"osdu:dataset--FileCollection.SEGY:f148b991068273fab025b602b51e1b354c2794cd8f5dc406c88193a9fdbfd11a"
],
"Name": "ST0202R08-PS_PSDM_FULL_OFFSET_DEPTH.MIG_FIN.POST_Stack.3D.JS-017534"
},
"id": "osdu:work-product-component--SeismicTraceData:ST0202R08-depth-volume"
},
{
"data": {
"Datasets": [],
"Name": "OSDU_SEGY"
},
"id": "osdu:work-product-component--SeismicTraceData:55fab9e0e8bc49908085c68addd1c27f"
},
{
"data": {
"Datasets": [],
"Name": "OSDU_SEGY"
},
"id": "osdu:work-product-component--SeismicTraceData:636b767cf0fe44d5867f2f3839e5e9db"
},
{
"data": {
"Datasets": [],
"Name": "OSDU_SEGY"
},
"id": "osdu:work-product-component--SeismicTraceData:b815caa455334b239dad6a5e74fdb8aa"
},
{
"data": {
"Datasets": [],
"Name": "OSDU_SEGY"
},
"id": "osdu:work-product-component--SeismicTraceData:86e9c8f993fd4295b0093b07d0becadd"
},
{
"data": {
"Datasets": [],
"Name": "OSDU_SEGY"
},
"id": "osdu:work-product-component--SeismicTraceData:08153c7260604588b07a8c636a1c94ec"
},
{
"data": {
"Datasets": [],
"Name": "OSDU_SEGY"
},
"id": "osdu:work-product-component--SeismicTraceData:b52b19c861ff47aca67eabc7aa466c07"
}
],
"aggregations": null,
"totalCount": 7
}When I attempt to get a signed url for the ST0202R08-PS_PSDM_FULL_OFFSET_DEPTH.MIG_FIN.POST_Stack.3D.JS-017534 dataset, I am getting a 500 error:
curl --location --request POST 'https://r3m12.preshiptesting.osdu.aws/api/dataset/v1/getRetrievalInstructions' \
--header 'data-partition-id: osdu' \
--header 'Authorization: Bearer ...' \
--header 'Content-Type: application/json' \
--data-raw '{
"datasetRegistryIds": [
"osdu:dataset--FileCollection.SEGY:f148b991068273fab025b602b51e1b354c2794cd8f5dc406c88193a9fdbfd11a"
]
}'Response:
{
"code": 500,
"reason": "Internal Server Error",
"message": "Unrecognized field \"code\" (class org.opengroup.osdu.core.common.dms.model.RetrievalInstructionsResponse), not marked as ignorable (2 known properties: \"datasets\", \"providerKey\"])_ at [Source: (String)\"{\"code\":400,\"reason\":\"Bad Request\",\"message\":\"File Collection Path is missing in the record metadata\"}\"; line: 1, column: 12] (through reference chain: org.opengroup.osdu.core.common.dms.model.RetrievalInstructionsResponse[\"code\"])"
}SeismicHorizon
Regarding the SeismicHorizon records, I am only able to find three of the SeismicHorizon records (SHETLAND_GP, Hod_Fm, BCU_Fm) when I use the following search query:
curl --location --request POST 'https://r3m12.preshiptesting.osdu.aws/api/search/v2/query' \
--header 'Content-Type: application/json' \
--header 'data-partition-id: osdu' \
--header 'Authorization: Bearer ...' \
--data-raw '{
"kind": "osdu:wks:work-product-component--SeismicHorizon:*",
"returnedFields":["id", "data.Name", "data.Datasets"],
"limit":10
}
'Response:
{
"results": [
{
"data": {
"Datasets": [
"osdu:dataset--File.Generic:af496e31d1d015b58e2a638339c160e8fad8506000b0df06fb1c24cb8a4b7028"
],
"Name": "SHETLAND_GP"
},
"id": "osdu:work-product-component--SeismicHorizon:de57eaa80d90559cdb11f669641d7b2042adcc55137ee77914fcd6d602a3a62c"
},
{
"data": {
"Datasets": [
"osdu:dataset--File.Generic:e793fbdb98b4c38be661db56e6d31b24178a5ef70797dde9c36a1d5c6b445a66"
],
"Name": "Hod_Fm"
},
"id": "osdu:work-product-component--SeismicHorizon:5281150c8af659c215c25c23869fa2f7f56d325c2bc7171985b168fb9abaff01"
},
{
"data": {
"Datasets": [
"osdu:dataset--File.Generic:eee8cc7c1484867dea243c3d6ed47457dab834118ab3c8115a6d071d3f018cf4"
],
"Name": "BCU_Fm"
},
"id": "osdu:work-product-component--SeismicHorizon:a720aa72e7039d941438ad5044034f07e431a1e2c1e464b1cd6c54e62271d865"
}
],
"aggregations": null,
"totalCount": 3
}When I attempt to get a signed url for any of the SeismicHorizon datasets returned in the previous query, I am getting a 500 error. Below is an example of one of the requests that are failing:
curl --location --request POST 'https://r3m12.preshiptesting.osdu.aws/api/dataset/v1/getRetrievalInstructions' \
--header 'data-partition-id: osdu' \
--header 'Authorization: Bearer ...' \
--header 'Content-Type: application/json' \
--data-raw '{
"datasetRegistryIds": [
"osdu:dataset--File.Generic:af496e31d1d015b58e2a638339c160e8fad8506000b0df06fb1c24cb8a4b7028"
]
}'Response:
{
"code": 500,
"reason": "Internal Server Error",
"message": "Unrecognized field \"status\" (class org.opengroup.osdu.core.common.dms.model.RetrievalInstructionsResponse), not marked as ignorable (2 known properties: \"datasets\", \"providerKey\"])_ at [Source: (String)\"{\"status\":\"BAD_REQUEST\",\"message\":\"UnrecognizedPropertyException: Unrecognized field \\\"PreloadFilePath\\\" (class org.opengroup.osdu.file.model.filemetadata.filedetails.FileSourceInfo), not marked as ignorable (11 known properties: \\\"Checksum\\\", \\\"FileSource\\\", \\\"PreLoadFilePath\\\", \\\"Name\\\", \\\"PreloadFileCreateUser\\\", \\\"PreloadFileModifyDate\\\", \\\"PreloadFileCreateDate\\\", \\\"PreloadFileModifyUser\\\", \\\"FileSize\\\", \\\"EncodingFormatTypeID\\\", \\\"ChecksumAlgorithm\\\"])\\n at [Source: UNKNOWN; byte offset: #\"[truncated 222 chars]; line: 1, column: 12] (through reference chain: org.opengroup.osdu.core.common.dms.model.RetrievalInstructionsResponse[\"status\"])"
}FaultSystem
I am able to find the expected FaultSystem record via search, however, when I try to get the signed url for that FaultSystem dataset, the request is failing:
curl --location --request POST 'https://r3m12.preshiptesting.osdu.aws/api/dataset/v1/getRetrievalInstructions' \
--header 'data-partition-id: osdu' \
--header 'Authorization: Bearer ...' \
--header 'Content-Type: application/json' \
--data-raw '{
"datasetRegistryIds": [
"osdu:dataset--File.Generic:56b38fd6f8fd925e1a7432262ebc546a6f8d827892d9f1367400299170beb3c9"
]
}'Response:
{
"code": 500,
"reason": "Internal Server Error",
"message": "Unrecognized field \"status\" (class org.opengroup.osdu.core.common.dms.model.RetrievalInstructionsResponse), not marked as ignorable (2 known properties: \"datasets\", \"providerKey\"])_ at [Source: (String)\"{\"status\":\"BAD_REQUEST\",\"message\":\"UnrecognizedPropertyException: Unrecognized field \\\"PreloadFilePath\\\" (class org.opengroup.osdu.file.model.filemetadata.filedetails.FileSourceInfo), not marked as ignorable (11 known properties: \\\"Checksum\\\", \\\"FileSource\\\", \\\"PreLoadFilePath\\\", \\\"Name\\\", \\\"PreloadFileCreateUser\\\", \\\"PreloadFileModifyDate\\\", \\\"PreloadFileCreateDate\\\", \\\"PreloadFileModifyUser\\\", \\\"FileSize\\\", \\\"EncodingFormatTypeID\\\", \\\"ChecksumAlgorithm\\\"])\\n at [Source: UNKNOWN; byte offset: #\"[truncated 222 chars]; line: 1, column: 12] (through reference chain: org.opengroup.osdu.core.common.dms.model.RetrievalInstructionsResponse[\"status\"])"
}