Open Test Data issueshttps://community.opengroup.org/osdu/data/open-test-data/-/issues2021-06-16T22:20:43Zhttps://community.opengroup.org/osdu/data/open-test-data/-/issues/53Duplicate Trajectories returned from query2021-06-16T22:20:43ZMichaelDuplicate Trajectories returned from queryWhen using the following query:
{
"fulltext": "*",
"aggregates_count": 10000,
"start": 0,
"count": 10000,
"metadata": {"WellSRN":"srn:master-data/Well:3687:"}
}
There are two trajectory datas listed that refer to the same csv file (369...When using the following query:
{
"fulltext": "*",
"aggregates_count": 10000,
"start": 0,
"count": 10000,
"metadata": {"WellSRN":"srn:master-data/Well:3687:"}
}
There are two trajectory datas listed that refer to the same csv file (3695.csv).
[duplicateTrajectories.txt](/uploads/faea570ead57229b8de6c66d28ff021a/duplicateTrajectories.txt)https://community.opengroup.org/osdu/data/open-test-data/-/issues/60Logout openId/OAuth2 on AWS2021-06-16T22:20:41ZAaronLogout openId/OAuth2 on AWSI cant seem to get the logout to work correctly with either openID flow or with coginito published flow
I get the following
![image](/uploads/e8ecdc58735aebaac2576ec838480828/image.png)
using these paramaters
```
forwardstring =...I cant seem to get the logout to work correctly with either openID flow or with coginito published flow
I get the following
![image](/uploads/e8ecdc58735aebaac2576ec838480828/image.png)
using these paramaters
```
forwardstring = osduService['credentials']['logout_url'] + \
'?id_token_hint=' + settings['tokens'][service]["id_token"] + \
'&state=' + service + \
'&post_logout_redirect_uri=' + redirect_url + \
'&logout_uri=' + redirect_url + \
"&client_id=" + osduService['credentials']['client_id']
```
which yeilds
```
https://osdur1prod.auth.us-east-1.amazoncognito.com/oauth2/logout?id_token_hint=eyJraWQiOiJZeXlQalFlaFpjSzU4R1lMOUcrSlNzQ1wvU0tkekJrWWdUemhZR0RHMDBuTT0iLCJhbGciOiJSUzI1NiJ9.eyJhdF9oYXNoIjoiLXFsSVF1QUphd3lwMC05RWtNeVU0USIsInN1YiI6Ijc4NzgyZGZkLTJjYWEtNDBjZC1hMGZkLWRmZjZhODgyOGUwOSIsImF1ZCI6IjFqZmx0cmxhZ2NibmxxaDR2NXJkaG83OGg5IiwiY29nbml0bzpncm91cHMiOlsib3NkdV9pc3YiXSwidG9rZW5fdXNlIjoiaWQiLCJhdXRoX3RpbWUiOjE1Nzc1OTQ1OTIsImlzcyI6Imh0dHBzOlwvXC9jb2duaXRvLWlkcC51cy1lYXN0LTEuYW1hem9uYXdzLmNvbVwvdXMtZWFzdC0xX1o2UkdGQ2RLViIsIm9zZHVfcm9sZSI6Im9zZHVfaXN2IiwiY29nbml0bzp1c2VybmFtZSI6IkFhcm9uQ2xvc2Uud2VsbGxvZ2RhdGEiLCJleHAiOjE1Nzc1OTgxOTIsImlhdCI6MTU3NzU5NDU5MiwiZW1haWwiOiJhYXJvbkB3ZWxsbG9nZGF0YS5jb20ifQ.jliJXg0sIWwWUj4C8BbiDCORCCxh_7PxjDOu_IQr01WxDIx0YVIqQs7tPm-zDGBTst4eh30nKazKUo1QOvCBTRNQSI-4soE5hmZPvPHe-Rr7Q3n1UtAdQKzaCyFFXOk2JlVHEJmF4WnTJpTIT_v_VeENWenKvNlcgUpDbrFQUc9evp4-NUAz-aRuTCnO8yd5XK45M3zPXHeFonvOZpUXpSYm_yTM--3f0eN4NynWaLtJ5zwQF5U6StXzy-LSMXVkqmYLMmpryuzRtPisbNEezB0unVKe5HSkeJFhs0giGtG00qigJJtHjD3rZGIm6gSJPryhNdh_Nq2oOhSGYO_X-Q&state=aws_r1&post_logout_redirect_uri=http%3A%2F%2Flocalhost%3A8080&logout_uri=http%3A%2F%2Flocalhost%3A8080&client_id=1jfltrlagcbnlqh4v5rdho78h9
```JoeBrandt BealJoehttps://community.opengroup.org/osdu/data/open-test-data/-/issues/62Differences in Assertions2021-06-16T22:20:40ZAaronDifferences in AssertionsDifferences in Assertions
Azure example from JWT Token "Simplified"
```json
{
"email": "aaron@welllogdata.com",
"name": "Aaron Close",
"unique_name": "aaron@welllogdata.com"
}
```
AWS example from JWT Token "Simplified"
```json
...Differences in Assertions
Azure example from JWT Token "Simplified"
```json
{
"email": "aaron@welllogdata.com",
"name": "Aaron Close",
"unique_name": "aaron@welllogdata.com"
}
```
AWS example from JWT Token "Simplified"
```json
{
"osdu_role": "osdu_isv",
"cognito:username": "AaronClose.welllogdata",
"email": "aaron@welllogdata.com"
}
```
Full Azure Example
```json
{
"aud": "29351175-8a36-4b1f-9f7e-a27ac01c174f",
"iss": "https://sts.windows.net/610dfadc-e232-4f9d-978e-eb29b1baf036/",
"iat": 1577586292,
"nbf": 1577586292,
"exp": 1577590192,
"amr": [
"pwd"
],
"email": "aaron@welllogdata.com",
"idp": "https://sts.windows.net/7c37e83e-3e17-4b98-bd64-bc5857e451f1/",
"ipaddr": "216.10.40.126",
"name": "Aaron Close",
"oid": "3ecad558-98d8-426c-a7a7-a7ef27063580",
"sub": "WTrHqGXfO6AHP0gYwz7sVLwkvldBVWi9jUOqWo74aj0",
"tid": "610dfadc-e232-4f9d-978e-eb29b1baf036",
"unique_name": "aaron@welllogdata.com",
"uti": "3s_h2FPj2EKY5PGeTwgqAA",
"ver": "1.0"
}
```
Full AWS Example
```json
{
"at_hash": "s_5Mpnna8FpnIsQA1X2B8g",
"sub": "78782dfd-2caa-40cd-a0fd-dff6a8828e09",
"aud": "1jfltrlagcbnlqh4v5rdho78h9",
"cognito:groups": [
"osdu_isv"
],
"token_use": "id",
"auth_time": 1577595651,
"iss": "https://cognito-idp.us-east-1.amazonaws.com/us-east-1_Z6RGFCdKV",
"osdu_role": "osdu_isv",
"cognito:username": "AaronClose.welllogdata",
"exp": 1577599251,
"iat": 1577595652,
"email": "aaron@welllogdata.com"
}
```https://community.opengroup.org/osdu/data/open-test-data/-/issues/57WellCommonName not specified for WellLogs, Trajectories, and Markers in AWS2020-01-21T14:40:37ZMichaelWellCommonName not specified for WellLogs, Trajectories, and Markers in AWSThe WellCommonName field is only specified for WellBores in AWS search results.
It is not specified in Well Logs, Trajectories, and Markers.
Using the below query, the WellCommonName is only listed once, for the wellbore.
```
{
"ful...The WellCommonName field is only specified for WellBores in AWS search results.
It is not specified in Well Logs, Trajectories, and Markers.
Using the below query, the WellCommonName is only listed once, for the wellbore.
```
{
"fulltext": "*",
"aggregates_count": 10000,
"start": 0,
"count": 10000,
"metadata": {
"WellSRN":"srn:master-data/Well:8345:"
}
}
```
[wellChildrenQueryResults.txt](/uploads/dda2256f1190320313ed9cec7ce768ce/wellChildrenQueryResults.txt)https://community.opengroup.org/osdu/data/open-test-data/-/issues/40Difference in Data delivered with curves for wellbore2020-01-21T14:40:18ZAaronDifference in Data delivered with curves for wellbore
AWS Examples
Azure has a "BaseDepth" field that is always = 0
Azure includes a "Type" property that always has the same value as "Mnemonic"
```json
"Curves": [
{
"BottomDe...
AWS Examples
Azure has a "BaseDepth" field that is always = 0
Azure includes a "Type" property that always has the same value as "Mnemonic"
```json
"Curves": [
{
"BottomDepth": 3055.0,
"CurveUnit": "srn:reference-data/UnitOfMeasure:M:",
"DepthUnit": "srn:reference-data/UnitOfMeasure:M:",
"Mnemonic": "DEPT",
"TopDepth": 0.1001
},
{
"BottomDepth": 3054.5,
"CurveUnit": "srn:reference-data/UnitOfMeasure:GAPI:",
"DepthUnit": "srn:reference-data/UnitOfMeasure:M:",
"Mnemonic": "GR",
"TopDepth": 10.5001
},
```
Azure Example
```json
"Curves": [
{
"BaseDepth": 0.0,
"BottomDepth": 3055.0,
"CurveUnit": "srn:reference-data/UnitOfMeasure:M:",
"DepthUnit": "srn:reference-data/UnitOfMeasure:M:",
"Mnemonic": "DEPT",
"TopDepth": 0.1001,
"Type": "DEPT"
},
{
"BaseDepth": 0.0,
"BottomDepth": 3054.5,
"CurveUnit": "srn:reference-data/UnitOfMeasure:GAPI:",
"DepthUnit": "srn:reference-data/UnitOfMeasure:M:",
"Mnemonic": "GR",
"TopDepth": 10.5001,
"Type": "GR"
},
```https://community.opengroup.org/osdu/data/open-test-data/-/issues/29AWS not returning all fields for Wells and wellbores2020-01-21T14:39:38ZAaronAWS not returning all fields for Wells and wellbores#AWS it appears not all fields are populated.
This shows up in map_aggregate searches
WELL
note the first one there is not "WellCommonName" and "WellUWI" fields
```json
{
"CurrentOperator": "srn:master-da...#AWS it appears not all fields are populated.
This shows up in map_aggregate searches
WELL
note the first one there is not "WellCommonName" and "WellUWI" fields
```json
{
"CurrentOperator": "srn:master-data/Organisation:AkzoNobel:",
"GeoLocation": {
"coordinates": [
6.77500613,
52.21003651
],
"type": "point"
},
"ResourceType": "master-data/Well",
"SRN": "srn:master-data/Well:5776:",
"SpudDate": "2014-06-30T00:00:00"
},
{
"CurrentOperator": "srn:master-data/Organisation:AkzoNobel:",
"GeoLocation": {
"coordinates": [
6.76860401,
52.21095667
],
"type": "point"
},
"ResourceType": "master-data/Well",
"SRN": "srn:master-data/Well:5722:",
"SpudDate": "2013-04-02T00:00:00",
"WellCommonName": "TWR-534",
"WellUWI": "5722"
}
```
WELLBORE
note the nulls and missing values for "WellCommonName", "WellSRN" and "WellUwi"
```json
{
"CurrentOperator": "srn:master-data/Organisation:AkzoNobel:",
"GeoLocation": {
"coordinates": [
6.77043859,
52.21023332
],
"type": "point"
},
"ResourceType": "master-data/Wellbore",
"SRN": "srn:master-data/Wellbore:5763:",
"SpudDate": "2014-03-10T00:00:00",
"WellCommonName": null,
"WellSRN": [],
"WellUWI": null
},
{
"CurrentOperator": "srn:master-data/Organisation:AkzoNobel:",
"GeoLocation": {
"coordinates": [
6.7720599,
52.20938238
],
"type": "point"
},
"ResourceType": "master-data/Wellbore",
"SRN": "srn:master-data/Wellbore:5769:",
"SpudDate": "2014-04-08T00:00:00",
"WellCommonName": null,
"WellSRN": [],
"WellUWI": null
},
```https://community.opengroup.org/osdu/data/open-test-data/-/issues/59Recieved random 504 error from delivery endpoint on aws2020-01-21T14:30:27ZMichaelRecieved random 504 error from delivery endpoint on awsWhen calling https://delivery.r1.prod.osdu.aws/api/v2/GetResources, a 504 error.
We have only noticed this once.
This error occurred on 12/19 at 1:47 pm (CDT).When calling https://delivery.r1.prod.osdu.aws/api/v2/GetResources, a 504 error.
We have only noticed this once.
This error occurred on 12/19 at 1:47 pm (CDT).https://community.opengroup.org/osdu/data/open-test-data/-/issues/61Refresh token Issue with Azure2020-01-14T14:08:33ZAaronRefresh token Issue with AzureWhen following OpenId refresh token flow Azure dosen't return new id_token and old one is not usable in refresh period
Example Response From refresh response.
```json
{
"access_token": "AQABAAAAAACQN9QBRU3jT6bcBQLZNUj7HAhd2wAWO0Fr0...When following OpenId refresh token flow Azure dosen't return new id_token and old one is not usable in refresh period
Example Response From refresh response.
```json
{
"access_token": "AQABAAAAAACQN9QBRU3jT6bcBQLZNUj7HAhd2wAWO0Fr0UDGB200ERHOmMWxvN68YvTMLsWs2t7iKa0olWPm3ydGPJRSryB-pvi0fcr0XPRHkGRDVf0yhL_ObhfFbdwm-eB7Dc7NqUA5usmNzvGalx_e1PgB2Oqg_rg02UPJuXdK9SQ-5XgdcMTEE7GkXgy89G-L-C4s-YJZdukNhTJEH7hmVbvrEm-qA3M0ThijNW_i_LerAq0d4v6POuN-FaYxk_rS41grLDWqHlRHnauB3-lkAnXAwswpbzfovGcR_Sh9W_KgVdWslAXYX8RXpLr-1jV1ichC_CY4x0trfneDrOd7qeymuUoFSC-JZ8Z4f_Oo1fdzvL9U7hro61tlK5tYxeB92PeU_xqzk04f7mNFB3TuThrtT69mgzIKTxv4QPGwKDkyeeZbBPYOr4duOGQQa2I6uf4u31FYWAKMJpFdIx9fQ93--paToaOiLokarYI2TI4RyhUuxftCkAH9TfJzC_Dq6WDQlR_a2kbkNQZU5U-C1B0a6Pofuq9yrehhohFFOMsCyRgVdwg4J6rRf6JabYEvSc1OfLdcxy0j20kbJUiu87vuCrbZ3Xroqq3BNNhhsGHu0rCuKTlKtVhaJ3j05ICF5cxjH13WVsQ3Sf5tK-DRFephU2U1IRP-8757U1Pz-WpGNR7vqOC5YqyOKLcH6zC3ORro5OogAA",
"expires_on": "1577598633",
"ext_expires_in": "3599",
"refresh_token": "AQABAAAAAACQN9QBRU3jT6bcBQLZNUj7K7GmE6O3hLgWpntFNv3r_nJhdvQPL_qs83-aub5L_OVTSkYyrTfqv7vhSG4OAYAVfUmd0yMJrEG7OXMit4Ni72spG4UR6MjHujczgZAmi3fN9izrKCtwC4HmgxLd0JlKvv3euNXUPsifvndQ21Knk__hO4K1qwhm7-sP4YDH5QwliX9j0-EAK4bwklF-rPiYgyQFUY3WBrLeLeTvci6F3AiAO1S53Jyra_QM8D_z-fAsKRxqruFR447Tug4rhm-lvsvAhRhK818sbB7d9v-43L0XRHnQuuExTck3NpWIQMdi8zdQ2MKEPqaQJmzuafgcLI7lxJmSKSSDBrLzcDFIq5Sjpw0Ex2ejfGmkv9YAFZ32wEbGCrUyUCbhlxia4aILfmuVk8EpL1u0yw5G2dmebaBQY76vJnxYcJp2xl7Kr9IlMW53iRKEkkTwEKJILkJEililNcNhmyROxNz3oC-ry_YfD_VxNYkaBmw_K64DvZj06WddF0ZMoHQOkLgaEqYFcfkoOyu0jGDFB2qVcMeo4XKx-9hDWygUw2Yi_O3IFqGdhcgsIXp88gw9pbbXJ8jp6QZiCpXqzguL9iFKxf5ZWbZ-EBwped2aRMMUz5ZqfdxQ9_IyqeRV5UQSgELTGaHCukWpvxjTbdT2WCxs0q_aOTbnZaoXpJ0t4MKEoSrqH70iTVxb-yJviLJRodfZacs-oycZW3V3a5nknJkOyt7f3oLLFYZw26ihea04jbju3AUR_W1D_vwBFclgWLkIB4bV47qcDmxfQzVDE4AqqOJfqpK9bnTfgwZ5EmjCH947jp8YVsznVsEp1KaOudcf5OW5KzfTH7mY-nUcSBe-u3dspSAA",
"token_type": "Bearer"
}
```https://community.opengroup.org/osdu/data/open-test-data/-/issues/30Diffrence in how markers are returned2020-01-13T18:12:11ZAaronDiffrence in how markers are returned## Differences in marker structure
Azure Example
```json
"Markers": [
{
"MarkerMeasuredDepth": "0.0",
"MarkerName": "Upper North Sea Group"
},
...## Differences in marker structure
Azure Example
```json
"Markers": [
{
"MarkerMeasuredDepth": "0.0",
"MarkerName": "Upper North Sea Group"
},
{
"MarkerMeasuredDepth": "318.0",
"MarkerName": "Rupel Clay Member"
},....
```
AWS Example
```json
"Markers": [
"Upper North Sea Group",
"Rupel Clay Member",
......
```https://community.opengroup.org/osdu/data/open-test-data/-/issues/52Unknown well names returned on AWS and AZURE2020-01-13T18:08:03ZDavid Diederichd.diederich@opengroup.orgUnknown well names returned on AWS and AZURE[RE_UAT_AWS_IVAAP_+_ML_results.htm](/uploads/7961c7deb6d3d4671579f42f0861a048/RE_UAT_AWS_IVAAP_+_ML_results.htm)[RE_UAT_AWS_IVAAP_+_ML_results.htm](/uploads/7961c7deb6d3d4671579f42f0861a048/RE_UAT_AWS_IVAAP_+_ML_results.htm)2019-12-17https://community.opengroup.org/osdu/data/open-test-data/-/issues/58Slow performance for map_aggregates query for all wells2019-12-19T14:34:14ZMichaelSlow performance for map_aggregates query for all wellsIt seems to take up to 2 minutes to get a list of all wells.
Query:
```
{
"fulltext": "*",
"aggregates_count": 10000,
"start": 0,
"count": 10000,
"metadata": {},
"full_results": false,
"map_aggregates": true,
"facets": [
...It seems to take up to 2 minutes to get a list of all wells.
Query:
```
{
"fulltext": "*",
"aggregates_count": 10000,
"start": 0,
"count": 10000,
"metadata": {},
"full_results": false,
"map_aggregates": true,
"facets": [
"ResourceType"
],
"GeoLocation": {
"type": "Polygon",
"coordinates": [
[
[
-151.87499999999994,
-53.10633730864091
],
[
151.87499999999994,
-53.10633730864091
],
[
151.87499999999994,
53.106337308641066
],
[
-151.87499999999994,
53.106337308641066
],
[
-151.87499999999994,
-53.10633730864091
]
]
]
}
}
```https://community.opengroup.org/osdu/data/open-test-data/-/issues/35AWS Doesn't always return all records2019-12-13T14:13:02ZAaronAWS Doesn't always return all records# Reported Record count and actually records returned do not match
![image](/uploads/b179a9844a2d066300c42e78b3defae5/image.png)
Occurs in these files
[INTFindAllWellsWithOperatorIn.json](/uploads/e0e493344f6c01d0afa644439724f914/IN...# Reported Record count and actually records returned do not match
![image](/uploads/b179a9844a2d066300c42e78b3defae5/image.png)
Occurs in these files
[INTFindAllWellsWithOperatorIn.json](/uploads/e0e493344f6c01d0afa644439724f914/INTFindAllWellsWithOperatorIn.json)
[INTFindAllWellsWithAuthorIn.json](/uploads/dd7504442eccb4f5dc581a0aee247a61/INTFindAllWellsWithAuthorIn.json)
[INTfindWellsWithTrajAndMarkersIn.json](/uploads/885daec3f5b3449a2177cfd59c6edee2/INTfindWellsWithTrajAndMarkersIn.json)https://community.opengroup.org/osdu/data/open-test-data/-/issues/38Azure not showing Trajectory file in file list2019-12-12T15:12:07ZAaronAzure not showing Trajectory file in file listThe well markers show up with the wellbore but the Trajectories do not.
```json
"Files": [
{
"FileSize": 0,
"FileSource": "",
"F...The well markers show up with the wellbore but the Trajectories do not.
```json
"Files": [
{
"FileSize": 0,
"FileSource": "",
"Filename": "5020-csv-1028.csv:",
"PreLoadFilePath": "https://r1devosdudemodata.blob.core.windows.net/tno/data/formation-tops/5020.csv",
"ResourceSecurityClassification": "srn:reference-data/ResourceSecurityClassification:RESTRICTED:",
"ResourceType": "srn:file/csv:",
"ResourceTypeID": "srn:type:file/csv:",
"SRN": "srn:file/csv:a66c7a8912e111eaaa3a5515cad54b90:1",
"SecurityClassification": "srn:reference-data/ResourceSecurityClassification:RESTRICTED:"
}
],
```https://community.opengroup.org/osdu/data/open-test-data/-/issues/36500 on warm up AWS2019-12-12T14:28:04ZAaron500 on warm up AWSFirst hit to aws after no activity get 500 error
![image](/uploads/21435c740e0d79ccc14d8b20cd29cb95/image.png)First hit to aws after no activity get 500 error
![image](/uploads/21435c740e0d79ccc14d8b20cd29cb95/image.png)https://community.opengroup.org/osdu/data/open-test-data/-/issues/37Diffrences how files associated with well/wellbore are returned2019-12-11T19:48:19ZAaronDiffrences how files associated with well/wellbore are returnedExtra properties are returned in Azure vs AWS
AWS
```json
"Files": [
{
"Filename": "5017.csv",
"SRN": "srn:file/csv:e568dc0769574e12a08cbdded0d54619:1"
...Extra properties are returned in Azure vs AWS
AWS
```json
"Files": [
{
"Filename": "5017.csv",
"SRN": "srn:file/csv:e568dc0769574e12a08cbdded0d54619:1"
},
{
"Filename": "5017.csv",
"SRN": "srn:file/csv:80404322f8034d399a75be2adf507f8d:1"
}
```
AZURE
```json
"Files": [
{
"FileSize": 0,
"FileSource": "",
"Filename": "5020-csv-1028.csv:",
"PreLoadFilePath": "https://r1devosdudemodata.blob.core.windows.net/tno/data/formation-tops/5020.csv",
"ResourceSecurityClassification": "srn:reference-data/ResourceSecurityClassification:RESTRICTED:",
"ResourceType": "srn:file/csv:",
"ResourceTypeID": "srn:type:file/csv:",
"SRN": "srn:file/csv:a66c7a8912e111eaaa3a5515cad54b90:1",
"SecurityClassification": "srn:reference-data/ResourceSecurityClassification:RESTRICTED:"
}
],
```https://community.opengroup.org/osdu/data/open-test-data/-/issues/31Formation Tops have non-english character issues2019-12-09T19:48:23ZAaronFormation Tops have non-english character issues##Character Conversion in Data prep
It appears that some of the marker files have had odd conversions ascii type at some point in the prep the formation names came across strangely see this from the original tops file fro 5722.
[5722...##Character Conversion in Data prep
It appears that some of the marker files have had odd conversions ascii type at some point in the prep the formation names came across strangely see this from the original tops file fro 5722.
[5722.csv](/uploads/3af731f06b8901fb2a26e8e4dfddd9f0/5722.csv)