OSDU Software issueshttps://community.opengroup.org/groups/osdu/-/issues2024-02-22T15:26:10Zhttps://community.opengroup.org/osdu/platform/pre-shipping/-/issues/497Erroneous Inconsistent search results when adding or removing records2024-02-22T15:26:10ZMichaelErroneous Inconsistent search results when adding or removing recordsWe are adding and removing records from OSDU Storage, and we see erroneous results where a record that we add is not shown in the search result or a record that we delete is shown.
We tried waiting for the expected result from the sear...We are adding and removing records from OSDU Storage, and we see erroneous results where a record that we add is not shown in the search result or a record that we delete is shown.
We tried waiting for the expected result from the search and then trying again. We see erroneous results sometimes when we find it in the search results, but the next search does not find it. Similarly, for deleted records, we sometimes see the deletion only to see it not deleted in the next search.
Here is a video that demonstrates the inconsistent search results after a record has been created: [osdu_indexing_consistency.zip](/uploads/88858771b3a497a7336dd3bf47bb0886/osdu_indexing_consistency.zip)
Here is the postman collection that is used in the video: [Indexing_Test.postman_collection.json](/uploads/6958cd6c0b3da081a54a46488e1a2497/Indexing_Test.postman_collection.json)https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/214Error Azure Infra setup on step "Deploy Monitoring Resources"2021-11-23T08:53:37ZSergey ZemskovError Azure Infra setup on step "Deploy Monitoring Resources"I have successfully completed all the required steps before:
- `common_prepare.sh` script has executed without errors and warnings
- `.envrc` file contain all necessary parameters
I get this error while execute deployment `terraform app...I have successfully completed all the required steps before:
- `common_prepare.sh` script has executed without errors and warnings
- `.envrc` file contain all necessary parameters
I get this error while execute deployment `terraform apply -var-file custom.tfvars`:
```
Error: Error creating or updating Scheduled Query Rule "airflow-import-errors-alert-osdu-mvp-mrdemo-e5sm" (resource group "osdu-mvp-mrdemo-e5sm-rg"): insights.ScheduledQueryRulesClient#CreateOrUpdate: Failure responding to request: StatusCode=400 -- Original Error: autorest/azure: Service returned an error. Status=400 Code="BadRequest" Message="Scope 'osdu-mvp-crdemo-dz5-ai' does not exists"
on main.tf line 239, in resource "azurerm_monitor_scheduled_query_rules_alert" "alerts":
239: resource "azurerm_monitor_scheduled_query_rules_alert" "alerts" {
```https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/79Error diagnostics - need to improve significantly2022-12-13T00:31:21ZDebasis ChatterjeeError diagnostics - need to improve significantlyYou may start of by checking here.
https://community.opengroup.org/osdu/platform/pre-shipping/-/tree/main/R3-M14/AWS-M14/Ingestion%20DAG%20CSV
For each and every problem, I did not get suitable clue from error log.
1. problem in data. ...You may start of by checking here.
https://community.opengroup.org/osdu/platform/pre-shipping/-/tree/main/R3-M14/AWS-M14/Ingestion%20DAG%20CSV
For each and every problem, I did not get suitable clue from error log.
1. problem in data. ELEVATION has non numeric value.
2. problem in schema - TVD, Latitude, Longitude - missed "type=string".
3. At times when the file is missed (incorrect sequence in collection), it gives fatal error instead of saying clearly that "Unable to get the CSV file".
Caused situation where record gets created, we can see all properties from Storage service, but none from Search service.
Nearly impossible to figure out, for average Data Loader (user).
Next, imagine we are ingesting 1000 rows from source CSV and problem occurs in row-253 and row-455.
User's expectation is that CSV Ingestion program should pinpoint and clearly indicate row number and type of problem which caused the failure.
cc @chad , @tdixonhttps://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/issues/72Error getting data from Redis on lost connection2023-09-18T07:26:13ZYurii Ruban [EPAM / GCP]Error getting data from Redis on lost connectionIn case of loss of connection between the service and Redis, the processing of requests to the service is delayed and an error of type
`Command timed out after 30 SECONDS` is received.
Redis (cache service) is a productivity tool. In c...In case of loss of connection between the service and Redis, the processing of requests to the service is delayed and an error of type
`Command timed out after 30 SECONDS` is received.
Redis (cache service) is a productivity tool. In case of a lost connection, delays in processing requests increase, and, in general, the service becomes unviable.
`entitlements-v2.app: An unknown error has occurred
AppException(error=AppError(code=500, reason=Internal Server Error, message=An unknown error has occurred, errors=null, debuggingInfo=null, originalException=com.lambdaworks.redis.RedisCommandTimeoutException: Command timed out after 30 SECONDS), originalException=com.lambdaworks.redis.RedisCommandTimeoutException: Command timed out after 30 SECONDS)
...
Caused by: com.lambdaworks.redis.RedisCommandTimeoutException: Command timed out after 30 SECONDS
`
I recommend adding Redis health checks.M20 - Release 0.23Yurii Ruban [EPAM / GCP]Yurii Ruban [EPAM / GCP]https://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/issues/7Error installing Helm Chart for OSDU on Azure Airflow2021-11-24T08:30:02ZSergey ZemskovError installing Helm Chart for OSDU on Azure AirflowIt looks like commands in `yaml` is deprecated
After running this command `helm install airflow osdu-airflow -n $NAMESPACE -f osdu_airflow_custom_values.yaml` I get error:
```
W1123 16:50:24.601955 9797 warnings.go:70] rbac.authoriza...It looks like commands in `yaml` is deprecated
After running this command `helm install airflow osdu-airflow -n $NAMESPACE -f osdu_airflow_custom_values.yaml` I get error:
```
W1123 16:50:24.601955 9797 warnings.go:70] rbac.authorization.k8s.io/v1beta1 Role is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 Role
W1123 16:50:24.769256 9797 warnings.go:70] rbac.authorization.k8s.io/v1beta1 RoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 RoleBinding
W1123 16:50:26.277249 9797 warnings.go:70] extensions/v1beta1 Ingress is deprecated in v1.14+, unavailable in v1.22+; use networking.k8s.io/v1 Ingress
W1123 16:50:28.803284 9797 warnings.go:70] rbac.authorization.k8s.io/v1beta1 Role is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 Role
W1123 16:50:28.971781 9797 warnings.go:70] rbac.authorization.k8s.io/v1beta1 RoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 RoleBinding
W1123 16:50:29.706011 9797 warnings.go:70] extensions/v1beta1 Ingress is deprecated in v1.14+, unavailable in v1.22+; use networking.k8s.io/v1 Ingress
Error: failed post-install: timed out waiting for the condition
```https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/317Error: Plugin did not respond2023-09-11T19:29:09ZYukuo WangError: Plugin did not respondWe captured several terraform plan failure recently.
│ Error: Plugin did not respond
│
│ with module.system_storage_account.azurerm_storage_account.main,
│ on ../../../modules/providers/azure/storage-account/main.tf line 19, in reso...We captured several terraform plan failure recently.
│ Error: Plugin did not respond
│
│ with module.system_storage_account.azurerm_storage_account.main,
│ on ../../../modules/providers/azure/storage-account/main.tf line 19, in resource "azurerm_storage_account" "main":
│ 19: resource "azurerm_storage_account" "main" {
│
│ The plugin encountered an error, and failed to respond to the
│ plugin.(*GRPCProvider).ReadResource call. The plugin logs may contain more
│ details.
╷
│ Error: Request cancelled
│
│ with module.keyvault_policy.azurerm_key_vault_access_policy.keyvault[0],
│ on ../../../modules/providers/azure/keyvault-policy/main.tf line 15, in resource "azurerm_key_vault_access_policy" "keyvault":
│ 15: resource "azurerm_key_vault_access_policy" "keyvault" {
│
│ The plugin.(*GRPCProvider).UpgradeResourceState request was cancelled.
╵
Also with stack trace logs:
Stack trace from the terraform-provider-azurerm_v3.39.1_x5 plugin:
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x4c12582]
goroutine 1950 [running]:
github.com/hashicorp/terraform-provider-azurerm/internal/services/containers.resourceKubernetesClusterRead(0xc001d94480, {0x5d01ea0?, 0xc000737000})
github.com/hashicorp/terraform-provider-azurerm/internal/services/containers/kubernetes_cluster_resource.go:2060 +0x9c2
github.com/hashicorp/terraform-plugin-sdk/v2/helper/schema.(*Resource).read(0x6f8e340?, {0x6f8e340?, 0xc001fd32c0?}, 0xd?, {0x5d01ea0?, 0xc000737000?})
github.com/hashicorp/terraform-plugin-sdk/v2@v2.24.1/helper/schema/resource.go:712 +0x178
github.com/hashicorp/terraform-plugin-sdk/v2/helper/schema.(*Resource).RefreshWithoutUpgrade(0xc000b56b60, {0x6f8e340, 0xc001fd32c0}, 0xc001f90750, {0x5d01ea0, 0xc000737000})
github.com/hashicorp/terraform-plugin-sdk/v2@v2.24.1/helper/schema/resource.go:1015 +0x585
github.com/hashicorp/terraform-plugin-sdk/v2/helper/schema.(*GRPCProviderServer).ReadResource(0xc00152f980, {0x6f8e340?, 0xc001fd2ea0?}, 0xc001c5a100)
github.com/hashicorp/terraform-plugin-sdk/v2@v2.24.1/helper/schema/grpc_provider.go:613 +0x4a5
github.com/hashicorp/terraform-plugin-go/tfprotov5/tf5server.(*server).ReadResource(0xc001930320, {0x6f8e340?, 0xc001fd2780?}, 0xc001127140)
github.com/hashicorp/terraform-plugin-go@v0.14.1/tfprotov5/tf5server/server.go:748 +0x4b1
github.com/hashicorp/terraform-plugin-go/tfprotov5/internal/tfplugin5._Provider_ReadResource_Handler({0x63c6d80?, 0xc001930320}, {0x6f8e340, 0xc001fd2780}, 0xc001347b20, 0x0)
github.com/hashicorp/terraform-plugin-go@v0.14.1/tfprotov5/internal/tfplugin5/tfplugin5_grpc.pb.go:349 +0x170
google.golang.org/grpc.(*Server).processUnaryRPC(0xc00027a000, {0x6f9e380, 0xc000f9e000}, 0xc002595b00, 0xc001993530, 0xb246a90, 0x0)
google.golang.org/grpc@v1.50.1/server.go:1340 +0xd23
google.golang.org/grpc.(*Server).handleStream(0xc00027a000, {0x6f9e380, 0xc000f9e000}, 0xc002595b00, 0x0)
google.golang.org/grpc@v1.50.1/server.go:1713 +0xa2f
google.golang.org/grpc.(*Server).serveStreams.func1.2()
google.golang.org/grpc@v1.50.1/server.go:965 +0x98
created by google.golang.org/grpc.(*Server).serveStreams.func1
google.golang.org/grpc@v1.50.1/server.go:963 +0x28a
Error: The terraform-provider-azurerm_v3.39.1_x5 plugin crashed!
This is always indicative of a bug within the plugin. It would be immensely
helpful if you could report the crash with the plugin's maintainers so that it
can be fixed. The output above should help diagnose the issue.
By troubleshooting on this, we noticed that there is a bug fix:
Fix nil panic by correcting nil check expression: https://github.com/hashicorp/terraform-provider-azurerm/pull/21850
This fix is inclued in terraform-provider-azurerm v3.57.0 (May 19, 2023)
https://github.com/hashicorp/terraform-provider-azurerm/blob/v3.57.0/CHANGELOG.md
BUG FIXES:
data.azurerm_kubernetes_cluster - prevent a panic when some values returned are nil (#21850)https://community.opengroup.org/osdu/ui/admin-ui-group/admin-ui/-/issues/53Error Search Reference-data2024-03-21T13:32:44ZFrank HaeselerError Search Reference-datawe have an internal server error when we want to search a reference data
![image.png](/uploads/1f9a25713cafa5de3acfb8fc786b3c6b/image.png)we have an internal server error when we want to search a reference data
![image.png](/uploads/1f9a25713cafa5de3acfb8fc786b3c6b/image.png)https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-dags/-/issues/53Errors with running tests for Ingestion DAGs2021-03-23T10:19:51ZBrady Spiva [AWS]Errors with running tests for Ingestion DAGs## Expected behavior:
Unit tests and end-to-end tests should work for core code out of the box.
## Observed behavior:
When attempting to run unit and end-to-end tests for Ingestion DAGs core code, the tests in /plugin-unit-tests/ fail d...## Expected behavior:
Unit tests and end-to-end tests should work for core code out of the box.
## Observed behavior:
When attempting to run unit and end-to-end tests for Ingestion DAGs core code, the tests in /plugin-unit-tests/ fail due to an issue related to Airflow's "variable" table ( see the error text below ).
From researching this issue, it appears that this could be related to needing to initialize the Airflow DB?
```❯ pytest /Users/spivbrad/Documents/aws-osdu-code/os-ingestion-dags/tests/plugin-unit-tests
===================================================== test session starts ======================================================
platform darwin -- Python 3.8.6, pytest-6.2.2, py-1.10.0, pluggy-0.13.1
rootdir: /Users/spivbrad/Documents/aws-osdu-code/os-ingestion-dags
plugins: anyio-2.2.0, dash-1.19.0, mock-3.5.1
collected 79 items / 1 error / 78 selected
============================================================ ERRORS ============================================================
_____________________________ ERROR collecting tests/plugin-unit-tests/test_process_manifest_r2.py _____________________________
../../../.local/lib/python3.8/site-packages/sqlalchemy/engine/base.py:1705: in _execute_context
self.dialect.do_execute(
../../../.local/lib/python3.8/site-packages/sqlalchemy/engine/default.py:681: in do_execute
cursor.execute(statement, parameters)
E sqlite3.OperationalError: no such table: variable
The above exception was the direct cause of the following exception:
tests/plugin-unit-tests/test_process_manifest_r2.py:27: in <module>
from operators import process_manifest_r2
src/plugins/operators/process_manifest_r2.py:37: in <module>
config.read(Variable.get("core__config__dataload_config_path"))
../../../.local/lib/python3.8/site-packages/airflow/models/variable.py:123: in get
var_val = Variable.get_variable_from_secrets(key=key)
../../../.local/lib/python3.8/site-packages/airflow/models/variable.py:181: in get_variable_from_secrets
var_val = secrets_backend.get_variable(key=key)
../../../.local/lib/python3.8/site-packages/airflow/utils/session.py:65: in wrapper
return func(*args, session=session, **kwargs)
../../../.local/lib/python3.8/site-packages/airflow/secrets/metastore.py:66: in get_variable
var_value = session.query(Variable).filter(Variable.key == key).first()
../../../.local/lib/python3.8/site-packages/sqlalchemy/orm/query.py:2695: in first
return self.limit(1)._iter().first()
../../../.local/lib/python3.8/site-packages/sqlalchemy/orm/query.py:2779: in _iter
result = self.session.execute(
../../../.local/lib/python3.8/site-packages/sqlalchemy/orm/session.py:1653: in execute
result = conn._execute_20(statement, params or {}, execution_options)
../../../.local/lib/python3.8/site-packages/sqlalchemy/engine/base.py:1520: in _execute_20
return meth(self, args_10style, kwargs_10style, execution_options)
../../../.local/lib/python3.8/site-packages/sqlalchemy/sql/elements.py:313: in _execute_on_connection
return connection._execute_clauseelement(
../../../.local/lib/python3.8/site-packages/sqlalchemy/engine/base.py:1389: in _execute_clauseelement
ret = self._execute_context(
../../../.local/lib/python3.8/site-packages/sqlalchemy/engine/base.py:1748: in _execute_context
self._handle_dbapi_exception(
../../../.local/lib/python3.8/site-packages/sqlalchemy/engine/base.py:1929: in _handle_dbapi_exception
util.raise_(
../../../.local/lib/python3.8/site-packages/sqlalchemy/util/compat.py:198: in raise_
raise exception
../../../.local/lib/python3.8/site-packages/sqlalchemy/engine/base.py:1705: in _execute_context
self.dialect.do_execute(
../../../.local/lib/python3.8/site-packages/sqlalchemy/engine/default.py:681: in do_execute
cursor.execute(statement, parameters)
E sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) no such table: variable
E [SQL: SELECT variable.val AS variable_val, variable.id AS variable_id, variable."key" AS variable_key, variable.is_encrypted AS variable_is_encrypted
E FROM variable
E WHERE variable."key" = ?
E LIMIT ? OFFSET ?]
E [parameters: ('core__config__dataload_config_path', 1, 0)]
E (Background on this error at: http://sqlalche.me/e/14/e3q8)
=================================================== short test summary info ====================================================
ERROR tests/plugin-unit-tests/test_process_manifest_r2.py - sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) no su...
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
======================================================= 1 error in 1.18s =======================================================
```
## A recommended solution:
The [README](https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-dags/-/tree/master/tests) for the tests mention a docker image that is used for testing. 1) could this image be made available for cloud providers to run these tests in a consistent environment? 2) could we alter the dockerfile used to run the `unit_tests.sh`, `set_airflow_env.sh`, and `test_dags.sh` scripts?
Is this feasible?JoeSiarhei Khaletski (EPAM)Kateryna Kurach (EPAM)Alan HensonJoehttps://community.opengroup.org/osdu/ui/admin-ui-group/admin-ui/-/issues/18ERR_OSSL_EVP_UNSUPPORTED when running ng serve with node 21.6.12024-02-05T17:05:15ZKadri UmayERR_OSSL_EVP_UNSUPPORTED when running ng serve with node 21.6.1When running ng serve on Windows with node v 21, you get an error ERR_OSSL_EVP_UNSUPPORTED. Check the following to fix https://stackoverflow.com/questions/70582072/npm-run-fails-with-err-ossl-evp-unsupported
Add environment variable:
Po...When running ng serve on Windows with node v 21, you get an error ERR_OSSL_EVP_UNSUPPORTED. Check the following to fix https://stackoverflow.com/questions/70582072/npm-run-fails-with-err-ossl-evp-unsupported
Add environment variable:
PowerShell $env:NODE_OPTIONS = '--openssl-legacy-provider'https://community.opengroup.org/osdu/platform/security-and-compliance/home/-/issues/7Establish inbound security contact for OSDU2020-06-24T20:29:04ZPaco Hope (AWS)Establish inbound security contact for OSDUIf a user/operator of OSDU detects a security issue that the OSDU governing body needs to know about, there should be a straightforward way to contact us.
Named individuals with appropriate levels of responsibility should be identified...If a user/operator of OSDU detects a security issue that the OSDU governing body needs to know about, there should be a straightforward way to contact us.
Named individuals with appropriate levels of responsibility should be identified to participate in a security incident response team. Representing areas like public relations, legal, operations, development. (*Am I really imagining I can tell oil companies how to do incident response?*) Ultimately we just need the appropriate level of due diligence and named people so we can get information shared at the right time and pace.
### Operator Inputs
- **Equinor**: The project should be able to show for short response time related to critical error and security issues.
## Definition of Done
* A contact method is published on the main OSDU web site and in any `README` or other code documentation
* The named contact method reaches at least 2 different people who can respond
* The responders have sufficient access (email, phone) to the OMC and/or PMC to alert on high priority security issues
* An incident response plan is documented (at least in some draft/wiki form) for how to handle high priority security alerts
* A triage plan is documented for normal and low severity security alertsM1 - Release 0.1https://community.opengroup.org/osdu/platform/security-and-compliance/home/-/issues/8Establish outbound security notification channel for OSDU2020-06-24T20:25:57ZPaco Hope (AWS)Establish outbound security notification channel for OSDUIf the OSDU team discovers a security issue that needs to be diseminated to operators/users of OSDU there needs to be an unambiguous and dedicated channel for that kind of notification. Typically this is done through a security alert mai...If the OSDU team discovers a security issue that needs to be diseminated to operators/users of OSDU there needs to be an unambiguous and dedicated channel for that kind of notification. Typically this is done through a security alert mailing list of some kind that operators can subscribe to.
## Definition of Done
* An email list is established with a reputable, reliable mailing list provider (one that has a good reputation and is unlikely to be marked as spam)
* Outsiders can sign up for alerts on this mailing list and will receive the emails
* People from the OMC and PMC can send emails to this mailing list as required
* The email list is published widely on the web site and in materials distributed with the code
* Participating member firms have at least one member subscribed to this mailing listM1 - Release 0.1https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/reservoir/open-etp-server/-/issues/109ETP-8 Unexpected Dataspace schema: Got v9; want v13: <path>2024-01-03T15:08:46ZDzmitry Malkevich (EPAM)ETP-8 Unexpected Dataspace schema: Got v9; want v13: <path>GC instance for release M22 was upgraded from M21 with all data retained. When making call `Get Resources List`
```
curl --location --request GET 'https://preship.gcp.gnrg-osdu.projects.epam.com/api/reservoir-ddms/v2/dataspaces/Dani%2FVo...GC instance for release M22 was upgraded from M21 with all data retained. When making call `Get Resources List`
```
curl --location --request GET 'https://preship.gcp.gnrg-osdu.projects.epam.com/api/reservoir-ddms/v2/dataspaces/Dani%2FVolve-Grid/resources' \
--header 'Authorization: Bearer <token>' \
--header 'data-partition-id: m19'
```
to any of existing dataspaces user gets 500 error we are seeing following error in logs:
<details><summary>ETP-8 Unexpected Dataspace schema: Got v9; want v13: Dani/Volve-Grid</summary>
```json
{
"textPayload": "\tETP-8 Unexpected Dataspace schema: Got v9; want v13: Dani/Volve-Grid",
"insertId": "ahrd0nhq1me4l9sl",
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "default",
"project_id": "osdu-service-prod",
"location": "us-central1-c",
"pod_name": "oetp-server-799d96f6b6-r4g5k",
"cluster_name": "asm-primary",
"container_name": "oetp-server"
}
},
"timestamp": "2024-01-03T15:02:58.479257813Z",
"severity": "INFO",
"labels": {
"k8s-pod/service_istio_io/canonical-name": "oetp-server",
"compute.googleapis.com/resource_name": "gke-asm-primary-asm-primary-pool-e828b97e-ml8z",
"k8s-pod/service_istio_io/canonical-revision": "latest",
"k8s-pod/pod-template-hash": "799d96f6b6",
"k8s-pod/security_istio_io/tlsMode": "istio",
"k8s-pod/app": "oetp-server"
},
"logName": "projects/osdu-service-prod/logs/stdout",
"receiveTimestamp": "2024-01-03T15:02:58.554538520Z"
}
```
</details>
From what we understood server is trying to update DB schema but fails, so we need your input on fixing this.
We've re-uploaded data to demo/Volve and now able to successfully retrieve resources for this dataspace.https://community.opengroup.org/osdu/platform/system/home/-/issues/71Evaluate and change APIs to comply with R3 schema2021-01-27T21:56:30ZChris ZhangEvaluate and change APIs to comply with R3 schemaOSDU schemas from R2 to R3 may break existing APIs. We need to evaluate the impact of APIs for all services, identify and fix the APIs so that they are not broken with R3 schema released.
One example is the previous Delivery service AP...OSDU schemas from R2 to R3 may break existing APIs. We need to evaluate the impact of APIs for all services, identify and fix the APIs so that they are not broken with R3 schema released.
One example is the previous Delivery service API /delivery/getFileSignedUrl, which was recently moved to be under File service. This API takes SRN as inputs, which is not valid anymore in R3 schema.https://community.opengroup.org/osdu/ui/data-loading/osdu-cli/-/issues/14Evaluate if CLI should use OSDU SDK2022-01-28T13:28:44ZJan MortensenEvaluate if CLI should use OSDU SDKToday the CLI is using [Equinors public SDK-backend](https://github.com/equinor/osdu-sdk-python), but going forward we should consider switching to the "official" [OSDU SDK](https://community.opengroup.org/osdu/platform/system/sdks/commo...Today the CLI is using [Equinors public SDK-backend](https://github.com/equinor/osdu-sdk-python), but going forward we should consider switching to the "official" [OSDU SDK](https://community.opengroup.org/osdu/platform/system/sdks/common-python-sdk).https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/151Event Grid Role Assignment for Webhook.2021-06-23T09:27:44ZKomal MakkarEvent Grid Role Assignment for Webhook.
<!--- Provide a general summary of the issue in the Title above -->
# Priority: High
## Expected Behavior
<!--- Tell us what should happen -->
Register Service should be able to create a subscriber on Event Grid Topic.
## Current Beh...
<!--- Provide a general summary of the issue in the Title above -->
# Priority: High
## Expected Behavior
<!--- Tell us what should happen -->
Register Service should be able to create a subscriber on Event Grid Topic.
## Current Behavior
<!--- Tell us what happens instead of the expected behavior -->
EG errors out during the creation of subscribers is blocked.
## Possible Solution
<!--- Not obligatory, but suggest a fix/reason for the bug, -->
https://docs.microsoft.com/en-us/azure/event-grid/secure-webhook-delivery
## Steps to Reproduce
<!--- Provide a link to a live example or an unambiguous set of steps to -->
<!--- reproduce this bug. Include code to reproduce, if relevant -->
Run ITs on Notification or register. Examine the logs.
## Impact
<!--- How has this issue affected you? What are you trying to accomplish? -->
<!--- Providing context helps us come up with a solution that is most useful in the real world -->
#### Environments impacted
All the environments that we have been impacted.
#### Release impacted
OSDU M5 tagging is waiting for this fix.
#### Services impacted
Register, Notification
#### Scenario impacted
Creation of a new subscriber to a topic.
<!--- Provide a general summary of the issue in the Title above -->
## Detailed Description
<!--- Provide a detailed description of the change or addition you are proposing -->
Due to security issues, EG updated the API behavior and hence all the environments got impacted. For more details, refer [this](https://docs.microsoft.com/en-us/azure/event-grid/secure-webhook-delivery)Komal MakkarKomal Makkarhttps://community.opengroup.org/osdu/platform/consumption/geospatial/-/issues/276Event Tracking/Timelines2024-02-13T16:28:15ZNoel OkanyaEvent Tracking/TimelinesAs a GCZ Product Owner, I want to prepare for the below events, so that we can provide the stakeholders with GCZ updates:
1. EAGE Digital in March 24, 2024 (no OSDU topic)
2. ERGIS event in April 24th - 25th, 2024 - Esri
3. OSDU F2F in E...As a GCZ Product Owner, I want to prepare for the below events, so that we can provide the stakeholders with GCZ updates:
1. EAGE Digital in March 24, 2024 (no OSDU topic)
2. ERGIS event in April 24th - 25th, 2024 - Esri
3. OSDU F2F in Europe April 24th week (No action from the team)https://community.opengroup.org/osdu/ui/data-loading/wellbore-ddms-data-loader/-/issues/44Exception display improvement2022-12-13T08:25:26ZChad LeongException display improvementWe need to display the error in more user-friendly way to show that this is a 404 error.
```
C:\Project\OSDU\CodeBase\data-ingestion\LAS\wellbore-ddms-data-loader\venv\Scripts\python.exe C:/Project/OSDU/CodeBase/data-ingestion/LAS/wellb...We need to display the error in more user-friendly way to show that this is a 404 error.
```
C:\Project\OSDU\CodeBase\data-ingestion\LAS\wellbore-ddms-data-loader\venv\Scripts\python.exe C:/Project/OSDU/CodeBase/data-ingestion/LAS/wellbore-ddms-data-loader/demo/LAS_Loader_WellboreDDMS.py
Successfully authenticated
(1/6) Parsing Las File for header info...
(2/6) Creating wellbore record from LAS data...
Traceback (most recent call last):
File "C:\Project\OSDU\CodeBase\data-ingestion\LAS\wellbore-ddms-data-loader\demo\LAS_Loader_WellboreDDMS.py", line 92, in <module>
wellbore_id = res.json()["recordIds"][0]
File "C:\Project\OSDU\CodeBase\data-ingestion\LAS\wellbore-ddms-data-loader\venv\lib\site-packages\httpx\_models.py", line 1514, in json
Response: b'<html>\r\n<head><title>404 Not Found</title></head>\r\n<body>\r\n<center><h1>404 Not Found</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n'
return jsonlib.loads(self.content.decode(encoding), **kwargs)
File "C:\Users\0023OI744\AppData\Local\Programs\Python\Python39\lib\json\__init__.py", line 346, in loads
return _default_decoder.decode(s)
File "C:\Users\0023OI744\AppData\Local\Programs\Python\Python39\lib\json\decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "C:\Users\0023OI744\AppData\Local\Programs\Python\Python39\lib\json\decoder.py", line 355, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
```
Process finished with exit code 1https://community.opengroup.org/osdu/platform/system/partition/-/issues/37Exception encountered during context initialization2023-12-07T05:43:18ZNikhil Patilnikhil.patil5@ibm.comException encountered during context initializationBeanCreationException: Error creating bean with name 'springSecurityFilterChain' defined in class path resource [org/springframework/security/config/annotation/web/configuration/WebSecurityConfiguration.class]
Bean instantiation via fact...BeanCreationException: Error creating bean with name 'springSecurityFilterChain' defined in class path resource [org/springframework/security/config/annotation/web/configuration/WebSecurityConfiguration.class]
Bean instantiation via factory method Failed to instantiate [javax.servlet.Filter]: Factory method 'springSecurityFilterChain' threw exceptio java.lang.NoClassDefFoundError: org/springframework/security/core/context/DeferredSecurityContextM22 - Release 0.25Nikhil Patilnikhil.patil5@ibm.comNikhil Patilnikhil.patil5@ibm.comhttps://community.opengroup.org/osdu/platform/data-flow/real-time/consumers/python-cli-kafka-consumer/-/issues/2Excepturi qui tempore officiis.2021-02-15T16:01:25ZDouglas DohmeyerExcepturi qui tempore officiis.###### Voluptas
Molestiae nostrum aut. Nisi voluptatem natus. Voluptas accusamus voluptatum. Fuga dolor dignissimos. Natus consequatur adipisci.
## Sit
Repudiandae delectus quia. Vitae non ad. Quod neque perferendis.
###### Dolor
Earum r...###### Voluptas
Molestiae nostrum aut. Nisi voluptatem natus. Voluptas accusamus voluptatum. Fuga dolor dignissimos. Natus consequatur adipisci.
## Sit
Repudiandae delectus quia. Vitae non ad. Quod neque perferendis.
###### Dolor
Earum reprehenderit eum. Quia qui voluptatem. Cum voluptatibus eligendi.
#### Laboriosam
At facilis a. Recusandae hic quasi. Voluptas alias eum.
Maiores voluptatem rerum. Modi deleniti veniam. *Nemo* rerum minus.Sample GitLab Project Milestone 22021-10-22https://community.opengroup.org/osdu/platform/data-flow/real-time/processors/pipe/-/issues/2Excepturi qui tempore officiis.2021-02-15T16:01:25ZDmitry KniazevExcepturi qui tempore officiis.###### Voluptas
Molestiae nostrum aut. Nisi voluptatem natus. Voluptas accusamus voluptatum. Fuga dolor dignissimos. Natus consequatur adipisci.
## Sit
Repudiandae delectus quia. Vitae non ad. Quod neque perferendis.
###### Dolor
Earum r...###### Voluptas
Molestiae nostrum aut. Nisi voluptatem natus. Voluptas accusamus voluptatum. Fuga dolor dignissimos. Natus consequatur adipisci.
## Sit
Repudiandae delectus quia. Vitae non ad. Quod neque perferendis.
###### Dolor
Earum reprehenderit eum. Quia qui voluptatem. Cum voluptatibus eligendi.
#### Laboriosam
At facilis a. Recusandae hic quasi. Voluptas alias eum.
Maiores voluptatem rerum. Modi deleniti veniam. *Nemo* rerum minus.Sample GitLab Project Milestone 22021-10-21