helm-charts-azure merge requestshttps://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests2024-03-27T15:21:17Zhttps://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/786upgrade opa2024-03-27T15:21:17Zsaketh somarajuupgrade opa- Upgrade OPA image from `0.56.0-rootless` to `0.61.1`.
- Community recommendations document [reference](https://osdu.pages.opengroup.org/platform/security-and-compliance/policy/opa/#opa-required-and-recommended-versions)
- Changes are t...- Upgrade OPA image from `0.56.0-rootless` to `0.61.1`.
- Community recommendations document [reference](https://osdu.pages.opengroup.org/platform/security-and-compliance/policy/opa/#opa-required-and-recommended-versions)
- Changes are tested in GLAB env. [Storage service Job](https://community.opengroup.org/osdu/platform/system/storage/-/jobs/2695263) and [policy service pipelines](https://community.opengroup.org/osdu/platform/security-and-compliance/policy/-/pipelines/251940), No breaking changes observed in GLAB env.
- Reference to the [original docker hub image](https://hub.docker.com/layers/openpolicyagent/opa/0.62.1/images/sha256-5adc63cf8042d2ebdb02c8cf75a705780d5eadba0e56c47ac15e5399170490e2?context=explore)M23 - Release 0.26saketh somarajusaketh somarajuhttps://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/785Add schema-upgrade charts to osdu azure2024-03-17T09:10:09ZDeepanshu SinghalAdd schema-upgrade charts to osdu azureAdded schema-upgrade directory in osdu-azure to standardize the deployment of schema upgrade service.Added schema-upgrade directory in osdu-azure to standardize the deployment of schema upgrade service.M23 - Release 0.26Deepanshu SinghalDeepanshu Singhalhttps://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/784Rafs update and ddms config restart2024-03-11T14:38:54ZArturo Hernandez [EPAM]Rafs update and ddms config restart* Update latest changes for rafs-ddms (Schema service and liveness variables)
* Setup Checksum pod annotation for DDMS
* When variable it is changed, the service will not be restarted, needs to be restarted manually, this change use p...* Update latest changes for rafs-ddms (Schema service and liveness variables)
* Setup Checksum pod annotation for DDMS
* When variable it is changed, the service will not be restarted, needs to be restarted manually, this change use pod annotation to restart service if configmap variables changes.M23 - Release 0.26Arturo Hernandez [EPAM]Arturo Hernandez [EPAM]https://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/783[MSCOSDU-35837] enable oid based auth by default2024-03-11T11:54:26Zsaketh somaraju[MSCOSDU-35837] enable oid based auth by default- As per recent discussions and new requirements, to make sure azure osdu uses similar auth process as ADME., This MR proposes to enable oid based auth by default
- for brownfield environments, this would require inviting users to the te...- As per recent discussions and new requirements, to make sure azure osdu uses similar auth process as ADME., This MR proposes to enable oid based auth by default
- for brownfield environments, this would require inviting users to the tenant and onboarding them into OSDU with their OID to ensure there's seamless transition.
Related to https://community.opengroup.org/osdu/platform/ci-cd-pipelines/-/merge_requests/1059M23 - Release 0.26saketh somarajusaketh somarajuhttps://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/782Removed duplicate value of event_grid_enabled in schema values.yaml2024-02-29T06:28:32ZDeepanshu SinghalRemoved duplicate value of event_grid_enabled in schema values.yamlRemoved the duplicate key event_grid_enabled from values.yaml file of schema helm charts.Removed the duplicate key event_grid_enabled from values.yaml file of schema helm charts.M23 - Release 0.26Deepanshu SinghalDeepanshu Singhalhttps://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/781Updated schema worker url in indexer queue and enabled it in auth policy in i...2024-02-28T10:31:26ZDeepanshu SinghalUpdated schema worker url in indexer queue and enabled it in auth policy in indexerThe changes are done to fix the azure_tests failure in the MR pipeline - https://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/383
Corrected the schema_worker_url and allowed the indexer service to get resp...The changes are done to fix the azure_tests failure in the MR pipeline - https://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/383
Corrected the schema_worker_url and allowed the indexer service to get responses from this url by adding it's reference in the auth policy.
Enabled service bus and disabled event grid as it is a requirement for the MR above to work.M23 - Release 0.26Deepanshu SinghalDeepanshu Singhalhttps://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/780update airflow user create command2024-02-24T06:50:26Zsaketh somarajuupdate airflow user create command- Update airflow user create command in documentation
- REF of official airflow documentation https://airflow.apache.org/docs/apache-airflow/stable/cli-and-env-variables-ref.html#create_repeat1- Update airflow user create command in documentation
- REF of official airflow documentation https://airflow.apache.org/docs/apache-airflow/stable/cli-and-env-variables-ref.html#create_repeat1M23 - Release 0.26saketh somarajusaketh somarajuhttps://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/779AppInsights migration - Removing duplicated key2024-02-26T12:58:46ZArturo Hernandez [EPAM]AppInsights migration - Removing duplicated keyOn MR !720 we introduced new appinsights migration approach, however, missed following from docs:
[Migrate to connection strings](https://learn.microsoft.com/en-us/azure/azure-monitor/app/migrate-from-instrumentation-keys-to-connection-...On MR !720 we introduced new appinsights migration approach, however, missed following from docs:
[Migrate to connection strings](https://learn.microsoft.com/en-us/azure/azure-monitor/app/migrate-from-instrumentation-keys-to-connection-strings)
> Important
> Don't use both a connection string and an instrumentation key. The latter one set supersedes the other, and could result in telemetry not appearing on the portal. See missing data.
SLB engineers are concerned about this statement, therefore, removing key will alleviate these concerns.
Related to https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/326M23 - Release 0.26Arturo Hernandez [EPAM]Arturo Hernandez [EPAM]https://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/778add java_opts env for crs-conversion jdk 172024-02-22T05:09:08Zsaketh somarajuadd java_opts env for crs-conversion jdk 17- Add java_opts env for crs-conversion jdk 17 migration
- Changes are required to support https://community.opengroup.org/osdu/platform/system/reference/crs-conversion-service/-/merge_requests/410- Add java_opts env for crs-conversion jdk 17 migration
- Changes are required to support https://community.opengroup.org/osdu/platform/system/reference/crs-conversion-service/-/merge_requests/410M23 - Release 0.26saketh somarajusaketh somarajuhttps://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/777Add Request Header Logging Envoy Filter2024-02-20T20:58:09ZHamdaan KhalidAdd Request Header Logging Envoy FilterAdd EnvoyFilter on Istio sidecars to log every incoming request to every service, along with certain headers.
Adding ADO code -> https://dev.azure.com/OpenEnergyPlatform/Open%20Energy%20Platform/_git/da64ac67-25ae-4c5e-9894-c0378e724cd9/...Add EnvoyFilter on Istio sidecars to log every incoming request to every service, along with certain headers.
Adding ADO code -> https://dev.azure.com/OpenEnergyPlatform/Open%20Energy%20Platform/_git/da64ac67-25ae-4c5e-9894-c0378e724cd9/pullrequest/7472
Into OSDU masterHamdaan KhalidHamdaan Khalidhttps://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/776Added indexer worker url env variable in indexer queue chart2024-02-19T11:25:25ZDeepanshu SinghalAdded indexer worker url env variable in indexer queue chartschema_worker_url variable has been added to the indexer-queue chart as part of the changes in MR - https://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/383schema_worker_url variable has been added to the indexer-queue chart as part of the changes in MR - https://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/383M23 - Release 0.26Deepanshu SinghalDeepanshu Singhalhttps://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/775update helm charts versions for M22 release2024-03-07T09:20:56Zsaketh somarajuupdate helm charts versions for M22 release- update helm charts versions for M22 release to reflect cherrypicks and patch version deployments
- Changes are already present in preship environment and successfully tested in M22 testing round.- update helm charts versions for M22 release to reflect cherrypicks and patch version deployments
- Changes are already present in preship environment and successfully tested in M22 testing round.M22 - Release 0.25saketh somarajusaketh somarajuhttps://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/774Draft: feat: Check changes between M21 and M22 into helm-chart-azure repository2024-02-15T10:46:57ZDavyd DerkachDraft: feat: Check changes between M21 and M22 into helm-chart-azure repository(cherry picked from commit 541ec2f9761c52a79581ad689ed5706dac252ab3)(cherry picked from commit 541ec2f9761c52a79581ad689ed5706dac252ab3)https://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/773Istio install pipeline/doc fixes2024-02-15T05:05:39ZArturo Hernandez [EPAM]Istio install pipeline/doc fixes* There were install instructions missing `-i` parameter for first time deployment on istio helm charts.
* Azure devops pipeline was using old istio version - fixed
* Added newer istio version to current release.* There were install instructions missing `-i` parameter for first time deployment on istio helm charts.
* Azure devops pipeline was using old istio version - fixed
* Added newer istio version to current release.M23 - Release 0.26Arturo Hernandez [EPAM]Arturo Hernandez [EPAM]https://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/772Made changes for eck chart to honor nodepool mapping2024-02-06T10:04:27ZVineeth Guna [Microsoft]Made changes for eck chart to honor nodepool mappinghttps://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/771Fix legal tag update cronjob2024-02-05T13:37:46Zsaketh somarajuFix legal tag update cronjob- Fix legal tag update cron job documentation
- Build https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/tree/master/source/legal-tags-update-trigger to `msosdu.azurecr.io/legaltags-update-...- Fix legal tag update cron job documentation
- Build https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/tree/master/source/legal-tags-update-trigger to `msosdu.azurecr.io/legaltags-update-status:0.25.0`M23 - Release 0.26saketh somarajusaketh somarajuhttps://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/770Add java opts parameter2024-02-05T08:12:15Zsaketh somarajuAdd java opts parameter- Add java options `java.base/java.util=ALL-UNNAMED` parameter for legal service- Add java options `java.base/java.util=ALL-UNNAMED` parameter for legal serviceM23 - Release 0.26saketh somarajusaketh somarajuhttps://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/769#31 Fixing Airflow env vars2024-02-02T16:34:40ZArturo Hernandez [EPAM]#31 Fixing Airflow env varsThe name of some of Airflow environment variables set in values.yaml, such as `AIRFLOW_VAR_CORE__SERVICE__DATASET__HOST`, are different from the ones [osdu-airflow-lib](https://community.opengroup.org/osdu/platform/data-flow/ingestion/os...The name of some of Airflow environment variables set in values.yaml, such as `AIRFLOW_VAR_CORE__SERVICE__DATASET__HOST`, are different from the ones [osdu-airflow-lib](https://community.opengroup.org/osdu/platform/data-flow/ingestion/osdu-airflow-lib) is looking for (such as `core__service__dataset__url` that means the env var set in values.yaml must be named `AIRFLOW_VAR_CORE__SERVICE__DATASET__URL`).
I have noticed this error as well in greenfield deployments, which it is highly confusing as there is few log output to point to right direction of the error, this can be re-checked and corroborated on the [osdu-ingestion-lib](https://community.opengroup.org/osdu/platform/data-flow/ingestion/osdu-ingestion-lib/-/tree/master).
Closes #31M23 - Release 0.26Arturo Hernandez [EPAM]Arturo Hernandez [EPAM]https://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/768Fixed issues with istio deployment script2024-01-31T06:43:43ZDeepanshu SinghalFixed issues with istio deployment scriptJIRA Task: [MSCOSDU-2073](https://jirapct.epam.com/jira/browse/MSCOSDU-2073)
Fixed issues with istio deployment script. The current script failed to deploy istio due to presence of tar gz subcharts. The fix unzips these files before dep...JIRA Task: [MSCOSDU-2073](https://jirapct.epam.com/jira/browse/MSCOSDU-2073)
Fixed issues with istio deployment script. The current script failed to deploy istio due to presence of tar gz subcharts. The fix unzips these files before deploying them.Deepanshu SinghalDeepanshu Singhalhttps://community.opengroup.org/osdu/platform/deployment-and-operations/helm-charts-azure/-/merge_requests/767Update airflow configuration in airflow installation function2024-01-23T14:47:09ZDeepanshu SinghalUpdate airflow configuration in airflow installation function[JIRA Task: MSCOSDU-2040](https://jirapct.epam.com/jira/browse/MSCOSDU-2040)
The following changes have been done -
- Updated the latest configurations of airflow to the airflow installation function script.
- Removed configuration th...[JIRA Task: MSCOSDU-2040](https://jirapct.epam.com/jira/browse/MSCOSDU-2040)
The following changes have been done -
- Updated the latest configurations of airflow to the airflow installation function script.
- Removed configuration that enables istio on airflow
- Parameterized hard-coded values for namespace, ACR and Image tagM23 - Release 0.26Deepanshu SinghalDeepanshu Singhal