infra-azure-provisioning merge requestshttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests2021-01-25T17:29:58Zhttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/166create osdu-entitlements required graph under the osdu-graph database2021-01-25T17:29:58ZMingyang Zhucreate osdu-entitlements required graph under the osdu-graph databaseRelated issue: https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/96Related issue: https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/96January - 21Mingyang ZhuMingyang Zhuhttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/165Repo Name Hotfix2021-01-25T17:31:34ZJasonRepo Name HotfixIssue: File and schema repos in instructions are defined to be `file-service` and `schema-service`, however when extracting manifests they are referred to as `file` and `schema`, which leads to errors.
Fix: Changers names during manifes...Issue: File and schema repos in instructions are defined to be `file-service` and `schema-service`, however when extracting manifests they are referred to as `file` and `schema`, which leads to errors.
Fix: Changers names during manifest extraction the names defined earlier in the charts/README.md file.January - 21JasonJasonhttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/163Fixing critical bugs found2021-01-21T17:34:10ZDaniel SchollFixing critical bugs foundA few bugs found while validating new cluster configurations.A few bugs found while validating new cluster configurations.January - 21Daniel SchollDaniel Schollhttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/161Updated AKS and Template Readme's to introduce custom.tfvars to ensure future...2021-01-20T23:58:11ZDaniel SchollUpdated AKS and Template Readme's to introduce custom.tfvars to ensure future...Updated AKS and Template Readme's to introduce custom.tfvars to ensure future upgrades are non breaking
#94Updated AKS and Template Readme's to introduce custom.tfvars to ensure future upgrades are non breaking
#94January - 21Daniel SchollDaniel Schollhttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/160Update Documentation to include new manual process using helm charts as well ...2021-01-20T19:34:59ZDaniel SchollUpdate Documentation to include new manual process using helm charts as well as service configuration data upload documentation.January - 21Daniel SchollDaniel Schollhttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/157Bug/922021-01-20T18:16:04ZDaniel SchollBug/92#92#92January - 21Daniel SchollDaniel Schollhttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/153Added condition - do not download Maven Cache if testCoreMavenPomFile is empty2021-01-18T15:06:29ZVasyl Leskiv [SLB]Added condition - do not download Maven Cache if testCoreMavenPomFile is emptyJanuary - 21Daniel SchollDaniel Schollhttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/152Bug - Fixing indexer service ADO Pipeline for Indexer-Service2021-01-24T16:47:50ZDaniel SchollBug - Fixing indexer service ADO Pipeline for Indexer-Service#90
As part of debugging a lot of tools variables scripts were updated due to little issues found when trying to execute integration tests locally against a built environment.#90
As part of debugging a lot of tools variables scripts were updated due to little issues found when trying to execute integration tests locally against a built environment.January - 21Daniel SchollDaniel Schollhttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/151Adding new partition properties2021-01-15T11:17:08Zharshit aggarwalAdding new partition propertiesRelates to Issue https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/89Relates to Issue https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/89January - 21https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/149CRS Conversion Documentation2022-09-15T23:50:41ZSumra ZafarCRS Conversion Documentation* \[**YES**/NO\] Have you added an explanation of what your changes do and why you'd like us to include them?
* \[**YES**/NO\] I have updated the documentation accordingly.
* \[**YES**/NO/NA\] My code follows the code style of this project.* \[**YES**/NO\] Have you added an explanation of what your changes do and why you'd like us to include them?
* \[**YES**/NO\] I have updated the documentation accordingly.
* \[**YES**/NO/NA\] My code follows the code style of this project.January - 21Sumra ZafarSumra Zafarhttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/148Added Storage Account in Data Partition for Ingest2021-01-14T01:51:10ZDaniel SchollAdded Storage Account in Data Partition for Ingest#84 and #85#84 and #85January - 21Daniel SchollDaniel Schollhttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/147Add Cosmos Graph Database to Central Resources2021-01-14T00:35:04ZDaniel SchollAdd Cosmos Graph Database to Central Resources#77#77January - 21Daniel SchollDaniel Schollhttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/145Adding Condition to Deploy Stage Dependency Cache2021-01-13T20:18:51ZJasonAdding Condition to Deploy Stage Dependency Cache**The Issue**: our ADO pipelines are currently expecting the folder `$(Pipeline.Workspace)/.m2/repository` to exist for every service in the `deploy` stage of the pipeline. This folder exists for services with tests written in java becau...**The Issue**: our ADO pipelines are currently expecting the folder `$(Pipeline.Workspace)/.m2/repository` to exist for every service in the `deploy` stage of the pipeline. This folder exists for services with tests written in java because that is where we store Maven dependencies. This folder does **not** exist for services with integration tests written in Python. This causes pipeline failures for services with tests written in Python because in the caching step of ADO, it tries to upload the contents of `$(Pipeline.Workspace)/.m2/repository`, but this folder doesn't exist.
**The fix**: Make the deploy stage dependency cache not run if `parameters.runPythonTest` is set to `true`January - 21Daniel SchollDaniel Schollhttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/144Added autoscaling to airflow worker nodes2021-01-15T10:33:03ZKishore BattulaAdded autoscaling to airflow worker nodesJanuary - 21https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/143WIP: added upload to file share script2021-11-19T11:40:31ZAnkush JainWIP: added upload to file share script## All Submissions:
-------------------------------------
* [YES] Have you added an explanation of what your changes do and why you'd like us to include them?
* [NO] I have updated the documentation accordingly.
* [YES] My code follows t...## All Submissions:
-------------------------------------
* [YES] Have you added an explanation of what your changes do and why you'd like us to include them?
* [NO] I have updated the documentation accordingly.
* [YES] My code follows the code style of this project.
## Current Behavior or Linked Issues
-------------------------------------
In this change, a script is added which uploads the controller dag, and dag_run operator and dag_run sensor to the file share.
#86
## Does this introduce a breaking change?
-------------------------------------
- [YES/NO]
<!-- If this introduces a breaking change, please describe the impact and migration path for existing applications below. -->
## Other information
-------------------------------------
<!-- Any other information that is important to this PR such as screenshots of how the component looks before and after the change. -->January - 21Kishore BattulaKishore Battulahttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/142Updating FAQ2021-01-12T15:40:38ZJasonUpdating FAQThis MR updates the user documentation FAQ in the following ways
1. Adds a table of contents
2. Separates the issues out into five sections (Common Problems and Errors, Infrastructure Provisioning Questions, Infrastructure Provisioning W...This MR updates the user documentation FAQ in the following ways
1. Adds a table of contents
2. Separates the issues out into five sections (Common Problems and Errors, Infrastructure Provisioning Questions, Infrastructure Provisioning Walkthroughs, Service Questions and Infrastructure Upgrade Walkthroughs)
3. Adds a few new issues to the FAQJanuary - 21Daniel SchollDaniel Schollhttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/141Move Diagnostics for AKS from All-Metrics to API Server (PREVIEW)2021-01-09T15:31:35ZDaniel SchollMove Diagnostics for AKS from All-Metrics to API Server (PREVIEW)Issue #82Issue #82January - 21Daniel SchollDaniel Schollhttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/140Added support to enable CORS Rules for the Blob Service Containers2021-01-13T15:40:17ZKrishna Nikhil VedurumudiAdded support to enable CORS Rules for the Blob Service Containers## Infrastructure Submissions:
-------------------------------------
* [YES/NO] Have you added an explanation of what your changes do and why you'd like us to include them?
* [YES/NO] I have updated the documentation accordingly.
* [YES/...## Infrastructure Submissions:
-------------------------------------
* [YES/NO] Have you added an explanation of what your changes do and why you'd like us to include them?
* [YES/NO] I have updated the documentation accordingly.
* [YES/NO/NA] I have added tests to cover my changes.
* [YES] All new and existing tests passed.
* [YES/NO/NA] I have formatted the terraform code. _(`terraform fmt -recursive && go fmt ./...`)_
## Current Behavior or Linked Issues
-------------------------------------
https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/80
## Does this introduce a breaking change?
-------------------------------------
- [NO]
<!-- If this introduces a breaking change, please describe the impact and migration path for existing applications below. -->
## Other information
-------------------------------------
Terraform plan output
```
+ blob_properties {
+ cors_rule {
+ allowed_headers = [
+ "*",
]
+ allowed_methods = [
+ "PUT",
+ "GET",
]
+ allowed_origins = [
+ "https://osdu-mvp.msft-osdu-test.org",
]
+ exposed_headers = [
+ "*",
]
+ max_age_in_seconds = 60
}
}
```
Unit Tests result
```
TestTemplate 2021-01-08T18:19:38+05:30 command.go:121: Deleted workspace "osdu-testing-xr9jtf"!--- PASS: TestTemplate (464.67s)
PASS
ok github.com/microsoft/cobalt/infra/templates/osdu-r3-mvp/data_partition/tests/unit 466.421s
```
Changes after terraform apply
![CORS](/uploads/f50bd960197a895c0315b548fb015fb7/CORS.PNG)
To test the changes
```
curl --location --request OPTIONS 'https://osdumvpidcmvpdi2ordata.blob.core.windows.net/' --header 'Origin: https://osdu-mvp.msft-osdu-test.org' --header 'Access-Control-Request-Method: PUT' --data-raw ''
// Returns 200 OK
curl --location --request OPTIONS 'https://osdumvpidcmvpdi2ordata.blob.core.windows.net/' --header 'Origin: https://foo-mvp.msft-osdu-test.org' --header 'Access-Control-Request-Method: PUT' --data-raw ''
// Returns 403
```January - 21https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/138Updated all pipelines and task2021-01-06T16:48:21ZDaniel SchollUpdated all pipelines and taskContinued work with Issue #75Continued work with Issue #75January - 21Daniel SchollDaniel Schollhttps://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/137Updated Unit Test count for central resources2021-01-06T14:53:33ZDaniel SchollUpdated Unit Test count for central resourcesPart A work still for Issue #75Part A work still for Issue #75January - 21Daniel SchollDaniel Scholl