CHANGELOG.md 16.3 KB
Newer Older
Daniel Scholl's avatar
Daniel Scholl committed
1
2
**Note:** This file is manually edited and is best effort information at this time.

Daniel Scholl's avatar
Daniel Scholl committed
3
4
# Current Master

MANISH KUMAR's avatar
MANISH KUMAR committed
5
# v0.11.0 (2021-9-1)
MANISH KUMAR's avatar
MANISH KUMAR committed
6
7
8

__Branch__ https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/tree/release/0.11

MANISH KUMAR's avatar
MANISH KUMAR committed
9
__Tag__ https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/tags/v0.11.2
MANISH KUMAR's avatar
MANISH KUMAR committed
10

Vivek Ojha's avatar
Vivek Ojha committed
11
12
13
14
15
16
17
18
19
20
21
22
23
24
__Infra Changes__
- [Keda Upgrade to 2.x](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/128) - Follow this Documentation to do it: [Keda Upgrade](docs/keda-upgrade.md)
- [BYOAD Enable](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/197)

__Service Onboarded__
- [Dataset Service](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/153)

__Feature Changes__
- [Add multi-partition support in Indexer Queue](https://community.opengroup.org/osdu/platform/system/indexer-queue/-/issues/6)
- [Notification Service to use Service Bus](https://community.opengroup.org/osdu/platform/system/notification/-/issues/25)
- [Notification loss, if migration not done](https://community.opengroup.org/osdu/platform/system/notification/-/blob/master/provider/notification-azure/docs/MIGRATION.md)

__Deprecation Notes__
- The Notification service has started functioning on Service Bus as the underlying PubSub. Starting v0.12.0, Event Grid will be deprecated. In v0.11.0, the service will have two deployments - one using Event Grid and one uses Service Bus.
MANISH KUMAR's avatar
MANISH KUMAR committed
25

Vivek Ojha's avatar
Vivek Ojha committed
26
27
28
29
30
31
32
33
34
35
36
# v0.10.0 (2021-8-8)

__Infra Changes__
- [[Breaking Change] Zonal Redundancy for Airflow](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/181)
- [Zonal Redundancy for Redis](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/180)
- [Zonal redundancy for AKS and App Gateway](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/179)

__Feature Changes__
- Added Retries and Logging for Legal Tags Cronjob
- Added Node.js application for LegalTags Update CRON Job

MANISH KUMAR's avatar
MANISH KUMAR committed
37
# v0.9.1 (2021-6-27)
MANISH KUMAR's avatar
MANISH KUMAR committed
38
39
40
41

__Service Onboarded__
- [Issue 95 - Policy Service](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/95)

MANISH KUMAR's avatar
MANISH KUMAR committed
42
__Feature Changes__
MANISH KUMAR's avatar
MANISH KUMAR committed
43
- [Feature 142 - Added support for array of object search](https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/142)
MANISH KUMAR's avatar
MANISH KUMAR committed
44
45
- [Feature 121 - Added support for nested search](https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/121)

Krishna Nikhil Vedurumudi's avatar
Krishna Nikhil Vedurumudi committed
46
__Infra Changes__
MANISH KUMAR's avatar
MANISH KUMAR committed
47
- AKS version upgrade to 1.19.11
MANISH KUMAR's avatar
MANISH KUMAR committed
48
49
- [Feature 277 - Alerts framework for Monitoring](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/277)
- [Feature 169 - Container hardening for Java based services](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/169)
Krishna Nikhil Vedurumudi's avatar
Krishna Nikhil Vedurumudi committed
50
- [Feature 159 - Added default JVM Parameters](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/159)
51
- [Issue 163 - Architecture change- service resources- Add cosmos db and Storage account](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/163)
MANISH KUMAR's avatar
MANISH KUMAR committed
52

53
54
# v0.8 (2021-4-9)

Krishna Nikhil Vedurumudi's avatar
Krishna Nikhil Vedurumudi committed
55
__Infra Changes__
56
57
58
- [Operationalize 104 - Backup and Restore](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/104)
- [Feature 115 - Enable Custom HTTPS Certificates](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/115)
- [Feature 121 - Added Default Dashboard](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/121)
Krishna Nikhil Vedurumudi's avatar
Krishna Nikhil Vedurumudi committed
59
60
- [Feature 149 - Make auto-scale parameters of App Gateway configurable](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/149)

Daniel Scholl's avatar
Daniel Scholl committed
61
62
63
64
65
66
# v0.7 (2021-3-11)

__Service Onboarded__
- [Issue 81 - Entitlements V2](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/81)
  > Not integrated yet to other services until M5.

67
__Bug Fixes__
Daniel Scholl's avatar
Daniel Scholl committed
68
69
70
- [Bug 130 - Variable Script Change Indexer Service - STORAGE_QUERY_RECORD_HOST](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/130)
- [Bug 129 - Envoy Filters Indentation formating](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/129)
- [Bug 124 - Documentation SDMS](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/124)
Daniel Scholl's avatar
Daniel Scholl committed
71
72
73
74
- [Bug 119 - Add Airflow python package `python-keycloak`](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/119)


__Infra Changes__
Daniel Scholl's avatar
Daniel Scholl committed
75
- [Issue 135 - Airflow Default Variables](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/135)
76
- [Arch 123 - Obsolete Cosmos DB Tables and add new v2 tables](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/123)
Daniel Scholl's avatar
Daniel Scholl committed
77
- [Issue 127](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/127)
78
- [Feature 126 - Add support to pass JAVA_OPTS to java command in DockerFile](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/126)
Daniel Scholl's avatar
Daniel Scholl committed
79
- [Feature 125 - Enable Manifest Ingestion](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/125)
Daniel Scholl's avatar
Daniel Scholl committed
80

81

Daniel Scholl's avatar
Daniel Scholl committed
82
# v0.5 (2021-2-11)
83
84

__Service Onboarded__
Daniel Scholl's avatar
Daniel Scholl committed
85
- [Issue 60 - Seismic DMS Service](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/44)
86
87
- [Issue 111 - CSV DAGS](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/111)

Daniel Scholl's avatar
Daniel Scholl committed
88
89
90
__Infra Changes__
- [Issue 106 - Arch Change - Data Partition - Ingestion Workflow Database and Storage new collections and fileshares](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/106)

Daniel Scholl's avatar
Daniel Scholl committed
91
__Bug Fixes__
92
93
- [Bug 109 - Add Entitlement Role](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/109#related-issues)
- [Bug 108 - Add VM Agent Max Nodes Option](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/108)
Daniel Scholl's avatar
Daniel Scholl committed
94
- [Bug 103 - Enable opt-in airflow ui ingress](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/103)
Jason's avatar
Jason committed
95
- [Bug 102 - Users with a lot of groups receive a 400 Bad Request when making API calls](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/102)
Daniel Scholl's avatar
Daniel Scholl committed
96
- [Bug 101 - Comsos Graph module always requires a change on tf plan](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/101)
97
- [Bug 100 - Airflow statsd not building in pipeline](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/100)
Daniel Scholl's avatar
Daniel Scholl committed
98
- [Bug 99 - AKS and Postgres Diagnostics - All Metrics](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/99)
Daniel Scholl's avatar
Daniel Scholl committed
99
100
101
- [Bug 97 - Rename Cosmos DB collections used by Schema Service](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/97)


102
# v0.4.3 (2021-1-25)
Daniel Scholl's avatar
Daniel Scholl committed
103

104
105
106
107
__Service Onboarded__
- [Issue 60 - Schema Service](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/60)
- [Issue 65 - CRS Conversion Service](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/65)
- [Issue 53 - WKS Service](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/53)
108
- [Issue 43 - Workflow Service](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/43)
109
110


Daniel Scholl's avatar
Daniel Scholl committed
111
112
113
__Infra Changes__
- [Issue 75 - Upgrade Infrastructure tools and software dependencies](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/75)  - _* Manual Intervention Required_
- [Issue 76 - Add Terraform Service Resource Template Feature Flags](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/76)
114
- [Issue 80 - Feature Change - Data Partition - Enable CORS configuration for Blob Containers on Storage Accounts](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/80)
115
- [Issue 77 - Architecture Change - Central Resources - Add Graph Database](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/77)
116
- [Issue 84 - Architecture Change - Data Partition - Add dedicated Storage Account for use by Ingestion Service](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/84/)
Daniel Scholl's avatar
Daniel Scholl committed
117

118
119
120
121
122
123
__Bug Fixes__
- [Bug 82 - AKS Template Plan Calculation](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/82)
- [Bug 90 - Indexer Service ADO Pipeline](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/90)
- [Bug 92 - CRS Conversion File Shares](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/92)
- [Bug 94 - AKS Default Node Pool Disk Size](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/94)

Daniel Scholl's avatar
Daniel Scholl committed
124
125


Daniel Scholl's avatar
Daniel Scholl committed
126
# v0.4.2 (2020-12-30)
Daniel Scholl's avatar
Daniel Scholl committed
127

Daniel Scholl's avatar
Daniel Scholl committed
128
129
130
__Service Onboarded__
- [Issue 55 - Unit Service](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/55)
- [Issue 56 - CRS Catalog Service](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/56)
Daniel Scholl's avatar
Daniel Scholl committed
131
132
- [Issue 54 - Register Service](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/54)
- [Issue 52 - Notification Service](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/52)
Daniel Scholl's avatar
Daniel Scholl committed
133

Daniel Scholl's avatar
Daniel Scholl committed
134
135
136
137
__Documentation Changes__
- [MR 90 - Documentation Tweaks and Fixing Environment Variables](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/90)
- [MR 92 - Airflow APACHE Licenses](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/92)
- [MR 94 - Fixing File Pipeline and Search URL Variable](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/94)
Daniel Scholl's avatar
Daniel Scholl committed
138
- [MR 95 - Updating Service Onboarding](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/95)
Daniel Scholl's avatar
Daniel Scholl committed
139
140
141
- [MR 103 - Updating Service Onboarding Template](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/103)
- [MR 108 - Initial FAQ](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/108)

Daniel Scholl's avatar
Daniel Scholl committed
142

Daniel Scholl's avatar
Daniel Scholl committed
143
144
__Chart Changes__
- [MR 110 - Airflow log monitoring](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/110)
Daniel Scholl's avatar
Daniel Scholl committed
145

Daniel Scholl's avatar
Daniel Scholl committed
146
147

__Tool Changes__
Daniel Scholl's avatar
Daniel Scholl committed
148
- [MR 101 - Partition Service Support - Storage Service](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/101)
Daniel Scholl's avatar
Daniel Scholl committed
149
150
- [MR 118 - Python Testing Variables](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/118)

Daniel Scholl's avatar
Daniel Scholl committed
151
152
153
154
155
156

__Infra Changes__
- [MR 97 - Adding a service Bus topic - WKS Service](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/97)
- [MR 99 - Adding KV Secret for Event Grid Topic Primary Keys - Storage Service](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/99)


Daniel Scholl's avatar
Daniel Scholl committed
157

Daniel Scholl's avatar
Daniel Scholl committed
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
# v0.4.1 (2020-11-30)

__Description__

_Additional Services Added._

__Branch/Tag__

[tag/0.4.1](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/tags/v0.4.1)


__Images__

| Service | Image | Tag |
| ------- | ----- | --- |
| Partition     | `community.opengroup.org:5555/osdu/platform/system/partition/partition-master` | 3a50a7048c7dd39ef689e87af6ee745f5a57b3b3 |
| Entitlements  | `community.opengroup.org:5555/osdu/platform/security-and-compliance/entitlements-azure/entitlements-azure-master` | 70b889b47be7ed01956db0305ad888e61e06387c |
| Legal         | `community.opengroup.org:5555/osdu/platform/security-and-compliance/legal/legal-master` | 70abc2ab72050a9795e63d6900f2b5f825173ad7 |
| Storage       | `community.opengroup.org:5555/osdu/platform/system/storage/storage-master` | 93b5636ba43bcd907c34ba61fcc00aba47349597 |
| Indexer-Queue | `community.opengroup.org:5555/osdu/platform/system/indexer-queue/indexer-queue-master` | 4b56366f90f2fb6ba904ab9ba672a0595e9a6a4b |
| Indexer       | `community.opengroup.org:5555/osdu/platform/system/indexer-service/indexer-service-master` | f0699e2af5e96eb1e853d6785f9abe97e87ba39d |
| Search        | `community.opengroup.org:5555/osdu/platform/system/search-service/search-service-master` | c42afcb11c0b36229cc2b2803f4e15958232d95a |
| Delivery      | `community.opengroup.org:5555/osdu/platform/system/delivery/delivery-master` | 16a935048c6e9ace219d08fd3feb718a4b1d7abf |
| File          | `community.opengroup.org:5555/osdu/platform/system/file/file-master` | 1144aa06e6b70df8e1c06ccc6331cb78a79951cc |


__Infrastructure Support__

- Airflow

__Devops Support__

- Airflow
- Python Testing Tasks

__Chart Support__

- osdu-airflow

__New Services__

- [Delivery](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/21)
- [File](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/40)



Daniel Scholl's avatar
Daniel Scholl committed
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
# v0.4.0 (2020-11-12)

__Description__

_Milestone 1 Tag Generated across all services._

__Branch/Tag__

[release/0.4](https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/tree/release/0.4)

__Images__

| Service | Image | Tag |
| ------- | ----- | --- |
| Partition     | `community.opengroup.org:5555/osdu/platform/system/partition/partition-release-0-4` | 81976630aa9de9abd508a32a7f0ef1f9a773a1ab |
| Entitlements  | `community.opengroup.org:5555/osdu/platform/security-and-compliance/entitlements-azure/entitlements-azure-release-0-4` | 32fb4035378213354dedb90bb1549deb44e5f2df |
| Legal         | `community.opengroup.org:5555/osdu/platform/security-and-compliance/legal/legal-release-0-4` | 96dd3c699e0fa344a69e63acd75c83bafadab94f |
| Storage       | `community.opengroup.org:5555/osdu/platform/system/storage/storage-release-0-4` | 4eb302c39db1956d2e5098ec87399526176d14a5 |
| Indexer-Queue | `community.opengroup.org:5555/osdu/platform/system/indexer-queue/indexer-queue-release-0-4` | a3ea5d8629fed60058332672d7b871606041ee96 |
| Indexer       | `community.opengroup.org:5555/osdu/platform/system/indexer-service/indexer-service-release-0-4` | c1cde375c3c76e84290efb63405edf81ec964ff3 |
| Search        | `community.opengroup.org:5555/osdu/platform/system/search-service/search-service-release-0-4` | 834269ff32812c3cdfc42f315d3c7eb01fda622e |

__Infrastructure__

This infrastructure release is the initial porting of infrastructure from Github to Gitlab.

- Common Resources creation script
- Terraform Modules to support MVP Architecture
- Terraform Template osdu-r3-mvp/central_resources
- Terraform Template osdu-r3-mvp/data-partition
- Terraform Template osdu-r3-mvp/service-resources


__Devops__

- Common Devops Tasks and Templates to Support Infrastructure, Charts and Services
- Infrastructure Pipelines
- Custom Pipelines


__Charts__

- osdu-common
- osdu-istio
- osdu-istio-auth


__New Services__

- Partition
- Entitlements
- Legal
- Storage
- Indexer-Queue
- Indexer
- Search