Dataset merge requests
https://community.opengroup.org/osdu/platform/system/dataset/-/merge_requests
2023-05-22T15:18:51Z
https://community.opengroup.org/osdu/platform/system/dataset/-/merge_requests/331
Full Upgrade of First Party Library Dependencies for Release 0.20
2023-05-22T15:18:51Z
David Diederich
d.diederich@opengroup.org
Full Upgrade of First Party Library Dependencies for Release 0.20
This generated MR upgrades the first party libraries (other OSDU libraries) to utilize the latest release.
The intent is to try to fully upgrade all dependent libraries to see if the latest code will work.
It is expected that these will ...
This generated MR upgrades the first party libraries (other OSDU libraries) to utilize the latest release.
The intent is to try to fully upgrade all dependent libraries to see if the latest code will work.
It is expected that these will often fail, since the upgrades were previously rejected for failing pipelines and have not been directly addressed yet.
This upgrade should only be merged in the CI pipeline reports success.
If this MR has failed, we can spend a little time investigating to see if a trivial upgrade could achieve compatiblity to the new library.
But significant upgrade efforts should not occur on this MR, as part of the release tagging process.
Instead, significant work should be scheduled for a subsequent milestone.
This MR may co-exist with a separate, smaller upgrade MR.
If both pass, this one should be used instead.
### Dependency Information Before the Upgrade
```
Branch: master
SHA: a95762ddd9c2ef6a556ebce4e60936c86e166fa8
Maven: 0.21.0-SNAPSHOT
```
| Maven Dependencies | _Root_ | testing/ |
| ------------------------------------------------------- | ---------------------- | ------------------------ |
| core-lib-azure | 0.14.0 | 0.14.0 |
| core-lib-gcp | 0.19.0-rc3 | 0.19.0-rc3 |
| os-core-lib-aws | 0.21.0-rc1 | 0.14.0 |
| obm | 0.18.0 | 0.18.0 |
| oqm | 0.18.0 | 0.18.0 |
| os-core-common | 0.19.0 | 0.19.0 |
| os-core-lib-ibm | 0.17.0-rc4 | 0.15.2 |
| osm | 0.18.0 | 0.18.0 |
| (3rd Party) com.fasterxml.jackson.core.jackson-databind | 2.13.4.2 | 2.13.2.2, 2.13.0, 2.12.2 |
| (3rd Party) org.apache.logging.log4j.log4j-api | 2.17.1 | 2.17.2, 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-core | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-jul | 2.17.1 | 2.13.3 |
| (3rd Party) org.springframework.spring-webmvc | 5.3.23, 5.3.22, 5.3.12 | 5.3.22 |
| (3rd Party) org.yaml.snakeyaml | 1.33 | 1.30 |
```
Critical: Found Vulnerable Spring MVC dependency (<5.2.20 || >=5.3.0 <5.3.18)
└─ _Root_
└─ org.opengroup.osdu.dataset-azure == 0.21.0-SNAPSHOT
└─ org.opengroup.osdu.os-core-common == 0.19.0
└─ org.springframework.spring-webmvc == 5.3.12
```
```
Critical: Found Vulnerable Snake YAML dependency (<2.0)
├─ _Root_
│ ├─ org.projectlombok.lombok == 1.18.8
│ │ └─ org.yaml.snakeyaml == 1.33
│ ├─ org.opengroup.osdu.dataset-core == 0.21.0-SNAPSHOT
│ │ └─ org.yaml.snakeyaml == 1.33
│ ├─ org.opengroup.osdu.dataset-aws == 0.21.0-SNAPSHOT
│ │ └─ org.yaml.snakeyaml == 1.33
│ ├─ org.opengroup.osdu.dataset-ibm == 0.21.0-SNAPSHOT
│ │ └─ org.yaml.snakeyaml == 1.33
│ ├─ org.opengroup.osdu.dataset-gc == 0.21.0-SNAPSHOT
│ │ └─ org.yaml.snakeyaml == 1.33
│ └─ org.opengroup.osdu.dataset-azure == 0.21.0-SNAPSHOT
│ └─ org.yaml.snakeyaml == 1.33
└─ testing/
├─ org.opengroup.osdu.storage.dataset-test-core == 0.21.0-SNAPSHOT
│ └─ org.opengroup.osdu.os-core-common == 0.19.0
│ └─ org.springframework.boot.spring-boot-starter-web == 2.7.7
│ └─ org.springframework.boot.spring-boot-starter == 2.7.7
│ └─ org.yaml.snakeyaml == 1.30
├─ org.opengroup.osdu.dataset-test-azure == 0.21.0-SNAPSHOT
│ └─ org.opengroup.osdu.os-core-common == 0.19.0
│ └─ org.springframework.boot.spring-boot-starter-web == 2.7.7
│ └─ org.springframework.boot.spring-boot-starter == 2.7.7
│ └─ org.yaml.snakeyaml == 1.30
├─ org.opengroup.osdu.storage.dataset-test-aws == 0.21.0-SNAPSHOT
│ └─ org.opengroup.osdu.os-core-common == 0.19.0
│ └─ org.springframework.boot.spring-boot-starter-web == 2.7.7
│ └─ org.springframework.boot.spring-boot-starter == 2.7.7
│ └─ org.yaml.snakeyaml == 1.30
├─ org.opengroup.osdu.dataset-test-gc == 0.21.0-SNAPSHOT
│ └─ org.opengroup.osdu.core-lib-gcp == 0.19.0-rc3
│ └─ org.opengroup.osdu.oqm == 0.18.0
│ └─ org.springframework.boot.spring-boot-starter == 2.7.2
│ └─ org.yaml.snakeyaml == 1.30
├─ org.opengroup.osdu.dataset-test-ibm == 0.21.0-SNAPSHOT
│ └─ org.opengroup.osdu.os-core-common == 0.19.0
│ └─ org.springframework.boot.spring-boot-starter-web == 2.7.7
│ └─ org.springframework.boot.spring-boot-starter == 2.7.7
│ └─ org.yaml.snakeyaml == 1.30
└─ org.opengroup.osdu.dataset-test-anthos == 0.21.0-SNAPSHOT
└─ org.opengroup.osdu.core-lib-gcp == 0.19.0-rc3
└─ org.opengroup.osdu.oqm == 0.18.0
└─ org.springframework.boot.spring-boot-starter == 2.7.2
└─ org.yaml.snakeyaml == 1.30
```
### Dependency Information After the Upgrade
```
Branch: dependency-upgrade
SHA: 3c4020ac889142fbedc28bb983c129178535fae7
Maven: 0.21.0-SNAPSHOT
```
| Maven Dependencies | _Root_ | testing/ |
| ------------------------------------------------------- | ---------- | ------------------------ |
| core-lib-azure | 0.20.0 | 0.20.0 |
| core-lib-gc | 0.20.0 | 0.20.0 |
| os-core-lib-aws | 0.21.0-rc2 | 0.21.0-rc2 |
| obm | 0.20.0 | 0.20.0 |
| oqm | 0.20.0 | 0.20.0 |
| os-core-common | 0.20.1 | 0.20.1 |
| os-core-lib-ibm | 0.20.0 | 0.20.0 |
| osm | 0.20.0 | 0.20.0 |
| (3rd Party) com.fasterxml.jackson.core.jackson-databind | 2.13.4.2 | 2.13.2.2, 2.13.0, 2.12.2 |
| (3rd Party) org.yaml.snakeyaml | 1.33 | 1.30, 1.27, 2.0 |
```
Critical: Found Vulnerable Snake YAML dependency (<2.0)
├─ _Root_
│ ├─ org.projectlombok.lombok == 1.18.8
│ │ └─ org.yaml.snakeyaml == 1.33
│ ├─ org.opengroup.osdu.dataset-core == 0.21.0-SNAPSHOT
│ │ └─ org.yaml.snakeyaml == 1.33
│ ├─ org.opengroup.osdu.dataset-aws == 0.21.0-SNAPSHOT
│ │ └─ org.yaml.snakeyaml == 1.33
│ ├─ org.opengroup.osdu.dataset-ibm == 0.21.0-SNAPSHOT
│ │ └─ org.yaml.snakeyaml == 1.33
│ ├─ org.opengroup.osdu.dataset-gc == 0.21.0-SNAPSHOT
│ │ └─ org.yaml.snakeyaml == 1.33
│ └─ org.opengroup.osdu.dataset-azure == 0.21.0-SNAPSHOT
│ └─ org.yaml.snakeyaml == 1.33
└─ testing/
├─ org.opengroup.osdu.storage.dataset-test-core == 0.21.0-SNAPSHOT
│ └─ org.opengroup.osdu.os-core-common == 0.20.1
│ └─ org.springframework.boot.spring-boot-starter-web == 2.7.7
│ └─ org.springframework.boot.spring-boot-starter == 2.7.7
│ └─ org.yaml.snakeyaml == 1.30
├─ org.opengroup.osdu.dataset-test-azure == 0.21.0-SNAPSHOT
│ └─ org.opengroup.osdu.core-lib-azure == 0.20.0
│ └─ org.redisson.redisson == 3.15.3
│ └─ org.yaml.snakeyaml == 1.27
├─ org.opengroup.osdu.storage.dataset-test-aws == 0.21.0-SNAPSHOT
│ └─ org.opengroup.osdu.core.aws.os-core-lib-aws == 0.21.0-rc2
│ └─ org.springframework.boot.spring-boot-starter-web == 2.7.7
│ └─ org.springframework.boot.spring-boot-starter == 2.7.7
│ └─ org.yaml.snakeyaml == 1.30
├─ org.opengroup.osdu.dataset-test-gc == 0.21.0-SNAPSHOT
│ └─ org.opengroup.osdu.core-lib-gc == 0.20.0
│ └─ org.opengroup.osdu.oqm == 0.20.0
│ └─ org.springframework.boot.spring-boot-starter == 2.7.10
│ └─ org.yaml.snakeyaml == 1.30
└─ org.opengroup.osdu.dataset-test-anthos == 0.21.0-SNAPSHOT
└─ org.opengroup.osdu.core-lib-gc == 0.20.0
└─ org.opengroup.osdu.oqm == 0.20.0
└─ org.springframework.boot.spring-boot-starter == 2.7.10
└─ org.yaml.snakeyaml == 1.30
```
M18 - Release 0.21
Okoun-Ola Fabien Houeto
Yauhen Shaliou [EPAM/GCP]
Srinivasan Narayanan
Deepa Kumari
Okoun-Ola Fabien Houeto
https://community.opengroup.org/osdu/platform/system/dataset/-/merge_requests/311
Adding support for EKS 1.23
2023-02-10T20:17:18Z
Marc Burnie [AWS]
Adding support for EKS 1.23
M16 - Release 0.19
Marc Burnie [AWS]
Marc Burnie [AWS]
https://community.opengroup.org/osdu/platform/system/dataset/-/merge_requests/278
Upgrade Dependencies
2022-12-09T22:56:25Z
Abhay Joshi
Upgrade Dependencies
## Type of change
- [ ] Bug Fix
- [ ] Feature
Patching Dependency versions
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES/NO]
NO
## Does this i...
## Type of change
- [ ] Bug Fix
- [ ] Feature
Patching Dependency versions
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES/NO]
NO
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] Google Cloud
- [ ] IBM
No, Just updated Pom Files
## Does this introduce a breaking change?
- [YES/NO]
No
## What is the current behavior?
N/A
## What is the new/expected behavior?
N/A
## Have you added/updated Unit Tests and Integration Tests?
No
## Any other useful information
Updated Dependencies
Okoun-Ola Fabien Houeto
Abhay Joshi
Okoun-Ola Fabien Houeto
https://community.opengroup.org/osdu/platform/system/dataset/-/merge_requests/275
Merge AWS changes to master
2022-12-02T21:59:26Z
Morris Estepa
Merge AWS changes to master
Merge AWS changes to master
Merge AWS changes to master
M15 - Release 0.18
Morris Estepa
Morris Estepa
https://community.opengroup.org/osdu/platform/system/dataset/-/merge_requests/231
Draft: Cherry pick spring-webmvc to release/0.16
2022-08-12T08:41:36Z
Morris Estepa
Draft: Cherry pick spring-webmvc to release/0.16
Original MR: !228
Original MR: !228
Morris Estepa
Morris Estepa
https://community.opengroup.org/osdu/platform/system/dataset/-/merge_requests/186
Update jackson-databind version & switch over from file dms to file service
2022-05-24T20:05:50Z
Morris Estepa
Update jackson-databind version & switch over from file dms to file service
commit cdd2d909
Author: Morris Estepa <estepamo@amazon.com>
Date: Wed Apr 20 2022 13:15:25 GMT-0500 (Central Daylight Time)
Fix jackson core version issue.
commit de63cc2e
Author: Morris Estepa <estepamo@amazon.com>
Date: Wed...
commit cdd2d909
Author: Morris Estepa <estepamo@amazon.com>
Date: Wed Apr 20 2022 13:15:25 GMT-0500 (Central Daylight Time)
Fix jackson core version issue.
commit de63cc2e
Author: Morris Estepa <estepamo@amazon.com>
Date: Wed Apr 20 2022 11:29:46 GMT-0500 (Central Daylight Time)
Fix incorrect jackson core version.
commit 71ac32af
Author: Morris Estepa <estepamo@amazon.com>
Date: Tue Apr 19 2022 14:46:40 GMT-0500 (Central Daylight Time)
Update jackson-databind version.
Morris Estepa
Morris Estepa
https://community.opengroup.org/osdu/platform/system/dataset/-/merge_requests/94
Int test: allow specifying schema authority for kind. Include changes for POM...
2021-04-12T20:07:27Z
Matt Wise
Int test: allow specifying schema authority for kind. Include changes for POM project id fixes
David Diederich
d.diederich@opengroup.org
Matt Wise
David Diederich
d.diederich@opengroup.org
https://community.opengroup.org/osdu/platform/system/dataset/-/merge_requests/73
R3 Data Definitions Changes
2021-02-02T20:55:46Z
Matt Wise
R3 Data Definitions Changes
Depends on: https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/merge_requests/52
commit 7697e607
Author: Matt Wise <wsmatth@amazon.com>
Date: Tue Feb 02 2021 13:47:07 GMT-0600 (Central Standard Time)
...
Depends on: https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/merge_requests/52
commit 7697e607
Author: Matt Wise <wsmatth@amazon.com>
Date: Tue Feb 02 2021 13:47:07 GMT-0600 (Central Standard Time)
update comment on dataset kind regex
commit 561cde42
Author: Matt Wise <wsmatth@amazon.com>
Date: Tue Feb 02 2021 11:58:29 GMT-0600 (Central Standard Time)
add provider key to swagger docs
commit 36166ff7
Author: Matt Wise <wsmatth@amazon.com>
Date: Tue Feb 02 2021 11:49:02 GMT-0600 (Central Standard Time)
update core-lib-aws
commit b22e2104
Author: Matt Wise <wsmatth@amazon.com>
Date: Tue Feb 02 2021 11:30:57 GMT-0600 (Central Standard Time)
update swagger docs. Remove legacy docs
commit df702cdc
Author: Matt Wise <wsmatth@amazon.com>
Date: Tue Feb 02 2021 11:22:24 GMT-0600 (Central Standard Time)
Updates to DMS API to support R3 data defs. Update int tests
commit cdf92e61
Author: Matt Wise <wsmatth@amazon.com>
Date: Tue Feb 02 2021 09:09:59 GMT-0600 (Central Standard Time)
Work on supporting R3 data def for DatasetRegistryAPI/Service
commit 204fd922
Author: Matt Wise <wsmatth@amazon.com>
Date: Fri Jan 29 2021 08:43:08 GMT-0600 (Central Standard Time)
Add schema service client
ethiraj krishnamanaidu
Dania Kodeih (Microsoft)
Wladmir Frazao
Joe
Dmitriy Rudko
Matt Wise
ethiraj krishnamanaidu
https://community.opengroup.org/osdu/platform/system/dataset/-/merge_requests/63
AWS: Fix S3 folder access
2020-12-14T16:05:21Z
Matt Wise
AWS: Fix S3 folder access